Autoencoders Explained Easily

Поділитися
Вставка
  • Опубліковано 28 тра 2024
  • Join The Sound Of AI Slack community:
    ua-cam.com/users/redirect?even...
    Learn how autoencoders work in an intuitive way. Learn about representation learning, latent space, and other fundamental concepts. I also explain how autoencoders are applied to important tasks such as data generation and denoising.
    Slides:
    github.com/musikalkemist/gene...
    Interested in hiring me as a consultant/freelancer?
    valeriovelardo.com/
    Follow Valerio on Facebook:
    / thesoundofai
    Connect with Valerio on Linkedin:
    / valeriovelardo
    Follow Valerio on Twitter:
    / musikalkemist
    ===============================
    Context
    0:00 Intro
    1:17 Key idea in autoencoders
    3:03 Encoder
    4:15 PCA vs Encoders
    7:05 Decoder
    8:21 Training autoencoders
    10:13 Optimal autoencoder
    12:57 Deep Autoencoder
    14:11 Deep Convolutional Autoencoder
    16:15 What's the point of compression/decompression?
    17:12 Autoencoder applications
    17:51 Generation with autoencoders
    22:29 Denoising with autoencoders
    26:06 Anomaly detection with autoencoders
    26:39 Coming next
  • Наука та технологія

КОМЕНТАРІ • 78

  • @KillKRT
    @KillKRT 15 днів тому +1

    Eventually, after 6 useless videos on this topic, I found this one that clearly explains why, what and how autoencoders are doing! Great video! Bravo Valerio!

  • @avidreader100
    @avidreader100 3 роки тому +13

    I am reminded of my boss asking for a 10 page report, and then asking for a 1 page summary. After some deliberation, he would again ask for expanding the summary to a 3 or 4 page report. What would happen is the important elements would get picked when we reduce and these would be elaborated when we expand again.
    Intuitively one catch would be the error should not be minimized to a very low value. Perhaps we would call that over fitting. The balance may be in how high is the correlation retention relative to data reduction.

  • @dhruvmatani7824
    @dhruvmatani7824 Рік тому +4

    Valerio thanks so much for putting together such great content and providing insights into Machine Learning concepts!

  • @mejimix
    @mejimix 5 місяців тому

    This channel is gold!. It really helps to understand Ai, and its "convoluted" topics. The terminology really confuses me, but you manage to explain it in a very simple way. Watched 3 videos already ... more to go!

  • @cafardine
    @cafardine Рік тому

    Well done. Great explanations without being oversimplified

  • @omidstudies2926
    @omidstudies2926 Рік тому +1

    Thanks for the great presentation that does not make the subject so complex and keep it as simple as possible.

  • @wixor_69
    @wixor_69 3 роки тому +7

    Epic. Just what i was looking for

  • @hackercop
    @hackercop 2 роки тому

    27:04 yay, looking forward to watching the next video. Thanks for making this series.

  • @ueakarnviwatpanachat9606
    @ueakarnviwatpanachat9606 3 роки тому

    Love all your videos! Looking forward to the next video from this series :)

  • @autismo1969
    @autismo1969 Рік тому +1

    very well explained, in perfect detail. thanks a lot man

  • @rajeshpalgp120
    @rajeshpalgp120 Рік тому

    Don't have any background in CS, but,2 mins into the video and you are so easy to understand.

  • @gustavwahl
    @gustavwahl 2 роки тому

    Great video! When are you going to publishing a video for anomaly detection?

  • @jaytube277
    @jaytube277 8 місяців тому

    Great video Valerio, thank you so much!

  • @vladimirbosinceanu5778
    @vladimirbosinceanu5778 10 місяців тому

    I don't know why, but it was so easy to understand it once you made the 2D plane instend of two nodes there. Awesome

  • @tunestar
    @tunestar 3 роки тому

    Excellent! Can't wait for next video!

  • @tasnimalaref3121
    @tasnimalaref3121 6 днів тому

    I really enjoyed every secound, it was very helpful. Thank you :)

  • @phuonglethithanh8498
    @phuonglethithanh8498 10 місяців тому

    Thank you for this video. Very easy to understand ❤

  • @kavinyudhitia
    @kavinyudhitia Рік тому

    Oh my!! Your video made a lot of sense!! thanks a lot and subscribed!!

  • @Nunocesarsa
    @Nunocesarsa 3 роки тому +2

    cool! just gave me a research idea x) nice, clear and simple!

  • @pavankumarkhot8521
    @pavankumarkhot8521 2 роки тому

    Awesome!! Best explanation I have ever seen 👏👏🙌😍😍

  • @yumenoqiao
    @yumenoqiao 11 місяців тому

    Extremely useful and easy to understand 🎉🎉🎉❤❤❤thank you so ooo much

  • @fabioantonini5421
    @fabioantonini5421 2 роки тому

    Great job! Thanks for sharing😊

  • @killersride2108
    @killersride2108 3 роки тому +2

    Great video! I am keen to see the implementation of this.
    What are your thoughts on using GANs to generate spectrograms?

    • @ValerioVelardoTheSoundofAI
      @ValerioVelardoTheSoundofAI  3 роки тому +2

      GANs are also effective at spectrogram generation. I'll definitely cover them at some point in the future.

    • @shivambatra70
      @shivambatra70 3 роки тому +5

      @@ValerioVelardoTheSoundofAI Please conver them. I am waiting for that for over a month now and there is no other channel which cover audio processing as you 😃

  • @EngRiadAlmadani
    @EngRiadAlmadani 3 роки тому

    great work sir
    my question is can we use kernel pca as encoder in Autoencoders because as I know it can reduce the dimensions of nonlinear data

  • @gildasorseau9783
    @gildasorseau9783 3 роки тому +2

    Thanks a lot Valerio, I really like the way you explain all of these "non-obvious" stuff !
    I would really appreciate if you could make a video which deal with AEs for Anomaly detection.
    Do you still plan to cover this item, as you mentionned in this video ?
    If so, by when do you think possible to have it ready ?
    Thanks again, and above all : keep on going !

    • @ValerioVelardoTheSoundofAI
      @ValerioVelardoTheSoundofAI  3 роки тому +1

      Thank you Gildas! I intend to cover AEs for Anomaly Detection in a self-contained video / project. Not sure when it'll come out, but it's in the pipeline ;)

    • @manuelmuller-wb3le
      @manuelmuller-wb3le 6 місяців тому

      @@ValerioVelardoTheSoundofAIThanks a lot Valerio! I am new to the field of audio signal processing and especially to AI approaches. Your channel helped me a lot. It was perfect to get an understanding of the whole topic. I am currently writing my master thesis in the field of anomaly detection of engine noise. I wanted to use an autoencoder as an example for the detection. I would therefore also be interested to know whether you are planning a video on this or whether it is already available on your channel. Thank you for the work and time you put into your channel! Keep up the good work! :)

  • @peterkanini867
    @peterkanini867 10 місяців тому

    Great explanations! One question though. In the denoising example, how different is using Autoencoders from regular deep learning? I mean, you feed in the audio with the noise and test your results against the clean audio which kind of acts as the label to the data.

  • @saurabhpandey4357
    @saurabhpandey4357 2 роки тому

    please make a video on semi-supervised learning along with practical implementation.

  • @amcoderipper4116
    @amcoderipper4116 11 місяців тому

    Thanks so much!
    شكراً جزيلاً 😎

  • @franklyvulgar1
    @franklyvulgar1 11 місяців тому

    working on a project that does this in some way right now :) the first thing I thought was, why use random noise when a latent vector would work so much better.

  • @carlystair5502
    @carlystair5502 Рік тому

    Great video! Thank you!

  • @chaimarebah115
    @chaimarebah115 2 роки тому

    I will use autoencoder for speech watermarking I hope you will aborde this subject too and thank you for this awesome videos you are the best

  • @entertainmenttv2362
    @entertainmenttv2362 Рік тому

    Best explanation so far

  • @avidreader100
    @avidreader100 3 роки тому +1

    Auto-encoding and de-noising seem to be equivalent to the processes we use for selectively listening to one speaker when in an environment where multiple members are speaking simultaneously.

    • @MARTIN-101
      @MARTIN-101 2 роки тому

      can we do both of the applications at the same time ?

    • @MARTIN-101
      @MARTIN-101 2 роки тому

      can you explain how background noise will be removed.

  • @juliagarciatorne1712
    @juliagarciatorne1712 11 місяців тому

    Good explanation. Thanks!!

  • @Jorge-wf3tg
    @Jorge-wf3tg 3 роки тому +1

    Cool video!! I'm doing a research of speech to speech (voice convertion)

  • @bansalll15
    @bansalll15 Місяць тому

    can I make this project if I'm working on macbook m1 without a gpu?

  • @alisaja11
    @alisaja11 3 роки тому

    nice video!!! thank you so much

  • @tanyachutani7272
    @tanyachutani7272 3 роки тому

    Best video for autoencoders

  • @Shiny_Mewtwo
    @Shiny_Mewtwo 2 роки тому

    Thank you, so helpful

  • @ethiotechnotube7982
    @ethiotechnotube7982 Рік тому

    can we implement VQ to audio classification with python?

  • @ashokbasnet798
    @ashokbasnet798 3 роки тому

    Very Nice session. Would be grateful if you explain attention mechanism implication.

  • @TehCannonMan
    @TehCannonMan 3 роки тому +1

    which loss metric would you use for the deep convolutional auto encoder? cross entropy or RMSE still?

  • @giuseppemastrangelo
    @giuseppemastrangelo 3 роки тому

    Great video 👍🏼

  • @aliazak6948
    @aliazak6948 Рік тому

    At the denoising part, do we always need to have same kind of noise in sound, for AE to denoise it ? For example, can samples with white noise and random noise denoised together ?

  • @ritwikamajumdar5967
    @ritwikamajumdar5967 3 роки тому

    Thank you so much

  • @Alig4realz
    @Alig4realz 2 роки тому

    awesome presentation! Subscribed

  • @kirtipandya4618
    @kirtipandya4618 3 роки тому

    Nice job 👍🏼

  • @MARTIN-101
    @MARTIN-101 2 роки тому

    can someone please explain how can i use auto encoders to filter out the background noise and reatain speaker voice ?

  • @jeremyuzan1169
    @jeremyuzan1169 3 роки тому

    thank you so much

  • @arturakobyan4171
    @arturakobyan4171 Рік тому

    I can't find video about anomaly detection with AEs(

  • @juanestebanflorez2826
    @juanestebanflorez2826 3 роки тому

    Thanks, can you cite your sources? (great explanation. thanks be)

  • @nabeelkoya.a6889
    @nabeelkoya.a6889 3 роки тому

    Great informative video.

  • @pasinduekanayaka8023
    @pasinduekanayaka8023 2 роки тому +1

    Does anyone know how to find what are the important features that are stored in the latent space?

    • @MARTIN-101
      @MARTIN-101 2 роки тому

      did u found a answer ?

  • @mehrdadkazemi3969
    @mehrdadkazemi3969 Рік тому

    ty :)

  • @yashjain6372
    @yashjain6372 Рік тому

    good

  • @ahmedanwer6899
    @ahmedanwer6899 Рік тому

    It's so cool how one idea like autoencoders can be used in audio, anomaly detection and I think even nlp as well! JVUVICFJ

  • @bluestar2253
    @bluestar2253 2 роки тому

    You still didn't explain exactly how the autoencoder works!

  • @chegevarra1036
    @chegevarra1036 Рік тому

    Valerio, can you give me an email? has some important to say/