The Neuroscience of “Attention”
Вставка
- Опубліковано 8 чер 2024
- What is "attention" and why did our brains evolve to prioritize things? This is the Episode 0 of the series "Visual Guide to Transformer Neural Networks" that delved into the mathematics of the "Attention is All You Need" (Vaswani, 2017) paper. This video discusses the neuroscience and the psychology related aspects of "Attention".
Visual Guide to Transformer Neural Networks (Series) - Step by Step Intuitive Explanation
Episode 0 - [OPTIONAL] The Neuroscience of "Attention"
• The Neuroscience of “A...
Episode 1 - Position Embeddings
www.youtube.com/watch?v=dichI...
Episode 2 - Multi-Head & Self Attention
www.youtube.com/watch?v=mMa2P...
Episode 3 - Decoder’s Masked Attention
www.youtube.com/watch?v=gJ9ka...
Credits - Video
1. Cosmos: Possible Worlds - • Official Trailer | Cos...
2. Transport inside the brain: The basic mechanisms of neuronal trafficking - • Transport inside the b...
3. Zoom Into Eye Effect Premiere Pro - • Zoom Into Eye Effect P...
4. The Beauty Of Earth - • The Beauty Of Earth
5. Norway | Mountains - • Norway | Mountains
6. Icheon Master Hand - • Icheon Master Hand
7. Labs of Cognitive Neuroscience - Nelson Lab - Boston Children's Hospital - • Labs of Cognitive Neur...
8. UCSF Dyslexia Center Phenotyping Project - Brain Imaging - • UCSF Dyslexia Center P...
9. Dissecting Brains - • Dissecting Brains
10. Hypatia | The Philosopher - • Hypatia | The Philosopher
11. Visual Attention - • Visual Attention
12. Optical illusions show how we see | Beau Lotto - • Optical illusions show...
13. Zoom Into Eye Effect [After Effects 2020 Transition Tutorial] No Plugins Required - • ZOOM INTO EYE EFFECT [...
14. Baby's Choice - Toys Vs Literally Anything Else - • BABY'S CHOICE - TOYS -...
15. Infant Looking Time Habituation. Activity 2 from "What Babies Can Do" - • Infant Looking Time Ha...
16. Karl Loxley - Never Enough (from The Greatest Showman) [Official Music Video] - • Karl Loxley - Never En...
17. Funny Phone Accidents Texting While Walking Fail!1 - • Funny Phone Accidents ...
18. TFL Viral - Awareness Test (Moonwalking Bear) - • TFL Viral - Awareness ...
19. Selective Attention Test - • Selective Attention Test
20. Misdirection and Inattentional Blindness - • Misdirection and Inatt...
21. World's Most Famous Magic Tricks Revealed! - • World's Most Famous Ma...
22. Smoothini's Top 7 Magic Tricks Finally Revealed | America's Got Talent - • SMOOTHINI'S TOP 7 MAGI...
23. The art of misdirection | Apollo Robbins - • The art of misdirectio...
24. The extraordinary final test to become a Shaolin Master | Sacred Wonders - BBC - • The extraordinary fina...
25. Horse Riding Cinematic - Red Scarlet- • HORSE RIDING CINEMATIC...
26. Hidden Figures Official Trailer 1 (2017) - Taraji P. Henson Movie - • Hidden Figures Officia...
27. 11 | Desiertos-Directors Cut | Directed By Diego Pernía - • 11 | Desiertos-Directo...
28. Inception - Ariadne Learns How To Build Dreams - • Inception - Ariadne Le...
29. The Neuroscience of Learning - • The Neuroscience of Le...
30. The Most Insane Piano Pieces (Vol. 1) - • The Most Insane Piano ...
31. Markus Eder's The Ultimate Run - The Most Insane Ski Run Ever Imagined - • The Most Insane Ski Ru...
32. Muhammad Ali Dodges 21 Punches In 10 Seconds - • Muhammad Ali Dodges 21...
33. Collaborative Video Object Segmentation by Foreground-Background Integration - • Collaborative Video Ob...
34. My Tips for Prompts, Part 1 (Invent Good Prompt for Disco Diffusion) - • My Tips for Prompts, P...
Credits - Music
1. Royalty Free Cinematic Trailer Music | Cinematic Trailer Background Music By Music4video - • ROYALTY FREE Cinematic...
2. Whitesand - Eternity (Epic Beautiful Dramatic Emotional Instrumental) [Copyright Free] - • Whitesand - Eternity (...
3. Science & Technology Background Music For Presentation No Copyright Royalty Free - • Science & Technology B...
4. Anastasiya Lunes - Desert Rose (Sting Cover Mix) With Lyrics (No Copyright) - • Anastasiya Lunes - Des...
5. Karl Loxley - Never Enough (from The Greatest Showman) [Official Music Video] - • Karl Loxley - Never En...
6. Sufi dance - • Sufi dance - Наука та технологія
what have i just saw!
never knew learning could be this much fun
This is ART, I'm sharing this with all my DL hommies
So glad to hear this :)
This video is made up of quality, substance and heart, hard to find all these things in one place. Great job and thank you. It is a shame that not enough people have benefited from it.
"made up of quality, substance and heart ..." such nice compliment! Thank you! :,)
That's a fantastic video. It's like a hidden gem that I have never watched on UA-cam. It's very inspiring! Thank you so much.
Yup, this channel deserves my attention.
Awesome, it's amazing how looking at things a bit more closely can reveal so much, great work!
I rarely comment on YT videos but this was so beautiful! What an underrated channel :0 I need to thank my teacher for recommending it and also I’m gonna share this with all my friends. Thank you for your excelent work!
You are bringing the introduction of a computer science topic to a new level: Art!
This video is so informative and influential that it should be at the top of a permanent recommendation list of all users in youtube. UA-cam should come up with such a list just for this video. It is that good. Hands down!
Best deep learning instructor on UA-cam. Thorough, responsive, detailed, and actually explains the topic (lots of other channels just talk through a paper or book or article!) . You arr awesome,
Your comment is such an accolade. Thank you! :)
I stumbled upon a gold mine. This channel is criminally underrated !
Wow! I found a treasure today! and subscribed to it :)
Beautifully explained! Great level of clarity in every single video. Perfect explanation! Particularly, the transformer videos are really insightful.
Really underappreciated. I have no doubt that this channel will gain a lot more subscribers! Please keep uploading.
You made my day :,) Thank you!!
You are amazing! Your video took my attention. That is how learning should be. Keep it up!
Truely phenomenal. This video really grab my full *attention* 😃. Your other videos about transformer also very intuitive. I am a big fan of this style and look forward to see more in the future 😊
This is soo cool. I even did not get the background of the paper. It turns out so natural. Thanks
It is amazing. You just went ahead and explained attention within such a short video in a fully understandable manner. I think it is the "Attention" in the creation of your video.
The only playlist to watch , which can make you learn, more than transformers , the best playlist 💯
Thank you very much Batool for posting this video. I've been following your channel for 2-3 years and every video that you have created is a gem, breaking complex subjects into simple golden nuggets.. The visualization that you use in your content is a piece of art.. In this video, the analogy of the conscious and sub conscious mind to the driver & the horse power blew my mind... The finishing touch on the cosmos and our position in our cosmos, it struck me very hard spiritually.. Please keep posting more videos, I'd be happy to support your channel in any way I can...
Thank you so much @vjaiic for such beautiful words of appreciation!!
Just Wow. Those captivating videos and soothing voice really keeps my attention. feels like a engrossing show rather than a simple educational video
This is an amazing video from the learning standpoint. Very thorough explained. The art & animation used was very relevant that helped me understand & pickup the message quickly. Your voice is amazing too. I look forward to the next video!
@16:17
This is hands down the most elegant definition of Machine Learning I've come across!
One of the best videos I've watched, gave me goosebumps!
Thank you
We need more videos from you, Hedu. You're great at explaining things.
You are an enligthened soul!
Truly fascinating and well presented.
Why on earth do you have only 6K subs. This content is mind blowing!
EDIT: I obviously subscribed!
Amazing video, well done. congratulations.
You are awesome. I met your channel through the transformers series and it helped me a lot. They are very didactic and also fun, bringing humanities and general culture along, something that this machine learning field lacks some times. And this new video was also great, it was beautiful, and you improved your editing and composition greatly. Continue with all of that :)
You are awesome too for being so generous with your words of appreciation
Exactly..., i stumbled on this channel while learning transformers, the transformer series is really awesome.
@@kloki2k1 Thank you :)
Felt like a very good Nova episode!
Thankyou, You must keep this learning going.. people need such teachers ❤
What a great video!
Amazing video!
Fantastic. Thanks
i was searching youtube for fast reaction to things in life (((i dont react fast to things as if my brain is dead, think of it as someone throwing a ball at you and you stand still))), and how to improve it; but youtube brought this video instead.
attention is really well explained by you, tho it is not the video i am looking for, but liked it.
Great Job
This is something next level !!
Amazing video! Greetings from Data Scientist from Serbia!
Amazing video! great content :)
What a beautiful video ❤❤❤
Best intro I have seen, subscribed
Aweeeesome..... my tears came out after long period.😬🤩🤩
Made my day!
Whoa... whatta video is this? I have never come across such an amazing video on any internet source which explains a concept so beautifully !! How did I miss this all these years? I came here to understand transformers & their working in detail - hope I will be successful in my quest :-) Thanks a lot for this video.
I hope so too!! (that you are successful in your quest. Let me know :)
great explainer
Amazing work. Your voice is equally soothing as your video. Thank you for sharing
Thanks Azad! :)
Amazing
Excellent video as usual.
Glad you liked it! :)
great channel
wow lady, take my heart!!
Woowww.... excellent....
Why aren't you uploading more videos, u have a very easy and simple way to explain things and I would extremely love to see you explaining more such concepts
Great work, please keep uploading
Yep! Working on it ... cheers!
Awesome
Fantastic video!
Thanks! :)
beautiful
Great🎉🎉🎉
J4f The Moon walking bear example scared me 😅
"Attention is just a make-shit strategy evolution came up with to optimize the brain's energy consumption."
"Who am I? ... You are what you pay attention to."
Beautiful video. Intelligently written. An insightful combination of facts and perspective.
Your "attention" to the details is pretty remarkable :)
Where were you undiscovered gem! 💎
Simply amazing! Your video is very insightful. Hopefully, you can create more content on the other popular neural network architecture and their relation to the human brain (like CNN, GAN)
Thanks Fikriansyah! Yes, I am working on those :)
What a beatiful video!
+1 subscriber :)
Thank you Brenda! :)
In Transformers, to perform SELF attention- Q, K and V are all a copy of the same input embeddings. suppose you wanted to use features X to look for similar features given features Y (i.e not SELF attention): should Q and K be X and Y be V OR how would it be? ...q k and v are query key and value
Umm, not sure I fully understood your question but let me attempt to answer it. So Q is "query" like "UA-cam search query". "Key" is say, the "title" search that the UA-cam algorithm, does. Value is the "final video" that gets returned, because its title (or the key) was the most similar to the search query (i.e. Q). Self attention uses self-copies because we are trying to find the relationship of words among themselves. Now, if you want to use Q to retrieve V without self attention, then that is the case of simple attention which was quite prevalent before self attention was introduced. And yes, in that case who could use Q and V directly as separate features (X and Y).
I couldn't play the rest of the episodes - Visual guide to Transformer networks. Is that working for any of you? Or is it still to be posted?
Anyways, climax 'Who am I' is good. Attention: Crying baby gets the attention. I mean, any anomalies to what our brain already holds memory of, easily gets attention. For a doctor, esp. Surgeon, Blood will not get their attention, but for rest of us, a tiny blood spot on our friend's shirt or body may easily fetch attention.
Hmm, all videos are up. Can you not open this - ua-cam.com/video/dichIcUZfOw/v-deo.html
Btw, great summary of attention :)
@@HeduAI Yes, I am able to watch them now. Thanks for the great presentation.
This channel is quite underrated!
I would buy your channel's NFT, if I could!
Even though you made very few videos, they are damn beautiful. ❤️ Ur vids.
Thanks! :)
All your videos are amazing
Amazing example of the duck haha
What happened to part 0 of the transformers series? :(
This is "Part 0". Why, did you not like it? :D Let me know of your feedback, if you didn't.
@@HeduAI No I really thought the video was great, you are such a great and underappreciated explainer and story teller.
But I was checking in again on the "Visual Guide to Transformer Neural Networks" video series and was missing part 0 of that series.
@@HeduAI No I really thought the video was great, you are such a great and underappreciated explainer and story teller.
But I was checking in again on the "Visual Guide to Transformer Neural Networks" video series and was missing part 0 of that series.
@@HeduAI This is such a great production. To be able to explain this very difficult and complex concept from so many angles, so people can understand easily, is very rare. The video quality comparable to videos from large commercial teams. But commercial teams with good story telling abilities would never touch such nerdy and complex subjects, not to mention explaining the math in full detail, that makes your work even more awesome. It makes me wonder if you're just one person, or a secret team, or some AGI generated being. :)
@@alexchoy9526 You just won the "Most Thoughtful Compliment Ever" Award! Thank you! :,)
distractions are all I need
I thought it was an ad at first
4:20 That baby made me yawn
I missed the bear 🐻
why you are making videos having alot of gaps, please try to upload atleast 1 video in a week🙃👏
Who are you?