Graph Neural Networks - a perspective from the ground up
Вставка
- Опубліковано 3 чер 2024
- What is a graph, why Graph Neural Networks (GNNs), and what is the underlying math?
Highly recommended videos that I watched many times while making this:
Petar Veličković's GNN video → • Intro to graph neural ...
Michael Bronstein's Geometric Deep Learning keynote speech (beautiful!) → • ICLR 2021 Keynote - "G...
Xavier Bresson's Graph Convolutional Networks lecture → / iiv9r6bjxh
3Blue1Brown’s series on Neural Networks → • But what is a neural n...
If you'd like to go further with GNNs, do get started with Petar's wonderfully compiled list of resources to continue → goo.gle/3cO7gvb
Here's also another awesome compilation, to go further with research → github.com/GRAND-Lab/Awesome-...
Also, the GNN literature is growing so quickly so subscribe to this Telegram channel by Sergey Ivanov to help you keep up → t.me/graphML
Reference blog posts about GNNs:
Michael Bronstein → towardsdatascience.com/geomet... (a must-read), towardsdatascience.com/do-we-...
Amal Menzli → neptune.ai/blog/graph-neural-...
Eric J. Ma → ericmjl.github.io/essays-on-d...
Rishabh Anand → / an-illustrated-guide-t...
(More recent) Distill → distill.pub/2021/gnn-intro/, distill.pub/2021/understandin...
Special thanks to:
Seb, Rish and Jet for reading drafts of this and giving such amazing feedback.
Serene for helping enhance production decisions like design, color, animation flow, time-management for my editing and recording (hahaha), and others.
Jay and Malcolm for being there and encouraging the decision to do this video.
Literature References:
Recommended survey → Wu et al. 2020
Convolutional GNN layers → Defferard et al. 2016; Kipf & Welling 2016
Attentional GNN layers → Monti et B 2017; Veličković et al. 2018
General Message Passing GNN layers → Gilmer et al.2017; Battaglia et al 2018; Wang et B 2018
Halicin → Stokes et al., Cell 2020
-----------------
Timeline:
0:00 - Graph Neural Networks and Halicin - graphs are everywhere
0:53 - Introduction example
1:43 - What is a graph?
2:34 - Why Graph Neural Networks?
3:44 - Convolutional Neural Network example
4:33 - Message passing
6:17 - Introducing node embeddings
7:20 - Learning and loss functions
8:04 - Link prediction example
9:08 - Other graph learning tasks
9:49 - Message passing details
12:10 - 3 'flavors' of GNN layers
12:57 - Notation and linear algebra
14:05 - Final words
------------------
Music by Vincent Rubinetti
Download the music on Bandcamp:
vincerubinetti.bandcamp.com/a...
Stream the music on Spotify:
open.spotify.com/album/1dVyjw...
------------------
Thanks for watching this, and I really hope it was helpful!
A quick introduction - I'm Alex from Singapore, a PhD student at NUS working on machine learning, computer vision and (I guess of course) GNNs for medical imaging and healthcare applications.
I've recently been thinking about doing explainer videos about machine learning or tech, and have always found great value in visual animations of math concepts.
So, thanks Grant Sanderson, James Schloss and the 3b1b team for organizing SoME1 which pushed me to pick up After Effects, research, script and put this together over the past month.
If you have questions or want to connect (please do!), you can:
Find me on Twitter → / alexfoo_dw
Find me on LinkedIn → / alex-foo - Наука та технологія
![ПОЛНАЯ ИСТОРИЯ ЭКЗОРЦИЗМА [Топ Сикрет]](http://i.ytimg.com/vi/qBySr6Bt0B8/mqdefault.jpg)
OUTLINE:
0:00 - Graph Neural Networks and Halicin - graphs are everywhere
0:53 - Introduction example
1:43 - What is a graph?
2:34 - Why Graph Neural Networks?
3:44 - Convolutional Neural Network example
4:33 - Message passing
6:17 - Introducing node embeddings
7:20 - Learning and loss functions
8:04 - Link prediction example
9:08 - Other graph learning tasks
9:49 - Message passing details
12:10 - 3 'flavors' of GNN layers
12:57 - Notation and linear algebra
14:05 - Final words
Only one video on this chanel? Come on. This is top quality content. I would definitely watch anything that gets published there.
This is by far the best introduction to GNNs in UA-cam today. I habe seen many of them. Congratulations and thank you!
From the correct level of mathematical precision, to the pedagogy of the content and up to the voice of the speaker. It all fits like a charm. Chapeau!
Too kind! Thanks so much :)
7 Months later i can just agree to every point of that. Wonderful
Really great job and great animations. What tools do you use to make all these animations? Must be very time consuming
Yes this is the best video on graph neural network BY FAR!!
Today, I understood Message Passing very well. Amazing interactive explanation. People like you make life easier. Thank you, Alex.
Thanks for the kind words! Glad this helped you :)
Amazing how you managed to include so much information in a relatively short video without compromising the depth of explanation. Subscribed and hoping for more content in future.
Best introduction tutorial on GNNs. Many tutorials throw statistics around as an explanation but very few provide the intuition behind it. Well done.
Such a lovely content man! I was having trouble understanding GNNs from other sources, but only your animation made it crystal clear in one go. Cant be thankful enough. Hope you keep making such wonderful explanatory videos on other topics in ML.
Amazing introduction to GNN's, summarizing all the important basics in a beginner-friendly fashion while providing very helpful visuals
Thanks for the kind review! Glad you found this useful :)
Crazy amounts of work has been put into this video. The simplicity was the cherry on the top. Thanks a ton. Gained a new sub.
Bro, you nailed it! This type of explanation is what we need. You are a legend
Such a great explanation for GNN. The examples are easier to understand so that I could clearly get the concept right!! Thanks for the wonderful video!!
Cleverly explained, beautifully animated! Great job!
What an amazing explanation, wondering if you are going to add further on this line .if so ,looking forward for this moment.big thanks
Thanks so much! Glad you found it helpful :) yes I intend to try different topics and different video lengths soon!
I'm writing a master thesis where I'm going to use graph neural networks to calculate traffic flow, so grateful for this thanks Alex!!
Sound awesome! Glad this was helpful, Richard!
dude, the effort you put into this is amazing! Thank you
The best high level explanation I've found, thanks!
Your video is amazing. Well explained with beautiful visualizations. Thanks a lot.
Amazing content...probably the best one which I have watched till now for GNN
Appreciable introduction to make concept totally clear. Keep up the good work !!
Very clear explanation of the high level concepts with a remarkably understandable example!
Alex! Until I watched this video I felt like I was scrambling my brain trying to understand GNNs. Thank you for the gorgeous and clear explanation.
Thank you for the great explanation, Alex. I’ve only just heard of GNNs in recent days and you have clarified things for me. They appear to be very efficient. 👍🙏
Beautifully made and explained, MORE!!
This is fabulously done; the low-level explanation of the CNN analogy and layer's function expression and then abstracting that to a generalised function expression as seen in research papers. Thank you so much!
great introduction & the animation helps a lot! thanks Alex!
You have a gift Alex. Thanks for this beautiful explanation. I hope you continue your amazing work.
Amazing way of explaining it, the animations helped a lot, GREAT JOB! Thanks a loooooooooot.
Magnificent, spectacular presentation, helped a lot in all aspects of my studies.
This is amazing, I can't tell you how much I needed this to see exactly where my models are messing up. Thank you😭!
amazing explanation, we would love a series on graph neural networks from you.
Very clear explanation. Perfect work!
Your video deserves millions of views. SEO your video properly and you will get that. best of luck.
indeed
Thanks for your kind words! Happy this was helpful :) any tips for SEO would be appreciated!
That is the best video explain the GNN and the more intuitive i have seen, thank you a lot.
That's a very impressive way to explain graph nn ... Well done!
Thank you ,sir. This has been the most helpful GNN video for me.
very good explanations. cleared all the doubts, thanks
Great explanation and illustration.
Absolutely amazing video! Subscribed.
really great and detailed explanation. Amazing graphics and text. Please do more !
Amazing and well done video! Thank you for sharing!
Thanks Alex. I'm not a Maths person, yet I enjoyed your video. Looking forward to learn from basics from you 🙏
bro this is the best introduction of gnn I have ever watch.
Wow. This is one of the best videos I've seen. Thank you for putting the effort into the helpful animations too.
Just noticed that this is your first video. you have a gift! please keep making more
one of the best intros to GNN i found on youtube 👍👍
This is amazing!! I sincerely hope you make more!
Thank you! Glad you found this helpful :)
Nicely done! Well illustrated that keeps the learning interesting 👍
Thanks Jia Hao!!
this is the most fun and informative video about GNN
This is the best GNN explainer I've seen. Thank you so much for this! Just one question: What did you use for the animations?
Spectacular work!
Great Video, Simple and easy to understand! appreciate the efforts taken!
We need more videos like this!
I spent like a week reading all the papers and now I stumble upon this video. God I wish I watched this before
Glad this was helpful! The paper reading will definitely pay off haha
Really helpful visual stimulations! ✨
Thanks Serene!!!
Thanks for the simple explaination of GNN
Best explanation I've found sofar on this topic. We need more videos from you!
Thanks for the kind words!
Keep them coming Alex. An amazing explainer. Hats off.
Thank you for your kind words!
What a lucid explanation to a complex topic. Take a bow..
You did an amazing job. I was wondering why did you stop making such videos . If possible please continue doing so
best video so far on the topic of graph neural networks.
Wow, very good explanation. Thank you!
Wow what a nice work! Must have put much effort in this! Thanks for sharing
I still struggle a bit to understand, but I will rewatch it
That was my best presentation video that ı've ever watched. Thanks for everything.
That is a perfect introduction. And what a fascinating topic. Thanks :)
So good! so well done, and clearly explained!
Wonderful! I use perceptrons / multipreceptrons and finally getting into GNN. You have a wonderful explanation! Thank you so much. I am very interested in GNN classification and anomaly detection
Thank you! Glad you found this helpful :) ah yes anomaly detection is very appropriate for GNNs, do pursue it further!
Great job w the animation! It makes the topic easier to understand 💯
Thanks filmmaker Elton!!
Easy explained but still has good depth. Pinnacle of good edu videos.
Best GNN video out there!
Alex! Thank you for this video!!!
very good video. please do more on GNNs. thank you!
This is the best gnn video i've seen
thank you so much for this video! helped me a lot to understand GNNs for my report
This video is very well done thank you!
Really helpful, Good clean explanation👌. Thanks
Thank you! So glad you found this helpful :)
This video was incredibly helpful. Thank you.
Glad you found this helpful! Thanks for the positive feedback :)
The best explanation on UA-cam!!!
Thank you! Glad you found it useful :)
This was a terrific video, thanks. I hope it gets more views.
Hey your way of explaining it is very simple and beautiful 🤩.. Please make more videos like this 🙏🏻 you are too good 🔥
You’re too kind, glad you enjoyed it!
This is best video on GNN for beginners
A new star is born 🌟 good job Alex, with thanks.
Hahaha too kind, thank you! Glad this was helpful to you :)
Man where are you.... we need videos from you
Really great explanation. GNNs seemed hard 15 min back...Thanks a lot!
It's a shame you didn't make more videos, this is like the 3Blue1Brown of NN. Best video on GNN i have ever seen.
best expaination for GNN, Thanks for the video 👌
Amazing, simply...
Amazing explanation. We have lots of hope from Alex. All the best.
Thanks so much for the kind words! :) Glad you found this helpful
Great video! I hope to see more :)
Great video! You saved my life, thousands tons of love from Vietnam
Lovee your pho
Great analysis
Great video! Keep up the good work!
What an honor! Thanks so much, you guys are an inspiration! :)
It's amazing explanation with visualization, really worth like share and subscribe, thanks for sharing such explanation and appreciated your efforts
Wow!! Keep this great work going!! ❤🚀
Thank you! Glad you found this helpful
This an extremely nice video. Thanks you
Hey, this video is amazing! I hope to see more videos from you :)
Cool infographics man!! And nice explanation.
What do you use to create such animations
Thank you!! Glad you enjoyed this. I used After Effects for all the animations :)
Really great video and very clear explanation! If you don't mind me asking, may I know what software do you use to create the animation? Thanks!
Thank you! Glad you found it clear :) I used After Effects for all the animations, and Illustrator for the objects
really good explaination. keep making the videos like this your work is good.
Thanks so much! Glad that this was helpful
Best introduction to GNN
Please continue. Don't let us hang dry after this addictive introduction.
I studied Forney style graphs and Bayesian message passing in uni. This seems extremely similar, but also cool