Mike Shou
Mike Shou
  • 24
  • 24 256
Tutorial: Video Diffusion Models. Mike Shou, 2023.
This 3-hours tutorial is for beginners who would like to quickly get into Video Diffusion Models (VDMs), covering study various subtopics of VDMs and their corresponding works as of Nov 2023. Due to the limited time for preparing this tutorial over the past several weeks, likely we miss out some works, sorry for that. Please feel free to command in the below and add some introduction about the paper, thank you so much.
Slides pdf download: sites.google.com/view/showlab/tutorial
Speaker Bio: www.comp.nus.edu.sg/cs/people/mikeshou/
Twitter: MikeShou1
Outline:
00:00:00 - 0. Intro & outline
00:03:09 - 1. Fundamentals of Diffusion Models
00:22:28 - 2.1 Video Gen, Pioneering Works, Task Definition and Evaluation Metrics
00:51:32 - 2.2 Video Gen, Open-source Base Models
01:09:50 - 2.3 Video Gen, Other Closed-source Works
01:10:12 - 2.4 Video Gen, Training-Efficient Techniques
01:19:56 - 2.5 Video Gen, Storyboard
01:35:51 - 2.6 Video Gen, Long Video Generation
01:40:08 - 2.7 Video Gen, Multimodal-Guided
01:45:23 - 3.1 Video Edit, Tuning-Based
02:08:23 - 3.2 Video Edit, Training-Free
02:14:40 - 3.3 Video Edit, Controlled Editing
02:56:36 - 3.4 Video Edit, 3D-Aware
03:15:52 - 3.5 Video Edit, Other Guidance
03:19:50 - 4. Summary
#aigc #videogeneration #videoediting #ai #computervision
Переглядів: 13 064

Відео

Show-1 open-sourced !!! Marrying pixel and latent diffusion models for text-to-video generation
Переглядів 91Рік тому
🔥 We're thrilled to announce the release of the code and model weights of Show-1 at github.com/showlab/Show-1 💡 Show-1 is our latest text-to-video generation model that marry the strength and alleviate the weakness of pixel-based and latent-based VDMs. Compared to latent VDMs, Show-1 can produce high-quality videos of precise text-video alignment; Compared to pixel VDMs, Show-1 is much more eff...
Jun-yan Zhu, ICCV 2021 Workshop on Share Stories and Lesson Learned
Переглядів 1,2 тис.3 роки тому
Invited Speaker: Jun-yan Zhu, CMU "The learning algorithms" learn from shared experience; learn from role models; learn from feedbacks; learn from trial and errors Find out more info at sites.google.com/view/1st-ssll-workshop-iccv21
Manohar Paluri, ICCV 2021 Workshop on Share Stories and Lesson Learned, “Research is a process”
Переглядів 5223 роки тому
Invited Speaker: Manohar Paluri, Director at Facebook Reality Lab “Research is a process, not a destination": About me; My academic journey; My corporate journey; Looking back on successful projects; Management Lessons Find out more info at sites.google.com/view/1st-ssll-workshop-iccv21
Yaser Sheikh, ICCV 2021 Workshop on Share Stories and Lesson Learned, “Virtual To Real”
Переглядів 1 тис.3 роки тому
Invited Speaker: Yaser Sheikh, Director at Facebook Reality Lab “Virtual To Real: surround yourself with smart, solve problems not papers, find yourself mentors early" Find out more info at sites.google.com/view/1st-ssll-workshop-iccv21
Rahul Sukthankar, ICCV 2021 Workshop on Share Stories and Lesson Learned, “Research in Industry”
Переглядів 5373 роки тому
Invited Speaker: Rahul Sukthankar, Distinguished scientist at Google Research “Working in Industrial Research” - Rahu’s 20 years research journey in industry, 4 dimensions for research projects at Google, how to choose your project, 5 anti-patterns to avoid Find out more info at sites.google.com/view/1st-ssll-workshop-iccv21
Mandela Patrick, ICCV 2021 Workshop on Share Stories and Lesson Learned, “The PhD playbook”
Переглядів 2973 роки тому
Invited Speaker: Mandela Patrick. Recent PhD graduate from Oxford "The PhD playbook: It takes a village; The paper checklist; What’s next?" Find out more info at sites.google.com/view/1st-ssll-workshop-iccv21
Gang Hua, ICCV 2021 Workshop on Share Stories and Lesson Learned
Переглядів 2913 роки тому
Invited Speaker: Gang Hua, Vice President at Wormpex AI Research "Your research career vs. Your industry career" Find out more info at sites.google.com/view/1st-ssll-workshop-iccv21
Bolei Zhou, ICCV 2021 Workshop on Share Stories and Lesson Learned
Переглядів 7113 роки тому
Invited Speaker: Bolei Zhou, Asst Professor at The Chinese University of Hong Kong "Strength and broaden research territory; The rejected behind the accepted" Find out more info at sites.google.com/view/1st-ssll-workshop-iccv21
Xinshuo Weng, ICCV 2021 Workshop on Share Stories and Lesson Learned
Переглядів 7653 роки тому
Invited Speaker: Xinshuo Weng, Senior PhD student at Carnegie Mellon University "Tips for PhD applications; story of managing multiple projects in parallel during PhD" Find out more info at sites.google.com/view/1st-ssll-workshop-iccv21
Dima Damen, ICCV 2021 Workshop on Share Stories and Lesson Learned
Переглядів 3903 роки тому
Invited Speaker: Dima Damen, Professor at University of Bristol "The story behind the EPIC-KITCHENS dataset" Find out more info at sites.google.com/view/1st-ssll-workshop-iccv21
Devi Parikh, ICCV 2021 Workshop on Share Stories and Lesson Learned
Переглядів 1,5 тис.3 роки тому
Invited Speaker: Devi Parikh. Associate Professor at Georgia Tech "Tips for early-career faculty" Find out more info at sites.google.com/view/1st-ssll-workshop-iccv21
Closing remark by Linchao Zhu at CVPR'21 LOVEU Workshop
Переглядів 1153 роки тому
More details: sites.google.com/view/loveucvpr21 International Workshop and Challenge on Long-form Video Understanding at CVPR'21
Q&A section for CVPR'21 LOVEU Challenge
Переглядів 633 роки тому
More details: sites.google.com/view/loveucvpr21 International Workshop and Challenge on Long-form Video Understanding at CVPR'21
Presentation by OPPO Visual Analysis of Humans (Third Place in Track 1) at CVPR'21 LOVEU Workshop
Переглядів 923 роки тому
More details: sites.google.com/view/loveucvpr21 International Workshop and Challenge on Long-form Video Understanding at CVPR'21
Presentation by ByteVideo (Second Place in Track 1) at CVPR'21 LOVEU Workshop
Переглядів 1583 роки тому
Presentation by ByteVideo (Second Place in Track 1) at CVPR'21 LOVEU Workshop
Presentation by Yonsei_CIPLAB (First Place in Track 1) at CVPR'21 LOVEU Workshop
Переглядів 4783 роки тому
Presentation by Yonsei_CIPLAB (First Place in Track 1) at CVPR'21 LOVEU Workshop
Presentation by SAIC_KAUST (Winner in Track 2) at CVPR'21 LOVEU Workshop
Переглядів 2663 роки тому
Presentation by SAIC_KAUST (Winner in Track 2) at CVPR'21 LOVEU Workshop
Chao-Yuan Wu (FAIR) at CVPR'21 LOVEU Workshop. Towards Long-Form Video Understanding.
Переглядів 3903 роки тому
Chao-Yuan Wu (FAIR) at CVPR'21 LOVEU Workshop. Towards Long-Form Video Understanding.
Matt Feiszli (FAIR) at CVPR'21 LOVEU Workshop. Opening remark.
Переглядів 2623 роки тому
Matt Feiszli (FAIR) at CVPR'21 LOVEU Workshop. Opening remark.
Mike Shou (NUS) at CVPR'21 LOVEU Workshop. Challenge Intro & Summary.
Переглядів 4723 роки тому
Mike Shou (NUS) at CVPR'21 LOVEU Workshop. Challenge Intro & Summary.
Andrew Zisserman (Oxford) at CVPR'21 LOVEU Workshop. Long-term video modelling with transformers
Переглядів 1,1 тис.3 роки тому
Andrew Zisserman (Oxford) at CVPR'21 LOVEU Workshop. Long-term video modelling with transformers
Ivan Laptev (INRIA) at CVPR'21 LOVEU Workshop. Towards affordable long-term video understanding.
Переглядів 2583 роки тому
Ivan Laptev (INRIA) at CVPR'21 LOVEU Workshop. Towards affordable long-term video understanding.
Raquel Urtasun (UoT, Waabi) at CVPR'21 LOVEU Workshop. Interpretable Neural Motion Planner.
Переглядів 1973 роки тому
Raquel Urtasun (UoT, Waabi) at CVPR'21 LOVEU Workshop. Interpretable Neural Motion Planner.

КОМЕНТАРІ

  • @wunian-sx1es
    @wunian-sx1es 5 місяців тому

    Amazing video. It helps me a lot.

  • @vijayendradwari
    @vijayendradwari 6 місяців тому

    Thank you professor

  • @AkhilChaturvedi-b3u
    @AkhilChaturvedi-b3u 11 місяців тому

    Absolute gem of a tutorial. Can't thank you enough!

  • @정현호-u9j
    @정현호-u9j Рік тому

    Amazing tutorial! 👏👏

  • @yewang9647
    @yewang9647 Рік тому

    Awesome Tutorial!

  • @krisman2503
    @krisman2503 Рік тому

    Thanks. Great tutorial for the video diffusion. Cann't find a better one!!

  • @SR-zi1pw
    @SR-zi1pw Рік тому

    Great video make more ❤

  • @canxkoz
    @canxkoz Рік тому

    great tutorial! thank you!

  • @alanmelling3153
    @alanmelling3153 3 роки тому

    Thank you for sharing your story and your accumulated wisdom.

  • @DeepakSingh-xt5io
    @DeepakSingh-xt5io 3 роки тому

    Thank you for uploading :)

  • @joyachen4978
    @joyachen4978 3 роки тому

    keep calm and move on. Wonderful talk. Thank you!

  • @fatmaguney3598
    @fatmaguney3598 3 роки тому

    this is amazing, so helpful, thank you very much!

  • @홍성훈-u9k
    @홍성훈-u9k 3 роки тому

    Great work!