High Performance Python Processing Pipeline

Поділитися
Вставка
  • Опубліковано 10 січ 2025

КОМЕНТАРІ • 14

  • @deoTS1
    @deoTS1 5 років тому +9

    I’m so excited to see all of these technologies come together in python. 10 years ago this demo would have taken 5 engineers, each with a different domain of expertise, at least a month to put together.

  • @marcelofigueroa
    @marcelofigueroa 5 років тому +3

    This is fantastic! Remarkable succinct presentation, thanks a lot for preparing and sharing this. All the best!

  • @omnomnomz1343
    @omnomnomz1343 2 роки тому

    This is brilliant! Thank you Matthew for the wonderful tutorial. It is short and sweet. And really easy to follow. I shall be using this for a seminar/course for new students in my lab!

  • @dakewla
    @dakewla 5 років тому

    Absolutely incredible. Well spoken, and easy to understand steps. Thanks for this video.

  • @markhou
    @markhou Рік тому

    Matthew - I'm curious to know your thoughts on the new developments in AI. How will this change the landscape for data processing, distributed computing and all things Dask?

  • @neilxu
    @neilxu 5 років тому +1

    Love your work and presentation.

  • @magacho9431
    @magacho9431 3 роки тому

    On the GPU part with dask, you doesn't need to specify threads per block and blocks per grid? I'm considering using dask to scale out one application of mine with multiple gpus

  • @jonarmani8654
    @jonarmani8654 4 роки тому

    Your code starting at 11:17 doesn't seem to work for Windows 10 anymore. Bokeh colors the smooth, fft2, and save functions all black in erred state. I have no way of troubleshooting why, as the error doesn't output to the Jupyter notebook. :(

    • @jonarmani8654
      @jonarmani8654 4 роки тому

      Just realized Jupyter console lists the error: ValueError for "Kernel launch configuration was not specified..." Maybe put an update in the description if the code has changed so much that this demo is already broken? This video isn't even a year old. Also, now I gotta figure out the fix on my own.

  • @BryanYuTx
    @BryanYuTx 5 років тому +1

    Any chance for higher resolution?

    • @MatthewRocklin
      @MatthewRocklin  5 років тому +3

      The uploaded version was quite high resolution. My guess is that it just takes UA-cam a bit to process the higher definition videos. It has only been a few minutes since upload time. Let's hope that things improve if we just wait.

    • @MatthewRocklin
      @MatthewRocklin  5 років тому +2

      Yup, it's looking better now. One just has to wait an hour after uploading :)

    • @BryanYuTx
      @BryanYuTx 5 років тому

      @@MatthewRocklin Patience is a virtue... patience is a virtue! Thanks!