Regarding your criticism about nested contextmanagers (at 17:35)... Since Python3.10 you are able to write something like this: async with ( aiohttp.ClientSession() as session, session.get(url) as response, ): return await response.json() This is super usefull :)
Thanks a lot for this! Why do I have not seen this before. Is it just me or is python so much getting so much cleaner as javascript for these types of thing (I'm a beginner at javascript so totally biased, I think it looks ridiculous)
I can't count the amount of times I've tried to find the best method for asnyc requests. I've used aiohttp just like you but it never felt right, but I never understood asyncio enough so this was always something I was scared of more than I should have. I am so happy that you have actually shown the best way to do it, it will help a lot in my everyday work!
I'm in love with async python now. Almost all apps will use other services. Almost everything uses REST now. This greatly speeds up by code and it more fun than sync programming. I recommend integrating your applications with Datadog if you can with APM enabled. Very satisfying to see parallel traces and great for optimizations as it can be used to uncover things that one may have thought were running in parallel but were not. Last is, to_thread is not a complete substitute for using aiohttp. Threads will start up slighly slower and I noticed that only 8 threads were running at one time when I used, where as if I used aiohttp everything ran at the exact same time and I was was able to run 100s of request in parallel were as with to_thread I was limited. Perhaps there is some env var i could have set to prevent the 8 thread limit but I could not find any docs on the topic.
I think one way to say it - to say parallelism vs concurrency - is to say the system parallelizes. However, the system handles concurrency. The system chooses to parallelize. The system reacts to concurrency.
you didn't mention the difference between using `requests` + `to_thread`, and `aiohttp`. Although `aiohttp` is more verbose, it is faster since it involves no threads. You can also reduce indentation by creating the session beforehand and reusing it.
Hey Arjan, thanks for posting this! You've opened my eyes to asyncio. I was wondering if you could explain when you'd use async methods vs when you would use Multi Threading through a ThreadPool? Many thanks!
IDK how or why, but the subject matter of your videos seem to show up (UA-cam suggestion page) exactly when I need a bit more understanding of what I'm actually working with at the time. The providence is well received and please keep making great videos. Thank you
Hi Arjan, your videos have been of really great help to me. If possible, a video about using the Aiohttp module with asyncio would be really nice. Fingers crossed. Thank you for all you do!
All other videos and tutorials I saw show the same example with asyncio.sleep()... Thanks for create a custom example a explain very well this tricky subject of python asynchronous programming. +100
Hey Arjan! Thank you for such amazing contents I have learned a lot from your videos. It will be great to see videos about Threading and Multiprocessing. Thank you again.
Hello, Thank you for the information. I like your way of teaching, and I would like to see more advanced topics in python explained by you, If possible please do. Have a good day, thanks.
Concurrency and Parallelism are two steps towards multi-threading (green or not). Concurrency is the first step, and means being able to define and start more than one function at a time without waiting for a return value at the call site. The two functions can run in series or in parallel, on one shared thread or two separate threads, it all depends on the system and hardware and load. They also run in the same process that started them. Parallelism is the second step, it is Concurrency but with an explicit request to try and run truly in parallel, by explicitly using an operating system thread for each function call. But it actually does not imply that the functions will truly run at the same time. It's up to the system to schedule and run these threads, which could be in parallel or in series if there is too much load on the system.
Amazing video and so well explained! I’ve been trying to get a better understanding of how to use asyncio and it’s not easy but you’ve done an incredible job. Will definitely be checking out your other videos. Thanks man!!!
I hope one of your future videos goes into what the async keyword actually does with your code. Sure, I know that *now*, as I worked with async before out of necessity (which was a great learner for me), but before that I was completely befuddled on what that keyword does and why it made my code stop running unless I used something like async.gather().
Thanks for covering async.. I have once written an aiohttp based webservice to retrieve data from neo4j.. Aiohttp github page have some nice async libraries collections.. I hope more developers will release async libraries as well..
That is very useful and interesting video discussing asyncio library. I was about to read the docs, but now I think I don't have to, thanks to your video! Great content! Thanks for that!
I really like the practical approach of exploring the topic, it's my favorite way of learning things. Keep going! just subscribed and signed up for the diagnosis course, eager to start and jump to the next ones. Thanks for sharing
Just one thing. You compare sync version with print in loop vs async with just one print. Of course it doesn't change the fact that async is much faster but to get more accurate results we have to remember to measure functions without unwanted code like slow prints ;-) Anyway great video. I'm mid developer that switched to python from other scripting language. I recently found your channel and liked it very much. I'm learning a lot from you. Thank you for all your great work!
Since you said that you "don't like these nested 'with' statements" 17:36, I remember there is a Python feature probably not so well known: you can declare multiple variables in one 'with' statement by delimiting them by commas 🙂
Comment before watching the full video: I wrote my first bit of code using asyncio (an example implementation of a library I've built) just a few days ago after watching your previous videos on asyncio. Very cool. Building an interactive CLI tool that runs a networking application in the background has been on my to-do list for a long time, so I'm quite happy I figured it out. On a separate topic, have you considered making a video on publishing python packages to PyPI?
Kind of mind boggling. I studied software engineering at an university in Germany for several years and they never bothered to teach us such moderns way of software engineering. I'm learning way more about software engineering on this channel than at the university, which is both fascinating and disturbing at once. I'm kind of disappointed by the things I learned at the university. The stuff I learned there barely scratched the surface of actual software engineering.
TL;DR # Excellent, thank you for the great content.# I really appreciate your work as thinking how much time you spent to create high quality contents like this. I watched a lot of videos when I started coding but %90 of them was like demonstrating an isolated feature of Python using a Jupyter Notebook. I accept that I learned so much things from them but here was the problem. Even if I learned so much deep, for instance using generators as coroutines that is what basically what asyncio implements now, but I'd never managed to get that advanced techniques together I later realize that was because I learned all the things in isolation and would stuck when it comes to use them all together, that is, the links were missing. Arjan, you did a great job starting to talk about design patterns that I realized the missing links were not the techniques but the philosophy. Therefore I can't recommend your channel enough for people who stuck in the intermediate level of coding and don't know why can't take a step further regardless of whatever new things they learn. I know there must full of people in that situation and think a great deal of them gives up in the end. Your channel is just a treasure for the people in subject and must be spread. As for concurrency, I've always found using preemptive multitasking far from being elegant because it inherently is a brute force approach and I can't imagine anybody who don't love asyncio s/he learns the philosophy behind it. Since we don't have too many options for cpu bound problems because of GIL even if we tackle the problem by splitting it independent sub methods, we can do much for IO bound problems using asyncio and I would appreciate if you consider to continue on the subject. For instance, how can we develop our own cooperative multitasked classes aside from using the external ones (except sending the couroutines to threads). For instance, think a project that used requests-http for its internal processes but doesn't explicitly support asyncio for its public methods. It's obvious that it has capacity for doing that and we can branch and give it our own asyncio support with a little effort and it would be great to learn how an async class should be designed philosophically. The last word is thank you for your great channel and efforts again.
1:47 gives a real life matephor of how asyncio computation compares to parallel computation 3:57 explains what async def means I greatly appreciate that you used pokemon in this video. It really helps me to see with clarity the difference between the actual subject matter. Also 10:28 Rage will most likely yield a Cubone or Gyrados! This video makes me want to sharpen up my list comprehension skills. Thank you for explaining the difference between parallel and concurrent code execution. That really made a lot of sense. Especially bringing up the fact that computers use different amounts of cores in a cpu chip. I didn't know that python can manipulate HOW our chips process our code. I learned something new here.
From what I read, that short answer describing a difference between concurrency and parallelism is incorrect. Parallelism is described correctly, but concurrency is either two lines of customers ordering from a single cashier taking turns, or each line having its own cashier.
http_get_sync is not an appropriate name for code that executes sequentially, line by line, waiting for all locks. Synchronized skating is when two athletes perform the same movement at the same time, in sync. The better their movements and trajectories match, the more perfect the synchronization. Synchronization in programming is precisely the simultaneous execution of two threads or processes on two different CPU cores. We won't overload this definition by requiring that both processes finish at exactly the same time; I think the previous criterion is sufficient. Thank you for your videos; I enjoy watching them.
2 роки тому+6
Did not know asyncio.to_thread, have been using loop.run_in_executor, which requires more setup. Also, reusing the session will save you quite a bit of time when sending many requests to the same end point, as it will reuse the connection. At work, saving the requests.Session halved the runtime of the application, which was was enough and save us the port to asyncio...
First: Great video as always, Arjan! I would really love to see some advandced asyncio topics on your channel. Some additional thoughts on Álvaro's post and the video: 1. Using a session with aiohttp or e.g. httpx brings the same benefits - especially if you have things like authentication in your requests, too. 2. Using asyncio.to_thread has two downsides: First you have the overhead for creating a thread, which consumes resources. Second Python thread execution is handeled by the OS, so you effectivly have no real control, when execution of the thread is interrupted and continued. This takes away some of the control over the program flow from the programmer - while using native coroutines are a bit more predictable. Apart from fast concurrent programs this is something I like most about asyncio - having so much control. So i personally would always prefer a native async library over using a synchronous one with asyncio.to_thread or loop.run_in_executor. If there's no quality alernative for a synchronous library, using asyncio.to_thread a great way to make you code asynchronous, absolutely agreed. 3. If you don't like deep nested context managers, there are some alternatives: not sure for aiohttp but for httpx you can use: client = httpx.AsyncClient() await client.aclose() With a httpx you also have only have one contextmanager (not two) using a session this way: async with httpx.AsyncClient() as client: r = await client.get('www.example.com/') As context managers are very common in async libraries (e.g. if you use sqlalchemy) you could also an AsyncExitStack to enter many contexts without having to indent every time. 4. You meantioned async Python getting easier with Python 3.10. Was there something added in this version for asyncio? I really can't remember - or did you mean it more generally with the features added in versions before? I hope this post does not sound to negative. I really love your videos and I'm very thankfull for learning so much from them! Just wanted to point out some things to consider. One last question: Are there are payment options aparart from credit card on your homepage or would you consider to add some other options in the future?
Try out concurrent.futures.ThreadPoolExecutor() it may be even easier. The downside to using .to_thread is that it is using threads to get concurrency and passing the operation to the OS rather than handling it manually. The benefit of asyncio is that you have concurrency in a single thread and you are controlling it but to do that you need to await a function that supports async operations. For that you would need to use aiohttp or httpx instead of requests which relies on the socket library which is blocking and doesn't support async.
I would love to see someone try to make a video with a full solution, like asyncio getting http requests like thousands of them, and loading on a database, it would use pandas? or just dictionaries or data classes?
This was just complex enough that I thought - We need a diagram. The verbage is rather fast alas when trying to grasp new ideas, plus watch what is going on with the typing. Diagrams pls!
To get a more accurate difference in sync and async calls, You should have tested without printing the Pokemon for each of the loop iteration. Since Print statement in itself takes some time.
💡 Get my FREE 7-step guide to help you consistently design great software: arjancodes.com/designguide.
Let's go deeper in async. Exceptions handling, pubsub pattern and how to manage back pressure.
Nothing specific to asyncio there.
I'll show you how to handle back pressure
@@josephlangford2912💀
@@josephlangford2912 gottem!
I'd be great to see a series of concurrency/parallelization in python.
He should publish it at once.
YES!!!
Regarding your criticism about nested contextmanagers (at 17:35)...
Since Python3.10 you are able to write something like this:
async with (
aiohttp.ClientSession() as session,
session.get(url) as response,
):
return await response.json()
This is super usefull :)
Thanks a lot for this! Why do I have not seen this before.
Is it just me or is python so much getting so much cleaner as javascript for these types of thing (I'm a beginner at javascript so totally biased, I think it looks ridiculous)
woah cool!
Thanks a lot for this
With python 3.11 we can now use Taskgroups as well.
What! This is so cool! Thank you for this!
Best video on async, finally someone who shows why , when and how to use async. Cleared all my doubts, Thank you
15:13 You could leave out both the “await” and the “async”. So “send‗async‗request” becomes a regular function which returns an awaitable.
Love, love, love your presentation style; so systematic, well thought out, and articulate.
I can't count the amount of times I've tried to find the best method for asnyc requests. I've used aiohttp just like you but it never felt right, but I never understood asyncio enough so this was always something I was scared of more than I should have. I am so happy that you have actually shown the best way to do it, it will help a lot in my everyday work!
I would love more examples using queues and event loops
I always check out Arjan when I need to brush up on ways to accomplish things in python.
Very helpful video, Arjan! Exactly what I was looking for! I will be looking forward to even more asyncio videos from you! Thank you!
Glad to hear it was helpful!
I would like to have more videos about concurrency and asynchronous stuff... Please don't wait too long for the video about this topic.
Woah... I'm blown away. Another new level for my Python code career
Thanks so much Charles, glad the content is helpful!
Just what I needed. I've got an app making a bunch of one by one API and SSH calls to my server which takes forever right now.
I'm glad the video was helpful!
Another video on parallel programming could be very nice ! Thanks for all the material you provide, it's really helpful.
Thanks so much, Julien, glad the content is helpful!
I'm in love with async python now. Almost all apps will use other services. Almost everything uses REST now. This greatly speeds up by code and it more fun than sync programming.
I recommend integrating your applications with Datadog if you can with APM enabled. Very satisfying to see parallel traces and great for optimizations as it can be used to uncover things that one may have thought were running in parallel but were not.
Last is, to_thread is not a complete substitute for using aiohttp. Threads will start up slighly slower and I noticed that only 8 threads were running at one time when I used, where as if I used aiohttp everything ran at the exact same time and I was was able to run 100s of request in parallel were as with to_thread I was limited. Perhaps there is some env var i could have set to prevent the 8 thread limit but I could not find any docs on the topic.
Thanks so much - Learning a lot from here . A friend of mine recommended your channel , now I am passing it on to others . Good Luck
I think one way to say it - to say parallelism vs concurrency - is to say the system parallelizes. However, the system handles concurrency. The system chooses to parallelize. The system reacts to concurrency.
you didn't mention the difference between using `requests` + `to_thread`, and `aiohttp`. Although `aiohttp` is more verbose, it is faster since it involves no threads. You can also reduce indentation by creating the session beforehand and reusing it.
I dont think he understands..
Hey Arjan, thanks for posting this! You've opened my eyes to asyncio.
I was wondering if you could explain when you'd use async methods vs when you would use Multi Threading through a ThreadPool?
Many thanks!
Good question
It would be great to see a video about exception handling with asyncio, and forever running tasks using asyncio.
more async videos please, lets go deeper with u - u can explain this stuff very well
Noted! Thanks ;)
This was really very helpful. Can't be not selfish to ask you for more of these. Thanks! 😌
Glad it was helpful!
IDK how or why, but the subject matter of your videos seem to show up (UA-cam suggestion page) exactly when I need a bit more understanding of what I'm actually working with at the time. The providence is well received and please keep making great videos. Thank you
Wow, thank you!
Hi Arjan, your videos have been of really great help to me. If possible, a video about using the Aiohttp module with asyncio would be really nice. Fingers crossed. Thank you for all you do!
this was so hepful, thanks.
Thanks so much, glad the content is helpful!
Great video! Looking forward for a video that refactors sync+unittest to async+unittest
Thank you, glad you liked it!
All other videos and tutorials I saw show the same example with asyncio.sleep()... Thanks for create a custom example a explain very well this tricky subject of python asynchronous programming. +100
Hey Arjan! Thank you for such amazing contents I have learned a lot from your videos. It will be great to see videos about Threading and Multiprocessing.
Thank you again.
you provide really good examples in your tutorials. Amazing channel.
Thank you so much! Glad you like the content.
Hello, Thank you for the information. I like your way of teaching, and I would like to see more advanced topics in python explained by you, If possible please do. Have a good day, thanks.
Concurrency and Parallelism are two steps towards multi-threading (green or not).
Concurrency is the first step, and means being able to define and start more than one function at a time without waiting for a return value at the call site.
The two functions can run in series or in parallel, on one shared thread or two separate threads, it all depends on the system and hardware and load. They also run in the same process that started them.
Parallelism is the second step, it is Concurrency but with an explicit request to try and run truly in parallel, by explicitly using an operating system thread for each function call. But it actually does not imply that the functions will truly run at the same time. It's up to the system to schedule and run these threads, which could be in parallel or in series if there is too much load on the system.
Thanks for improving the way the video looks
Great! I hope more videos about asyncio are coming ^___^
On it 😉
Amazing video and so well explained! I’ve been trying to get a better understanding of how to use asyncio and it’s not easy but you’ve done an incredible job. Will definitely be checking out your other videos. Thanks man!!!
I'm really glad it was helpful! Welcome to the channel :)
Pfff... nobody knows the struggle of getting Mewtwo on the first try. ;) Thanks for the comprehensive introduction!
Thanks so much! Love to see your videos. Thanks so much for making and sharing them! ^_^
Thank you for very helpful video.
Mewtwo is one of legendary poketmon, but you got it with just two choices!
Great video. We are doing a bunch of data ingestion from a rest api right now so this is very top of the mind.
Thanks! Would love more asyncio content
I hope one of your future videos goes into what the async keyword actually does with your code.
Sure, I know that *now*, as I worked with async before out of necessity (which was a great learner for me), but before that I was completely befuddled on what that keyword does and why it made my code stop running unless I used something like async.gather().
That type union is dope :O
Haven't coded in Python for a while; been trying to get into JS frameworks. I love that union type :D
Thanks for covering async.. I have once written an aiohttp based webservice to retrieve data from neo4j.. Aiohttp github page have some nice async libraries collections.. I hope more developers will release async libraries as well..
That is very useful and interesting video discussing asyncio library. I was about to read the docs, but now I think I don't have to, thanks to your video! Great content! Thanks for that!
I really like the practical approach of exploring the topic, it's my favorite way of learning things. Keep going!
just subscribed and signed up for the diagnosis course, eager to start and jump to the next ones. Thanks for sharing
Just one thing. You compare sync version with print in loop vs async with just one print. Of course it doesn't change the fact that async is much faster but to get more accurate results we have to remember to measure functions without unwanted code like slow prints ;-)
Anyway great video. I'm mid developer that switched to python from other scripting language. I recently found your channel and liked it very much. I'm learning a lot from you. Thank you for all your great work!
Thank you!
As always, I always learn something from your videos, THANK YOU. The to_thread() is new to me, very cool
Too much sun? Nice color.
Loving it! Thanks Arjan.. this video was very informative, would like to see more videos on async python 🙏
Thank you, glad you liked it! I’ll surely revisit async in the future.
Since you said that you "don't like these nested 'with' statements" 17:36, I remember there is a Python feature probably not so well known: you can declare multiple variables in one 'with' statement by delimiting them by commas 🙂
great explanation with giving right examples
Glad you liked it, Eldar!
Great tutorial and fantastic way of presenting.
Thanks
Thank you!
if possible make a video on writing test cases on async functions!
Thanks for the suggestion!
Comment before watching the full video: I wrote my first bit of code using asyncio (an example implementation of a library I've built) just a few days ago after watching your previous videos on asyncio. Very cool. Building an interactive CLI tool that runs a networking application in the background has been on my to-do list for a long time, so I'm quite happy I figured it out.
On a separate topic, have you considered making a video on publishing python packages to PyPI?
Very helpful video, Arjan!
Thanks Nate, glad it was helpful!
Awesome tutorial and all, but what really blew my mind was the existence of a Pokemon-API :D
I know! After discovering that, my life is complete.
this is incredibly helpful. Thank you so much
Thanks so much, Mo Gung, glad the content is helpful!
Kind of mind boggling. I studied software engineering at an university in Germany for several years and they never bothered to teach us such moderns way of software engineering. I'm learning way more about software engineering on this channel than at the university, which is both fascinating and disturbing at once. I'm kind of disappointed by the things I learned at the university. The stuff I learned there barely scratched the surface of actual software engineering.
When you introduce aiohttp and describe the differences, this is hilarious. For a relatively noob like me, it's a lot to digest :) But it's great.
Could you make some advanced video on GIL? Where you can explain how it works, how to "bypass" it etc?
Thank you ! this tutorial was awesome !
Glad you liked it!!
This video helped me a lot! thank you so much!💌
this has been extremely helpful
Thanks for your really useful video. Can you do another video on specifying which part of the program to run concurrently and sequentially?
Thank you, it was great . let's go deeper!
On it 😉
Thanks for the video! I really like your coding style )
Thank you - glad you like the video!
Thank you so much, man! Brilliant explanation!
I'm glad it helped!
I’m just starting to get into async. Have you thought about doing a tutorial on async use in the context of LLM calls and frameworks?
TL;DR # Excellent, thank you for the great content.#
I really appreciate your work as thinking how much time you spent to create high quality contents like this. I watched a lot of videos when I started coding but %90 of them was like demonstrating an isolated feature of Python using a Jupyter Notebook. I accept that I learned so much things from them but here was the problem. Even if I learned so much deep, for instance using generators as coroutines that is what basically what asyncio implements now, but I'd never managed to get that advanced techniques together I later realize that was because I learned all the things in isolation and would stuck when it comes to use them all together, that is, the links were missing. Arjan, you did a great job starting to talk about design patterns that I realized the missing links were not the techniques but the philosophy. Therefore I can't recommend your channel enough for people who stuck in the intermediate level of coding and don't know why can't take a step further regardless of whatever new things they learn. I know there must full of people in that situation and think a great deal of them gives up in the end. Your channel is just a treasure for the people in subject and must be spread. As for concurrency, I've always found using preemptive multitasking far from being elegant because it inherently is a brute force approach and I can't imagine anybody who don't love asyncio s/he learns the philosophy behind it. Since we don't have too many options for cpu bound problems because of GIL even if we tackle the problem by splitting it independent sub methods, we can do much for IO bound problems using asyncio and I would appreciate if you consider to continue on the subject. For instance, how can we develop our own cooperative multitasked classes aside from using the external ones (except sending the couroutines to threads). For instance, think a project that used requests-http for its internal processes but doesn't explicitly support asyncio for its public methods. It's obvious that it has capacity for doing that and we can branch and give it our own asyncio support with a little effort and it would be great to learn how an async class should be designed philosophically. The last word is thank you for your great channel and efforts again.
1:47 gives a real life matephor of how asyncio computation compares to parallel computation
3:57 explains what async def means
I greatly appreciate that you used pokemon in this video. It really helps me to see with clarity the difference between the actual subject matter.
Also 10:28 Rage will most likely yield a Cubone or Gyrados!
This video makes me want to sharpen up my list comprehension skills. Thank you for explaining the difference between parallel and concurrent code execution. That really made a lot of sense. Especially bringing up the fact that computers use different amounts of cores in a cpu chip. I didn't know that python can manipulate HOW our chips process our code. I learned something new here.
From what I read, that short answer describing a difference between concurrency and parallelism is incorrect. Parallelism is described correctly, but concurrency is either two lines of customers ordering from a single cashier taking turns, or each line having its own cashier.
http_get_sync is not an appropriate name for code that executes sequentially, line by line, waiting for all locks. Synchronized skating is when two athletes perform the same movement at the same time, in sync. The better their movements and trajectories match, the more perfect the synchronization. Synchronization in programming is precisely the simultaneous execution of two threads or processes on two different CPU cores. We won't overload this definition by requiring that both processes finish at exactly the same time; I think the previous criterion is sufficient.
Thank you for your videos; I enjoy watching them.
Did not know asyncio.to_thread, have been using loop.run_in_executor, which requires more setup.
Also, reusing the session will save you quite a bit of time when sending many requests to the same end point, as it will reuse the connection.
At work, saving the requests.Session halved the runtime of the application, which was was enough and save us the port to asyncio...
to_thread is new from Python 3.8 on, if I'm not mistaken
First: Great video as always, Arjan! I would really love to see some advandced asyncio topics on your channel.
Some additional thoughts on Álvaro's post and the video:
1. Using a session with aiohttp or e.g. httpx brings the same benefits - especially if you have things like authentication in your requests, too.
2. Using asyncio.to_thread has two downsides: First you have the overhead for creating a thread, which consumes resources. Second Python thread execution is handeled by the OS, so you effectivly have no real control, when execution of the thread is interrupted and continued. This takes away some of the control over the program flow from the programmer - while using native coroutines are a bit more predictable. Apart from fast concurrent programs this is something I like most about asyncio - having so much control. So i personally would always prefer a native async library over using a synchronous one with asyncio.to_thread or loop.run_in_executor. If there's no quality alernative for a synchronous library, using asyncio.to_thread a great way to make you code asynchronous, absolutely agreed.
3. If you don't like deep nested context managers, there are some alternatives: not sure for aiohttp but for httpx you can use:
client = httpx.AsyncClient()
await client.aclose()
With a httpx you also have only have one contextmanager (not two) using a session this way:
async with httpx.AsyncClient() as client:
r = await client.get('www.example.com/')
As context managers are very common in async libraries (e.g. if you use sqlalchemy) you could also an AsyncExitStack to enter many contexts without having to indent every time.
4. You meantioned async Python getting easier with Python 3.10. Was there something added in this version for asyncio? I really can't remember - or did you mean it more generally with the features added in versions before?
I hope this post does not sound to negative. I really love your videos and I'm very thankfull for learning so much from them! Just wanted to point out some things to consider.
One last question:
Are there are payment options aparart from credit card on your homepage or would you consider to add some other options in the future?
Thanks for this!
Try out concurrent.futures.ThreadPoolExecutor() it may be even easier. The downside to using .to_thread is that it is using threads to get concurrency and passing the operation to the OS rather than handling it manually. The benefit of asyncio is that you have concurrency in a single thread and you are controlling it but to do that you need to await a function that supports async operations. For that you would need to use aiohttp or httpx instead of requests which relies on the socket library which is blocking and doesn't support async.
great video! maybe can you make "next-level threaded concurrent programming" that will run async WebSockets on all CPUs?
using asyncio with "to_thread" function is like using electric car to save environment and charge it with diesel generator at home
Nice one. Thanks!
I would love to see someone try to make a video with a full solution, like asyncio getting http requests like thousands of them, and loading on a database, it would use pandas? or just dictionaries or data classes?
go more deep for async iterators and generators. what are those and how can it be beneficial?
Very useful, thanks 🙏🏼
Great lesson. Thanks
Thank you, glad you liked the video!
This was just complex enough that I thought - We need a diagram. The verbage is rather fast alas when trying to grasp new ideas, plus watch what is going on with the typing. Diagrams pls!
I'd love a video on snakemake, a great tool for data science pipelines
Awesome, thanks for this video! maybe you would like to make a video about asyncio and websocket?🤩
Thank you, for suggestion, I have put it in my list.
4:13 “await” is actually an expression, not (necessarily) a statement.
Thanks for telling concurrency vs parallelism. I will be confident in my next interview
Very useful , Thank you.
cool as always :)
Thank you!
Would like to see more on async..
hi. whats the difference between multiprocesing, and asyncio ?
15:27 This looks a lot like java's fork/join. The create_task is like the fork, the await is like the join
awesome video, looking forward to new videos
Thank you!
Thank you for your movies! You make me better python developer :)
You’re welcome - glad you like them!
Excellent!
so helpfull! thanks a lot
really helpful thanks man
Glad to hear it!
this is how i kill boredom , watching something usefull
Thanks so much, glad it was helpful!
To get a more accurate difference in sync and async calls, You should have tested without printing the Pokemon for each of the loop iteration.
Since Print statement in itself takes some time.
really nice video. please can you do something with celery and gevent
What an excellent explanation! Subscribed!
Hi, Arjan, your content is perfect as always, but the background music is too loud compared to your voice, or I'm going deaf
Greate quality of videos.
Could Async be used on Class bassed views in Django, and how?