@@Rishi_Khandelwal Although concurrency and parallelism are related concepts in terms of concurrent programming and can be used together, they aren't the same thing. Concurrency = multiple tasks that start/run/complete in overlapping time periods and in no specific order. vs. Parallelism = multiple tasks that run at the same time.
Great explanation. I would add a couple of remarks. You have to be aware that these terms may be used differently, people sometimes mixed them up. Or some use a different terminology. For instance, .NET uses the terms synchronous and asynchronous. I came across this definition of concurrency: concurrency means that two or more calculations happen within the same time frame. Meaning, several tasks run (with context switching) within a period of say 3 minutes. Managing multiple tasks simultaneously (within a time frame) is a good definition as well. IO-heavy and CPU-heavy is often referred to as IO-bound and CPU-bound. There is also the multitasking term, which is a more informal term that overlaps with both concurrent and parallel. Concurrency is an umbrella term for both concurrent and parallel execution. Parallel execution is a specific case of concurrency. But when they say the tasks runs concurrently, it means they run in interleaved, non-parallel way. This video is so good that I recommend to rewatch it any time a confusion arises.
The terms sync and async are separate concepts. Async is achieved differently depending on the language. Using JS, async code is implemented using concurrency since JS is single threaded. On the other hand, if you use Java, async code is executed on a separated thread, making it parallel but not concurrent.
Great video! Is there an alternative to context switching where the CPU Core focuses solely on one task continuously until that task blocks so the CPU Core can focus on a separate task? I believe the JavaScript event loop behaves similarly to this alternative.
So is it right when I say concurrency is better for multiple network call, like reading from a database, using concurrency, and based on each of the results returned, i can handle simultaneous computations using parallelism?
When talking about multi-cores or multi-cpus for doing parallel tasks the most important thing to watch out for would the cpu/core cache coherency. It would've been nice to touch on that too. Keep up the good work though! Cool video.
This is wrong? Concurrency on multiple CPU cores enables parallel execution. Concurrency on a single CPU core requires switching. Parallelism is a subset of concurrency.
Absolutely. Yeah, people try to redefine words that already have a definition. Concurrent literally means at the same time. I will never understand the followers that just go with it without thinking "is he correct?"
All we can do with a programming language ( such as C#, Java, python ) is to write a concurrent program. And when we run them on a machine, it may run parallelly or not. This is decided by the OS which decides it based on the hardware availability In these languages, we don't have much control to forcefully run tasks in truly parallel manner. These programming languages abstract away those details Is the above understanding right?
Yes, to my understanding, this is the case. If you let's say call Parallel.ForEach in C#, you give a hint to the OS that you would like to run it in parallel, if possible.
Thank you very much for all the knowledgeable videos. We respect your efforts. Please make a video on system design of online coding judge, how leetcode or hacker rank handles the online contest's load.
in the 2nd 'concurrent, not parallel', if task A and task B are running in sequence (one after the other) they can't finish at the same time. am i missing something?
your statement is correct. but you should see it more like this. a has 10 jobs, b has 10 jobs. If you do those alternate you end up done at roughly the same time (for a and b). Thats why the chef making 3 dishes is a good example.
"Concurrency is about dealing with lots of things at once. Parallelism is about doing lots of things at once." R. Pike
What do you mean by dealing and doing? Please clarify.
@@Rishi_Khandelwal Although concurrency and parallelism are related concepts in terms of concurrent programming and can be used together, they aren't the same thing. Concurrency = multiple tasks that start/run/complete in overlapping time periods and in no specific order. vs. Parallelism = multiple tasks that run at the same time.
Appears you're on a path to have 1,000,000 subscribers by year-end! Hoping you make it! 🍻😎✌️
Great explanation. I would add a couple of remarks. You have to be aware that these terms may be used differently, people sometimes mixed them up. Or some use a different terminology. For instance, .NET uses the terms synchronous and asynchronous.
I came across this definition of concurrency: concurrency means that two or more calculations happen within the same time frame. Meaning, several tasks run (with context switching) within a period of say 3 minutes. Managing multiple tasks simultaneously (within a time frame) is a good definition as well.
IO-heavy and CPU-heavy is often referred to as IO-bound and CPU-bound. There is also the multitasking term, which is a more informal term that overlaps with both concurrent and parallel.
Concurrency is an umbrella term for both concurrent and parallel execution. Parallel execution is a specific case of concurrency. But when they say the tasks runs concurrently, it means they run in interleaved, non-parallel way.
This video is so good that I recommend to rewatch it any time a confusion arises.
The terms sync and async are separate concepts. Async is achieved differently depending on the language. Using JS, async code is implemented using concurrency since JS is single threaded. On the other hand, if you use Java, async code is executed on a separated thread, making it parallel but not concurrent.
Concurrency is abt managing and parallelism is abt executing
wtf is abt
@@wexwexexortabout i guess
@@dy0mber847 lol, that makes sense.
Thank you for explaining concurrency and parallelism in understable way.
Great video!
Is there an alternative to context switching where the CPU Core focuses solely on one task continuously until that task blocks so the CPU Core can focus on a separate task? I believe the JavaScript event loop behaves similarly to this alternative.
Clear and concise with good animations, great video!
So is it right when I say concurrency is better for multiple network call, like reading from a database, using concurrency, and based on each of the results returned, i can handle simultaneous computations using parallelism?
So with Node.js only concurrency is possible, because it is single threaded?
When talking about multi-cores or multi-cpus for doing parallel tasks the most important thing to watch out for would the cpu/core cache coherency. It would've been nice to touch on that too. Keep up the good work though! Cool video.
How do you do parallelism while maintaining order? Is it possible?
In the Go language, parallelism and concurrency are often confused
Yes. Parallelism is a SUBSET of concurrency.
The best explanation
This is wrong?
Concurrency on multiple CPU cores enables parallel execution.
Concurrency on a single CPU core requires switching.
Parallelism is a subset of concurrency.
Absolutely.
Yeah, people try to redefine words that already have a definition.
Concurrent literally means at the same time.
I will never understand the followers that just go with it without thinking "is he correct?"
All we can do with a programming language ( such as C#, Java, python ) is to write a concurrent program. And when we run them on a machine, it may run parallelly or not. This is decided by the OS which decides it based on the hardware availability
In these languages, we don't have much control to forcefully run tasks in truly parallel manner. These programming languages abstract away those details
Is the above understanding right?
I am thinking the same way too. I encourage you to read Grokking concurrency By Kirill Bobrov for deeper explanation regarding this topic :D
Yes, to my understanding, this is the case. If you let's say call Parallel.ForEach in C#, you give a hint to the OS that you would like to run it in parallel, if possible.
I was asked to explain this concept recently in my system design interview at Disney for what was essentially implement Launch Darkly
I see you didn’t get the job
Hello Sir, as and always Thanks for the great content. Please make a video on ACTOR SYSTEM.
Thank you very much for all the knowledgeable videos. We respect your efforts. Please make a video on system design of online coding judge, how leetcode or hacker rank handles the online contest's load.
It's kinda a blurry line now though, for most development, your software is running virtualized anyway. .
parallelism is a type of concurrency
It’s a subset of concurrency :)
sir please make video on topin web application on protocal because I didn't learn on any kind of video so plz thinking to make it
Thank you for doing this!
paraconcurrent should be a word.
Using Go made me understand this better
YES SAME HERE. Learning goroutines and channels right now.
in the 2nd 'concurrent, not parallel', if task A and task B are running in sequence (one after the other) they can't finish at the same time. am i missing something?
your statement is correct. but you should see it more like this. a has 10 jobs, b has 10 jobs. If you do those alternate you end up done at roughly the same time (for a and b). Thats why the chef making 3 dishes is a good example.
Concurrency to enable parallelism...nice idea to ponder
you are very good, thanks so much for all
Multitasking vs Multiprocessing
Concurrency is a computer to listen multiple users, while parallelism is a user to call multiple computers. The difference is who takes control.
then there is also cooperative and preemptive
Isn't this a repeat?
Parallelism is subset of concurrency
Just brilliant!
Nice Tut. Thanks 🍓🍓🍓
What software did you use to draw those diagrams ?
I have the same question, the animations are so clean. probably using AE
What’s AE?
After Effects @@sujathajagath2033
@@sujathajagath2033after effect
@@sujathajagath2033 after effects
Youe content awesome 👏👏👏👏
What if one task depends on another during parallelism. Thanks for the video
In this case, I think you have no other choice but to wait for the task to finish
multitasking is concurrency, slavery is parallelism. Probably.
edit : parallel -> parallelism. i ain't native
Nice
nice its funny how many devs still get these confused
Funny that you seem to be one of these devs; considering that he's wrong.
Concurrent literally means at the same time.
01:48 (nitpick) - task 1.2 appears twice on the top.
👍 👍 👍 👍
👍👍👍
123