Great video. I have been playing with Polars, Python, and Rust, and it is a fantastic technology. Also, I think Polars' Python facade with Rust backend / clean API is a great model for other data-centric technologies that need performance and scripting facade interfaces. Big thanks to the Polars team for this gem.
I wonder if this could ever be used with multiple machines similar to spark. Polars looks very fast and with the addition of distributed compute it would be very powerful. Perhaps it was not designed to allow that though.
@@АнатолийБугаков-е9г I am asking specifically about cross machine distribution. For example if we had multiple 8-core machines (like VMS in aws) available, can we distribute polars work across those vms instead of being limited to a single machine and its cores.
Great video. I have been playing with Polars, Python, and Rust, and it is a fantastic technology.
Also, I think Polars' Python facade with Rust backend / clean API is a great model for other data-centric technologies that need performance and scripting facade interfaces.
Big thanks to the Polars team for this gem.
Learn rust, python and rust synergies will be all over the place in data science soon. Great work with Polars
Why do you think that? Can you elaborate more please? Thanks!
Can you please provide some insight? I am thinking of learning rust and I wish to enter this field.
Polars is just great! After trying it I won't go back to pandas.
Haven't been so excited about data analysis for a while. Now comes the chore of converting pandas to polars in a 15k line project.
Really great crate and great video, thanks.
For a lot of my job its not possible to use eagerly evaluated DFs, polars is a fantastic option.
I'm going to try this out. Thanks
This is great, can we use polars on a databricks cluster?
Sure, it terms of python, its just another library so can use it very conveniently!!!
I wonder if this could ever be used with multiple machines similar to spark. Polars looks very fast and with the addition of distributed compute it would be very powerful. Perhaps it was not designed to allow that though.
Polars uses all logical cores of your machine in parallel. Doesn't that mean distributed compute?
@@АнатолийБугаков-е9г I am asking specifically about cross machine distribution. For example if we had multiple 8-core machines (like VMS in aws) available, can we distribute polars work across those vms instead of being limited to a single machine and its cores.
@@milo4433 aah I see the difference now
@@milo4433 yea you totally could but would need to do that yourself, not sure the crate supports it out of the box
Wouldn't be a load balancer be enough to make it happen?
Does polars with with scikit?
I think they work most of the time. The good think in that if something fails, you can pass polars to numpy very easily
great API
Nice presentation
Super confused. I thought Polars was deprecating in favor of Arrow2?
need pandas compatible api, just get fast conversion from pandas
It has methods to read and export to Pandas out of the books. It can also write or read Delta tables (locally or in S3).