The Billion Rows Challenge in Rust - an intro to Rust for data engineering

Learn about using Rust for efficiently processing high volumes of data. This live tutorial introduction to the Rust language will explain how to craft utilities for your data engineering pipeline.
The speaker, Tim McNamara, leads a global technology consultancy that helps teams create secure, energy efficient and reliable applications with th Rust programming language.
No experience in Rust required, but you'll greatly benefit from some knowledge of programming. Bring your questions, bring your data. Let's go!
#rustlang #dataengineering #bigdata #easydata

[@IlMaestroG]

"On the planet to build a better planet"! As a Python data engineer with a background in environmental sciences, that resonates a lot with me. Thank you for what you do!

[@mrlectus]

python doesn't help with the environment

[@IlMaestroG]

​​@@mrlectus Agreed. Trying to change the tech stack where I'm at to use Rust 🦀 Needless to say, Tim's content helps me a lot with that!

[@theuberlord7402]

Nice to see a Kiwi leading the charge on Rust education and advocacy.

[@knolljo]

Love the challenge, thanks!

[@flwi]

Thanks for taking the time to explain your workflow in such great detail! Glad I found your channel just now, because I started learning rust this weekend

[@coolbuddy95able]

Great video! Couple of weeks ago I picked up Rust, and I'm loving it. Would have been good if you could benchmark it in the video. Any chance you did it offline?

[@user-nl7ek7qt7r]

Thank you for this stream! So many interesting things explained!

[@andydataguy]

Ooo can't wait to watch this!

[@sergeykuznetsov7688]

Thanks for the video! While watching I wanted to experiment with so many things so I ended up solving it by myself for both single and multi thread modes. Being quite simple It turns out to be a very educative problem.

[@timClicks]

Nice work! I'm so glad that you have fun playing around.

[@GlobalYoung7]

thank you😀

[@hanling8489]

like it

[@learning_rust]

I'm just curious - if f32 would have been sufficient for the temperature, and if so, would that make any performance improvement?
I come from Python background so naive on this and keen to learn!

[@julians.2597]

Measure, measure, measure. Only way to show performance differences, and then only on specific setups

[@michaelwagner4801]

The accent character is called an umlaut

[@CarelessMiss]

That would be an Ä

[@JOHNSMITH-ve3rq]

Brother is Aussie?? Cool!

[@timClicks]

New Zealander, but close enough 😂

[@minciNashu]

else isn't mandatory after if-let.

[@sidkang]

wow, really interesting topic, happy to see this. Thanks!