Відео

Love it! ♥

Thanks for the presentation. Why could we not use set difference to support the delete operation using Theta sketches?

Embedding an IAM service in the catalog is kinda weird

Auth discussion went downhill

Let my man Jack Ye ship

Use whiteboard and visualise the discussion. Keeping that verbally produces different understanding and it feels that no consensus exists. I think on iam/ rbac discussion majority is very close to each other but at the end the result was “it’s an interesting discussion ”

Any idea when this is going to be GA and rolled out widely?

when this will be released?

is there any possibility to perform this encryption not at file level but at column level?

33:08 why not implementing row level security and column masking in the iceberg spec? Using view to handle security is so old school and not modern or a 2024 thing! Iceberg isn’t it supposed to be more focus and prioritising productivity? We are not in the early days of big data anymore.

22:05 and Rust bring memory safety which is more complicated to do with ac and C++.

Based on what Iceberg have been nominated De Facto Storage standard? 45:04 Change Data Capture or Change Data Feed is nothing unique to Iceberg, nor is Merge on Read!

16:13 those are indeed a nice set of selections criteria. Today, all 3 main tables format Delta, Hudi and Iceberg are checking all those boxes. And in terms of simplicity and performance Iceberg is not necessarily leading there. Iceberg is a good table format but I’ve seen many companies going from traditional data warehouse to Lakehouse choose Iceberg because of its loud community, then struggles to use it as their looking for productivity features which haven’t been implemented yet on Iceberg but present in the other format. Iceberg has a nice spec, but adding a kernel layer like Delta did with their Delta Kernel will ensure easier integration with the different tools in the ecosystem and more importantly those tools support all the range of features provided by iceberg. This will already help to address ecosystem interoperability. Then it will be good to see a working group in the Iceberg PMC working on interoperability with the 2 other main format, as they’re doing on their side. Then lastly will be good to see the 3 community work together and bring 1 unify format like the telco industry did with when GSM became the one standard used by everyone world wide.

37:26 Iceberg community can learn from other format. Having a Iceberg Kernel will help adoption of the spec and increase adoption

15:15 so why did you join Databricks? I like how all the challenges people’s have with Iceberg today are presented as strengths. History have shown us many time being first doesn’t mean a lot, it’s just a talking point. Schema evolution was the key differentiator Iceberg had aside its loud community! Redshift added support to Iceberg far after adding support to LF Delta and Hudi. Snowflake adding Iceberg as a desperate move to stop the flow of customers moving to Databricks and the Open Lakehouse. But yes let not talk about that! The dream will be to have 1 table format with all the best features of the 3 existing table formats.

Great talk. Appreciate the deepdive for new comers (historical, current and future version). Super helpful.

Nice talk, love PyIceberg, looking forward to v1.0.0

Wow, this is amazing! Learning about how the Daft engine simplifies complex tasks under the hood is mind-blowing! And the tips on using simple Python scripts with Apache Iceberg are super practical. Thanks for sharing all this awesome knowledge! 🌟

This video needs a higher resolution. I can't read most of the text at 360

Wait This hits different after the acqui lol

Excellent usage of iceberg

Great talk!!

360p, really?

Nice demo on PyIceberg + Daft+ Ray

good choice going in on iceberg for ur lakehouse

Good job Nick

good job Yan & Fan

sounds like a vc pitch

Nick is one of the many jedi masters at Bodo!

This was very interesting, I am looking forward to check this out. - Thanks

awesome

Apache Iceberg, I loved this video so much, I had to hit the like button!