- 103
- 65 917
CelerData
United States
Приєднався 9 лют 2022
CelerData enables enterprises to quickly and easily grow their business with the world’s most performant query engine for open lakehouses. Powered by StarRocks, CelerData delivers 3X the performance/cost of any other solution on the market and is the only platform uniquely designed to enable users to simplify their lakehouse architecture and ditch the need for a data warehouse. CelerData is used worldwide by market-leading brands including Airbnb, Pinterest, and Trip.com to generate critical new insights for these data-driven companies.
CelerData Quarterly Update: Automatic Materialized Views and More
Get ready to level up with CelerData Cloud’s latest features! In this quarterly update, we’re introducing exciting updates that help users reduce operational overhead, boost security, ensure availability, and enhance connectivity. Watch as CelerData Product Manager Sida Shen dives into these improvements with expert tips and demos to help you harness the full potential of StarRocks.
----------------------------------------------------------------------------------------------------------------------
00:00 Introduction
00:25 Unpacking CelerData and StarRocks
02:23 The Hidden Costs of Maintaining Open Source Infra-Level Software
03:50 CelerData Cloud: Managed Enterprise StarRocks in Your VPC
05:05 What’s New With CelerData Cloud BYOC
06:26 Unity Catalog Integration: Discover Seamless Data Governance and Interoperability With Unity Catalog for Enhanced Data Management and Flexibility
08:43 Security: Transparent Data Encryption
09:23 Compute & Storage Autoscaling
11:32 Failover Groups: High Availability and Disaster Recovery
12:56 Automatic Materialized View: Automation and Ease of Use
19:07 Demo
20:08 Automatic MV Recommendation
24:34 How Automatic Materialized Views Can Help You: Merge Similar Materialized Views
29:08 Try CelerData Cloud for Free and Connect With Us
29:39 Q&A
----------------------------------------------------------------------------------------------------------------------
Learn more at celerdata.com/
Connect with us:
LinkedIn: www.linkedin.com/company/celerdata/
Twitter: celerdata
CelerData Website: celerdata.com/
StarRocks GitHub: github.com/StarRocks/StarRocks
StarRocks Website: www.starrocks.io/
Slack: starrocks.io/redirecting-to-slack
#DataAnalytics #DataEngineering #DataLakeAnalytics #UnityCatalog #OLAP #DataAnalyst #DataEngineer #DataInfrastructure #UserFacingAnalytics #Database #AnalyticalDatabase #DataLake #DataLakeHouse #DataWarehouse #datasciencebasics #databricks
----------------------------------------------------------------------------------------------------------------------
00:00 Introduction
00:25 Unpacking CelerData and StarRocks
02:23 The Hidden Costs of Maintaining Open Source Infra-Level Software
03:50 CelerData Cloud: Managed Enterprise StarRocks in Your VPC
05:05 What’s New With CelerData Cloud BYOC
06:26 Unity Catalog Integration: Discover Seamless Data Governance and Interoperability With Unity Catalog for Enhanced Data Management and Flexibility
08:43 Security: Transparent Data Encryption
09:23 Compute & Storage Autoscaling
11:32 Failover Groups: High Availability and Disaster Recovery
12:56 Automatic Materialized View: Automation and Ease of Use
19:07 Demo
20:08 Automatic MV Recommendation
24:34 How Automatic Materialized Views Can Help You: Merge Similar Materialized Views
29:08 Try CelerData Cloud for Free and Connect With Us
29:39 Q&A
----------------------------------------------------------------------------------------------------------------------
Learn more at celerdata.com/
Connect with us:
LinkedIn: www.linkedin.com/company/celerdata/
Twitter: celerdata
CelerData Website: celerdata.com/
StarRocks GitHub: github.com/StarRocks/StarRocks
StarRocks Website: www.starrocks.io/
Slack: starrocks.io/redirecting-to-slack
#DataAnalytics #DataEngineering #DataLakeAnalytics #UnityCatalog #OLAP #DataAnalyst #DataEngineer #DataInfrastructure #UserFacingAnalytics #Database #AnalyticalDatabase #DataLake #DataLakeHouse #DataWarehouse #datasciencebasics #databricks
Переглядів: 187
Відео
Stream Processing Must Haves
Переглядів 342Місяць тому
Ben Gamble, Field CTO at Ververica (the original creators of Apache Flink), and Sida Shen, Product Manager at CelerData, break down the essentials of real-time stream processing, sharing insights into its benefits, challenges, and practical ways to get started. Take a closer look at VERA: The Path to Cloud-Native Apache Flink, and how it’s designed to support today’s real-time data needs. The s...
What’s Next for Lakehouse in 2025 With Databricks and CelerData
Переглядів 811Місяць тому
🌟Take a deep dive into the future of lakehouse technology with this recorded fireside chat featuring Databricks Product Expert Michelle Leon and Sida Shen from CelerData. In this session, we unpack the latest developments, including Unity Catalog, Databricks’ acquisition of Tabular, key differences between Databricks and Snowflake on open formats, and more. You'll also see live demos showcasing...
StarRocks X Tencent - Introducing Vector Similarity Search
Переглядів 4422 місяці тому
In this video, Petri Zhang from Tencent reveals how Tencent leverages StarRocks for Retrieval-Augmented Generation (RAG) with hybrid search. He details their journey in building a billion-scale image repository that enables both reverse image search and traditional BI dashboards within a unified platform. Petri also shares the challenges they faced along the way and the key reasons why Tencent ...
Tencent Games Unifies Their Gaming Analytics with StarRocks
Переглядів 972 місяці тому
✅ 15x storage cost-saving ✅ 50% better efficiency when developing new data pipelines ✅ 100% pre-aggregations are eliminated Discover how Tencent Games, boasting 200 million users globally and renowned titles like "League of Legends" & "PUBG Mobile," is able to unify their gaming analytics across multiple studios, and why StarRocks was the only solution that could make this possible. Tencent Gam...
Demo: Achieving Interoperability with Unity Catalog, Delta UniForm, and StarRocks
Переглядів 2753 місяці тому
This video introduces Databricks’ Unity Catalog, an open-source tool launched at the DATA AI 2024 event. Unity Catalog helps manage data across different data and AI applications. In this demo, StarRocks, a powerful query engine, is used to show how Unity Catalog makes it easy to work with multiple table formats. For example, StarRocks is able to query data stored as Delta but treat it like an ...
Query Engine Must-Haves for the Best Apache Superset Experience
Переглядів 7173 місяці тому
Apache Superset promises quick insights through interactive, no-code dashboards. Still, it can struggle to deliver due to the unsatisfactory performance and limited capabilities of the query engines chosen to power it. In this session, CelerData's Sida Shen will explore the essential capabilities your query engine must possess to achieve the BI performance everyone hopes for, but few often get,...
How to Accelerate Apache Iceberg Metadata Retrieval
Переглядів 4133 місяці тому
Many Iceberg users struggle with job planning taking too long, particularly when dealing with high concurrency or large metadata files. In this video, Chelsea (Simo) Wang covers: 🌟 What makes job planning in Iceberg so challenging. 🌟How StarRocks 3.3’s new features provide effective solutions for both large and small metadata use cases, supported by real-world examples. 🌟StarRocks' adaptive job...
StarRocks Virtual Meetup: Version 3.3.x and What’s Next
Переглядів 3874 місяці тому
Catch the recorded session of the StarRocks Community August Meetup, where Harrison (Heng) Zhao, a TSC member, and Sida Shen, an StarRocks Contributor and project expert, discussed the latest developments and shared their expertise. Highlights: 🌟New Features in 3.3.x and the Roadmap Ahead: Dive into the latest features introduced in the 3.3.x release of StarRocks, and discover the exciting deve...
Rockset Acquired by OpenAI: What's Next for Its Users?
Переглядів 5784 місяці тому
Whether you're affected by Rockset's shutdown this September or simply exploring new database options, this video will guide you through a range of alternatives and help you find the best fit for your needs. Webinar Highlights: 🌟What the Rockset acquisition means for its users. 🌟Immediate steps users should take now to ensure continuity in their operations. 🌟The pros and cons of multiple open-s...
Data Lake Query Engines: Trino vs StarRocks
Переглядів 3695 місяців тому
Explore the differences between Trino and StarRocks as data lake query engines, their architectures, performance benchmarks, and suitable use cases for modern data analytics. Timestamps 00:00Intro 00:10 What is Trino? 00:56 What is StarRocks? 01:59 Performance Comparison: Trino vs StarRocks 02:33 Trino vs. StarRocks: Which to Use for Specific Use Cases 03:28 Conclusion Join StarRocks on Slack: ...
What Is StarRocks and What Are Its Use Cases?
Переглядів 8935 місяців тому
StarRocks is an Apache-licensed open-source project under the Linux Foundation. As of June 2024, it has garnered 8.3 thousand stars on GitHub and has 354 contributors globally. Its adoption by major industry players attests to its reliability and efficiency in handling various data analytics needs. Get to know StarRocks in this video and discover how it excels as a data warehouse for real-time ...
How to Solve Data Upserts Challenges in OLAP Databases
Переглядів 3525 місяців тому
Discover the challenges of data upserts in OLAP systems and explore effective strategies, including the delete and insert method, with real-world examples like Airbnb’s fraud detection. Timestamps 00:00 Intro 00:05 The Challenges of Data Upserts Challenges in OLAP 01:25 Delete and Insert Strategy 03:24 Data Upsert Example: Airbnb Fraud Detection - Challenges 04:42 Data Upsert Example: Airbnb Fr...
Materialized Views: Tips, Tricks, and Use Cases
Переглядів 5235 місяців тому
Materialized views are one of StarRocks’ most popular and powerful features, but are you getting the most out of them? Murphy Wang, the technical mind behind the project’s materialized views, is ready to share all the latest tips and tricks to help you get the best query performance for your data pipeline. Session Highlights: 🌟Best practices for rolling out materialized views: Learn what causes...
[Coinbase Lakehouse Architecture] Achieving Data Warehouse Performance on a Data Lakehouse
Переглядів 9976 місяців тому
Join Sida Shen from CelerData and Eric Sun from Coinbase in this video as they dive into the latest advancements in data lakehouse querying and share tips to make the most out of your data lakehouse. They'll cover: 🌟Why you shouldn't rely on proprietary data warehouses just to speed up queries 🌟The latest cool stuff in query engines boosting lakehouse performance 🌟A close look at how Coinbase i...
StarRocks 3.3 is Here: Key Features and Improvements
Переглядів 8846 місяців тому
StarRocks 3.3 is Here: Key Features and Improvements
Getting Started with CelerData Cloud Serverless: Intro and Live Demo
Переглядів 1306 місяців тому
Getting Started with CelerData Cloud Serverless: Intro and Live Demo
The Register & CelerData: Ditch Your Data Warehouse with Superior Lakehouse Performance
Переглядів 1497 місяців тому
The Register & CelerData: Ditch Your Data Warehouse with Superior Lakehouse Performance
Going Serverless for Warehouse-Free Lakehouse Analytics
Переглядів 3367 місяців тому
Going Serverless for Warehouse-Free Lakehouse Analytics
Challenges and Accelerations in Running Data Warehouse Workloads on Open Data Lake
Переглядів 827 місяців тому
Challenges and Accelerations in Running Data Warehouse Workloads on Open Data Lake
What Is Single Instruction Multiple Data and the Role of SIMD in Boosting OLAP Database Efficiency
Переглядів 3788 місяців тому
What Is Single Instruction Multiple Data and the Role of SIMD in Boosting OLAP Database Efficiency
StarRocks Connect: Sling - Extract & Load Data From Your CLI With Ease and Speed
Переглядів 4348 місяців тому
StarRocks Connect: Sling - Extract & Load Data From Your CLI With Ease and Speed
Unlock User Behavior with 87M Events Using Hudi, StarRocks & MinIO - Apache Hudi Community Call
Переглядів 2278 місяців тому
Unlock User Behavior with 87M Events Using Hudi, StarRocks & MinIO - Apache Hudi Community Call
Tencent's A/B Testing SaaS Platform Unifies All SQL Workloads on the Data Lakehouse with StarRocks
Переглядів 568 місяців тому
Tencent's A/B Testing SaaS Platform Unifies All SQL Workloads on the Data Lakehouse with StarRocks
How to Accelerate Apache Iceberg Queries
Переглядів 1798 місяців тому
How to Accelerate Apache Iceberg Queries
Apache Iceberg + StarRocks: Your Recipe for Superior Lakehouse Performance
Переглядів 2,4 тис.8 місяців тому
Apache Iceberg StarRocks: Your Recipe for Superior Lakehouse Performance
StarRocks Architecture: StarRocks as a Data Warehouse & StarRocks as a Lakehouse Query Engine
Переглядів 4398 місяців тому
StarRocks Architecture: StarRocks as a Data Warehouse & StarRocks as a Lakehouse Query Engine
Getting Started Tutorial: Building a Data Lakehouse With StarRocks, Apache Hudi, and MinIO
Переглядів 7429 місяців тому
Getting Started Tutorial: Building a Data Lakehouse With StarRocks, Apache Hudi, and MinIO
🌟Join StarRocks on Slack: starrocks.io/redirecting-to-slack 🌟Try CelerData Cloud (30-Day Free): cloud.celerdata.com/login 🌟Read the blog: celerdata.com/blog/celerdata-quarterly-update-automatic-materialized-views-and-more 🌟 Unity Catalog + CelerData Cloud Demo: ua-cam.com/video/KyyVBzjP6A0/v-deo.htmlsi=Xx9Ge2eAH5tWQ6tk&t=2763
great
Useful Links: 🌟Join StarRocks on Slack: starrocks.io/redirecting-to-slack 🌟VERA: The Path to Cloud-Native Apache Flink Security Whitepaper: www.ververica.com/vera/whitepaper
Useful Links: 🌟Join StarRocks on Slack: starrocks.io/redirecting-to-slack 🌟 Unity Catalog Website: www.unitycatalog.io/ 🌟Join Unity Catalog Slack: go.unitycatalog.io/slack 🌟 StarRocks Catalog: docs.starrocks.io/docs/data_source/catalog/catalog_intro/ 🌟 CelerData Cloud BYOC: cloud.celerdata.com/login
Druid at least provides normal UI build in . UI showed in the demo is not available for free only some ugly limited one.
🌟Join StarRocks on Slack: starrocks.io/redirecting-to-slack
Useful Links: 🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack 🌟Tencent Games Case Study: www.starrocks.io/blog/tencent-unifies-their-gaming-analytics-with-starrocks
Useful Links: 🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack 🌟 StarRocks Unity Catalog: docs.starrocks.io/docs/data_source/catalog/unified_catalog/
Superset I good however, but you guys should secure PowerBI connector with Direct Query capabilities in order to get more “enterprise” exposure and adoption.
Thanks for the suggestion. CelerData Cloud BYOC does have PowerBI direct query capabilities, so we will certainly consider creating more content for it!😁
Useful Links: 🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack 🌟StarRocks Materialized Views: docs.starrocks.io/docs/using_starrocks/Materialized_view/
Useful Links: 🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack 🌟 StarRocks Materialized Views: docs.starrocks.io/docs/using_starrocks/Materialized_view/
Useful Links: 🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack 🌟StarRocks 3.3: www.starrocks.io/blog/starrocks-3.3-is-out-features-and-improvements 🌟Apache Iceberg + StarRocks: Your Recipe for Superior Lakehouse Performance: ua-cam.com/video/8Q5Vev4O1lQ/v-deo.htmlsi=uPP_YZMWPND9kuWl
Useful Links: 🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack 🌟 Delivering Faster Analytics at Pinterest: medium.com/pinterest-engineering/delivering-faster-analytics-at-pinterest-a639cdfad374 🌟 Databricks Data + AI: Coinbase x StarRocks: ua-cam.com/video/UTRcEqcTx4g/v-deo.htmlsi=Q_p_V_ZJjLkSPpwE 🌟 StarRocks 3.3: www.starrocks.io/blog/starrocks-3.3-is-out-features-and-improvements 🌟 StarRocks Best Practices: medium.com/starrocks-engineering/starrocks-best-practices-capacity-planning-and-deployment-2075f8d59e16 🌟StarRocks Blog: www.starrocks.io/blog
Great video, you explain these things really well :)
This is wonderful, thanks for demo'ing
Glad you liked it!
Rockset indexes looks stupid in traditional way from database perspective , but however in some way perfect for AI area. For the time they are changing!
🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack 🌟Airbnb Use Case: celerdata.com/blog/airbnb-builds-a-new-generation-of-fast-analytics-experience-with-starrocks
Thank you for promoting our platform to the industry, and letting more people know about it.
What about Dremio vs StarRocks?
While Dremio explicitly forbids publishing performance tests or analysis against them, where you'll see the biggest fundamental difference is in the codebase. StarRock's is developed in C++ where Dremio is based on Java. Being C++ gives StarRocks the advantage of utilizing lower-level optimizations such as SIMD, which is crucial for fast OLAP queries. Additionally, StarRocks is fully open-source and actively maintained by a global community of contributors. In contrast, although Dremio is open-source, there has been no update for the past three months and currently, it does not support the submission of new issues.
🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack
🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack
For querying datalake, can StarRocks just connect to it or should do a full/incremental copy?
StarRocks directly query data lake with its external catalog framework, no ingestion/data copying needed. Link to the docs: docs.starrocks.io/docs/sql-reference/sql-statements/data-definition/CREATE_EXTERNAL_CATALOG/
Great stuff. Thanks for sharing.
Thanks for watching!
🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack
Great episode, keep going!
Thanks, will do!
Meh. All talk, no demo at all ?
how StarRocks compares with Databricks with Photon engine ?
StarRocks is around 2x the performance compared to Databricks SQL with Photon, and it is 100% open source
Where i can find the full video
Here it is: ua-cam.com/video/cUuxicRqmB4/v-deo.htmlsi=8QRtArdG-ZHbVJWa
Great content! Am really excited to test starrocks, but i have a question please what the difference between impala and starrocks ?
There is a huge performance difference. StarRocks' operators are fully vectorized so it is way faster for OLAP queries. Also query planning, StarRocks' cost-based optimizer can generate much more efficient query plans
@@SidaShen this is really promising, the reason why i asked is because we are using on premise cloudera solution, and impala is already configured, is there any official docs on setting up starrocks with cloudera
@@SidaShen great!, the reason i asked because we are running on premise cloudera solution, which impala is already configured, is there an official guide on setting up starrocks with cloudera?
@@abdullahmajed7554 Are you using Apache lceberg with Cloudera? If it is it should work. You can join the StarRocks channel and we can chat there about specific integrations bit.ly/starrocks-slack :D
Got error ERRcOR 1064 (HY000): Unexpected exception: Failed to create shards. error: INVALID_ARGUMENT:shard info can not be empty. when try create table, also starrocks-cn is not started.
Would you please join the StarRocks slack channel? We can help you out there. bit.ly/Join-StarRocks
🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack
His chart at 16min mentions MPP HTAP for starrocks. Does it mean they don't even use a OLTP DB? Starrocks does both OLAP and OLTP for web apps?
About internal shuffling, yes, it's via gRPC to shuffle chunks. About data lake, yes, we can read avro files. Sida, you really did a great job!
Useful Links: 🌟Join StarRocks Community on Slack: try.starrocks.com/join-starrocks-on-slack 🌟StarRocks 3.3 RC02 release note: docs.starrocks.io/releasenotes/release-3.3/ 🌟StarRocks Best Practices: www.starrocks.io/blog/starrocks-best-practices-data-modeling
Useful Links: 🌟Try CelerData Cloud Serverless for Free: serverless.celerdata.com/login 🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack StarRocks GitHub: github.com/StarRocks/StarRocks StarRocks Website: www.starrocks.io/
Hi! Which catalog for Iceberg would you recommend for Financial company with high reqs for regulatory reporting?
@zamw4276 Good question, to be completely honest it'll really depend on your inifrastructure. Generally speaking, a good place to start would be this video by Tabular: ua-cam.com/video/G2YMCPdQfgM/v-deo.htmlsi=BXMT0KRViUWuXzc7 but if you want a more personalized answer I'd suggest asking this question in the StarRocks Slack channel here: try.starrocks.com/join-starrocks-on-slack
Useful Links: Try CelerData Cloud Serverless for Free: serverless.celerdata.com/login Join StarRocks on Slack: join.slack.com/t/starrocks/shared_invite/zt-2fou0ynxe-mZpcW54KewxWocehcBNoKQ StarRocks GitHub: github.com/StarRocks/StarRocks StarRocks Website: www.starrocks.io/
Useful Links: 🌟Try CelerData Cloud Serverless for Free: serverless.celerdata.com/login 🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack StarRocks GitHub: github.com/StarRocks/StarRocks StarRocks Website: www.starrocks.io/
Love starrocks! Do you guys have any plans to support Redpanda / Kafka as the storage layer? Especially for enterprises with the tiered aws storage and shadow indexing in Redpanda, I think Starrocks as the lakehouse engine would be absolutely amazing!
Thank you for your support and interest in StarRocks! We currently don’t have plans to integrate Redpanda/Kafka as the storage layer in our H1 or Q3 roadmap. If you haven't already, we invite you to join our StarRocks community on Slack - join.slack.com/t/starrocks/shared_invite/zt-2fou0ynxe-mZpcW54KewxWocehcBNoKQ to discuss this further and stay updated on future developments!
Useful Links: 🌟 Load Data into StarRocks from Any Database vis Sling: blog.slingdata.io/load-data-into-starrocks-from-any-database 🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack
Useful Links: 🌟Tutorial: github.com/StarRocks/demo/tree/master/documentation-samples/datalakehouse 🌟Join StarRocks Slack Channel: try.starrocks.com/join-starrocks-on-slack 🌟 Apache Hudi Quick Start: docs.starrocks.io/docs/quick_start/hudi/ 🌟Slides: www.slideshare.net/slideshow/unlock-user-behavior-with-87-million-events-using-hudi-starrocks-minio/266628987
Useful Links: 🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack 🌟[doc] Quick start: Apache Iceberg Lakehouse docs.starrocks.io/docs/quick_start/iceberg/ 🌟Case Studies and More: www.starrocks.io/blog 🌟StarRocks GitHub: github.com/StarRocks/StarRocks 🌟StarRocks Website: www.starrocks.io/
🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack
🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack
🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack
🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack
🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack
🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack
🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack
🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack
🌟Join StarRocks on Slack: try.starrocks.com/join-starrocks-on-slack