- 430
- 737 406
Anyscale
United States
Приєднався 31 січ 2020
Welcome to the Anyscale UA-cam channel! Join us as we explore Ray, an open-source framework designed to accelerate the development and deployment of machine learning applications. From beginner tutorials to advanced insights, our videos cater to all skill levels. Stay up-to-date with the latest advancements and hear from experts through interviews, panel discussions, and keynotes.
Ray Summit 2024 – Recap Video
Get a quick look at all of the joy, excitement, and announcements that took place at Ray Summit 2024.
Ray Summit 2024 was our best summit yet, but we're just getting started. Join us at Ray Summit 2025, coming to the Bay Area this fall.
--
Liked this video? Watch the full Day 1 Keynote: ua-cam.com/video/jwZHJthQvXo/v-deo.html or check out the Ray Summit breakout session recordings!
--
🔗 Connect with us:
- Subscribe to our UA-cam channel: www.youtube.com/@anyscale
- Twitter: x.com/anyscalecompute
- LinkedIn: linkedin.com/company/joinanyscale/
- Website: www.anyscale.com
Ray Summit 2024 was our best summit yet, but we're just getting started. Join us at Ray Summit 2025, coming to the Bay Area this fall.
--
Liked this video? Watch the full Day 1 Keynote: ua-cam.com/video/jwZHJthQvXo/v-deo.html or check out the Ray Summit breakout session recordings!
--
🔗 Connect with us:
- Subscribe to our UA-cam channel: www.youtube.com/@anyscale
- Twitter: x.com/anyscalecompute
- LinkedIn: linkedin.com/company/joinanyscale/
- Website: www.anyscale.com
Переглядів: 216
Відео
Building a GPU Cloud with Ray at io.net | Ray Summit 2024
Переглядів 400Місяць тому
io.net transforms idle GPUs worldwide into a powerful decentralized computing network, creating an "Airbnb for GPUs" that spans data centers, GPU farms, and individual devices. In this session, Aline Almeida explores how Ray orchestrates this diverse ecosystem of over 300,000 verified GPUs to power scalable AI workloads. Almeida dives into the technical challenges of managing a heterogeneous, g...
ChatGPT Creator John Schulman on OpenAI | Ray Summit 2023
Переглядів 9 тис.2 місяці тому
OpenAI co-founder John Schulman joins Anyscale Co-Founder and CEO Robert Nishihara for an illuminating conversation on the creation and impact of ChatGPT. In this Ray Summit 2023 keynote, Schulman shares his 13-year journey in AI, starting from his PhD research in 2010 to the pivotal decisions that led to ChatGPT's development. The discussion explores how OpenAI leverages Ray's distributed comp...
Ben Horowitz - Historical Perspectives on AI and the Internet | Ray Summit 2023
Переглядів 3,5 тис.2 місяці тому
Andreessen Horowitz Co-Founder Ben Horowitz sat down with Anyscale Co-Founder Robert Nishihara to discuss the future of AI-and how learnings from the Internet boom could help us predict AI’s own trajectory. Horowitz shared how, like AI, the Internet had a proprietary vs open source battle, with an open model eventually winning. The question, he says, comes down to people and technology: is the ...
Greg Brockman on Founding OpenAI and Systems for AI | Ray Summit 2022
Переглядів 3,6 тис.2 місяці тому
Filmed just three weeks before the launch of ChatGPT, OpenAI Co-Founder and President, Greg Brockman, sat down with Anyscale Co-Founder Robert Nishihara to discuss OpenAI’s mission of advancing AI in a way that’s beneficial to humanity. In this chat, Brockman shares the infrastructure challenges OpenAI faced when they began to train larger and larger models, and how Ray helped them train at sca...
Building Scalable AI Infrastructure with Kuberay and Kubernetes | Ray Summit 2024
Переглядів 9393 місяці тому
KubeRay maintainers Andrew Sy Kim from Google and Kai-Hsun Chen from Anyscale present an in-depth look at scaling generative AI workloads using KubeRay and Kubernetes. Their talk addresses how this integration provides a lightweight, flexible solution for diverse infrastructure requirements in AI deployments. The presentation covers crucial integrations with the Kubernetes ecosystem and cloud p...
Scaling Ray to 10K NPUs: Huawei's Hyperscale Journey | Ray Summit 2024
Переглядів 7433 місяці тому
Huawei's ambitious project of integrating 10,000 Ascend NPUs into a Ray cluster pushes the boundaries of distributed computing. In this technical deep dive, Boyuan Chen, Chong Yin Tan, and Xiaoshuang Liu from Huawei share their experiences and innovations in creating a hyperscale Ray-NPU infrastructure. The presenters detail the challenges of migrating existing business cases to Ray and adding ...
Optimizing vLLM Performance through Quantization | Ray Summit 2024
Переглядів 1,6 тис.3 місяці тому
At Ray Summit 2024, Michael Goin and Robert Shaw from Neural Magic delve into the world of model quantization for vLLM deployments. Their presentation focuses on vLLM's support for various quantization methods, including FP8, INT8, and INT4, which are crucial for reducing memory usage and enhancing generation speed. In the talk, Goin and Shaw explain the internal mechanisms of how vLLM leverage...
Scaling AI at Autodesk with Ray and Metaflow | Ray Summit 2024
Переглядів 5023 місяці тому
Autodesk's journey into large-scale 3D generative AI has led to a powerful synergy between Ray and Metaflow. In this session, Thomas Gale and Peter Meltzer from Autodesk, joined by Savin Goyal from Outerbounds, unveil how they've harnessed these tools to process terabytes of data and train advanced 3D models. The presenters dive into their innovative approach of integrating Ray's distributed co...
Scaling LLMs on Google Cloud: Synergy Between Ray, TPU, and GKE | Ray Summit 2024
Переглядів 8113 місяці тому
As Large Language Models (LLMs) become increasingly central to AI-driven solutions, the challenge of deploying them at scale demands innovative approaches. In this cutting-edge session, Fanhai Lu and Richard Liu from Google unveil a high-performance serving stack that harnesses the combined power of Ray, TPUs, and Google Kubernetes Engine (GKE). The presenters tackle the trifecta of LLM deploym...
Reverb's ML Evolution: From Data Engineering to MLOps | Ray Summit 2024
Переглядів 2213 місяці тому
As machine learning becomes integral to business operations, data engineering teams often find themselves at the forefront of ML infrastructure development. Sam Hallam from Reverb shares the company's journey in this transformative process, offering valuable insights for organizations navigating similar transitions. Hallam delves into the challenges and learnings encountered while building a sc...
The LLM-Cloud Synergy: NebiusAI's Insider Perspective | Ray Summit 2024
Переглядів 1363 місяці тому
In the race to build superior AI clouds, NebiusAI has discovered a crucial advantage: an in-house LLM team. Aleksandr Patrushev takes the stage to reveal how this synergy has become a game-changer in cloud service development. Patrushev shares key insights gleaned from NebiusAI's dual role as both LLM developer and cloud provider. He illustrates how firsthand experience in LLM creation directly...
How Rubrik Unlocked AI at Scale with Ray Serve | Ray Summit 2024
Переглядів 1673 місяці тому
Rubrik's quest for high-performance, real-time AI inference led them to a game-changing solution: Ray Serve. In this technical deep dive, Shaikh Ismail and Shivanshu Agrawal from Rubrik unveil their journey of harnessing Ray's ML model serving library to meet demanding scalability and throughput requirements. The duo explores Ray Serve's unique capabilities that made it stand out among alternat...
Pricing and Packaging Your AI Products for Scale | Ray Summit 2024
Переглядів 2453 місяці тому
In the fast-paced world of AI, where capabilities evolve at breakneck speed, pricing strategies can make or break a product's success. Metronome CEO Scott Woody takes the stage to demystify the complex art of AI product pricing and packaging. Woody tackles the pressing questions that keep AI entrepreneurs up at night: How can you confidently price products in an industry that's constantly in fl...
Multi-tenant Data Processing with Ray: Phaidra's Approach to Industrial AI | Ray Summit 2024
Переглядів 2143 місяці тому
Phaidra is reshaping the landscape of industrial and data center optimization with AI-driven controls. In this illuminating session, Brandon Hernandez and Jerry Luo unveil Phaidra's innovative approach to building a multi-tenant data processing platform on Ray for Reinforcement Learning agents. The presenters delve into the architecture of their Ray-based platform, which forms the backbone of t...
Ray at IBM: Transforming Large-Scale Data Processing for AI and Science | Ray Summit 2024
Переглядів 1403 місяці тому
Ray at IBM: Transforming Large-Scale Data Processing for AI and Science | Ray Summit 2024
Fighting Fire with Algorithms: Lockheed's RL-Based Wildfire Solution | Ray Summit 2024
Переглядів 1533 місяці тому
Fighting Fire with Algorithms: Lockheed's RL-Based Wildfire Solution | Ray Summit 2024
Ray Meets Daft: Supercharging ETL and Analytics | Ray Summit 2024
Переглядів 4163 місяці тому
Ray Meets Daft: Supercharging ETL and Analytics | Ray Summit 2024
How Datadog is Transforming Time Series Forecasting with Toto | Ray Summit 2024
Переглядів 2593 місяці тому
How Datadog is Transforming Time Series Forecasting with Toto | Ray Summit 2024
From Spark to Ray: CSS's Data Revolution with Daft | Ray Summit 2024
Переглядів 2543 місяці тому
From Spark to Ray: CSS's Data Revolution with Daft | Ray Summit 2024
Leveraging LLMs and LangGraph @ FlightAware | Ray Summit 2024
Переглядів 3053 місяці тому
Leveraging LLMs and LangGraph @ FlightAware | Ray Summit 2024
KubeSecRay: Fortifying Multi-Tenant Ray Clusters on Kubernetes | Ray Summit 2024
Переглядів 1653 місяці тому
KubeSecRay: Fortifying Multi-Tenant Ray Clusters on Kubernetes | Ray Summit 2024
Ray on Kubernetes: Powering Quant Research at Scale | Ray Summit 2024
Переглядів 1993 місяці тому
Ray on Kubernetes: Powering Quant Research at Scale | Ray Summit 2024
Scaling LLM Inference: AWS Inferentia Meets Ray Serve on EKS | Ray Summit 2024
Переглядів 2603 місяці тому
Scaling LLM Inference: AWS Inferentia Meets Ray Serve on EKS | Ray Summit 2024
Model Training on Snowflake with Ray | Ray Summit 2024
Переглядів 1653 місяці тому
Model Training on Snowflake with Ray | Ray Summit 2024
Akash Network: Powering Ray on an Open Source Cloud | Ray Summit 2024
Переглядів 1883 місяці тому
Akash Network: Powering Ray on an Open Source Cloud | Ray Summit 2024
Building Scalable Cross-Modal Search with Ray | Ray Summit 2024
Переглядів 2153 місяці тому
Building Scalable Cross-Modal Search with Ray | Ray Summit 2024
Accelerating Princeton's Computational Science with Ray | Ray Summit 2024
Переглядів 703 місяці тому
Accelerating Princeton's Computational Science with Ray | Ray Summit 2024
How Vivix Scales Video Ad Classification with Ray | Ray Summit 2024
Переглядів 1553 місяці тому
How Vivix Scales Video Ad Classification with Ray | Ray Summit 2024
Building Intelligent AI Infrastructure with O.XYZ's ORI | Ray Summit 2024
Переглядів 3243 місяці тому
Building Intelligent AI Infrastructure with O.XYZ's ORI | Ray Summit 2024
I love you.
00:00:03 - Intro & Motivation 00:01:06 - LLM & RL 00:08:36 - Challenges & Solutions 00:23:22 - Framework & Results
6:00 cannot agree more!
How to configure properly an on-premise S3 storage in Daft?
"give me fp16 or death" 😤😤
Hello snorkel team,i would love to be your part as Ml enginner,please let me know of further process
Good
“Laser”
clay shirky's Here Comes Everybody has come to life at AnyScale
讲得不错,给我很多启发
This guy is a head of his time - very sharp and makes a great point.
This guy is a legend. His work on RL especially TRPO, PPO algorithms is still the state of the art. Interesting interview 👍
Proud of MRNA tech and its utility? hmmmmmm
👑 👑 👑
I bought 12,000 shares of recursion pharmaceuticals
❤
Thanks for explaining this clearly.
Im glad Arthur Fleck really turn things around for him
Marc shouldn't talk authoritatively about military systems
Great content, horrible audio!
I'm somewhat struggling to understand the value of Ray Train over Lightning or even Vertex AI. It seems having to deploy onto a gke or eks cluster is more overhead than GCPs solution using on demand cluster spin up.
is this a toy example?
This guy is an affront to rational thought; a transparent self-aggrandizing shill not a fraction as intellectually capable as he believes himself to be by virtue of the simple fact that no one is or in practical terms could be
do people realize that Russia also has a drone program and by the end if the war it will be one if the most advanced
Good interviewer. Great convo
dr evil. plus conehead
It just seems all fake like scripted. You found a book on Singularity at a garage sale? 😂 You’re just that aligned, huh?
awesome!!!!
Great guy
Unfortunately VLLM Integration with KubeRay seems to be buggy for now. Couldn't get it to run, especially with the newer (0.6.4) VLLM versions. There only few resources and issues in the internet.
What? Last year's video?
Indeed Dr. Evil.
AWESOME
Awesome 👍
Requiring the companies to conduct and publish their safety research seems like a good regulation. If you don't want bad government regulation then maybe YOU need to have ideas for good regulations. Wait a minute! Are you waiting for Mitch McConnell and Pelosi to come up with something? They won't. But if your little toy robots go messing with the grid and so on, you can be sure the guys with the black SUV's will find you quick. They'll be angry. And they will have questions which you can't answer. You didn't study for the test? At all? And they'll be rude!
He’s obviously lying. A uh manoa student created ChatGPT, called Lana ai. Easy to google and fine that out.
Great discussion, love knowing more about how things evolved.
Fake it till you make it.
100%. You've clearly worked in the industry.. (me too)
Interesting
Interesting
Perhaps the answer to scalable supervision is humans proficient at research given a RAG based system with academic libraries, the national archives, and high quality heterodoxy like Michael Hudson, John Stockwell, etc
This guy does not lack jaw power
Guy looks like Joker, now I'm really worried about AGI if anything bad happens to him.
lol, first thing that came to my mind when I saw the thumbnail xD
♥♥♥♥I love AI♥♥♥♥
There should be much more investments in AI safety and much more effort put into AI safety regulations. Remember, when this goes very wrong there likely won't be a second chance for us. Very important warnings by two godfathers of AI, Geoffrey Hinton and Yoshua Bengio, and many other leading AI technicians, about a very real, possible AI existential threat! Like by creating subgoals when AIs are enabled to act autonomously, and one of those subgoals would be to get more control. When they'll surpass us in general intelligence, which we won't necessarily notice, we won't be able to keep up with them and imagine what they're planning or strategizing. Surely these people are ultimate generative AI technical experts and truly know what they're talking about. As a layperson I choose to trust their information and warnings before anyone else.
With the AI paradigm shift I guess people need to have a guarantee for a means of survival also without having a job, and that they have extra free time. Current intellectual and creative jobs also have boring repetitive time consuming tasks. AI is an opportunity and new way of life to continuously learn, explore and be more creative.
Wow, important conversation. Thanks for sharing! Great questions
Andreesen is brilliant
Will we all be substituted by super intelligent ai?