Parsl Project
Parsl Project
  • 84
  • 2 261
Pluggable Dependencies
Parsl waits for Futures to complete when used as app arguments. Ben Clifford and Andrew Rosen worked on expanding this to richer types (for example, lists of futures). In this talk, Ben discusses that prototype mechanism.
Recording Date: May 28, 2024
Speaker: Ben Clifford
Переглядів: 10

Відео

Billion Task Parsl
Переглядів 34Місяць тому
This talk is intended to stimulate imaginings of what Parsl might look like in future years if running a Billion Tasks was a goal. Recording Date: October 15, 2024 Speaker: Ben Clifford
TaPS: A Performance Evaluation Suite for Task-based Execution Frameworks
Переглядів 432 місяці тому
In this talk, Greg discusses his work with TaPS - a performance evaluation suite for task-based execution frameworks. Speaker: Greg Pauloski Session Date: September 27, 2024
Dynamic Resource Management for Elastic Scientific Workflows using PMIx/PRRTE
Переглядів 322 місяці тому
In this talk, Rajat discusses dynamic resource management for elastic scientific workflows using PMIx/PRRTE. Speaker: Rajat Bhattarai Session Date: September 27, 2024
Extreme-Scale Monitoring of Parsl Workflows with Chronolog
Переглядів 222 місяці тому
In this talk, Inna discusses extreme-scale monitoring of Parsl workflows with Chronolog. Speaker: Inna Brodkin Session Date: September 27, 2024
Task Orchestration in Heterogeneous Computing Environments using Globus Compute
Переглядів 302 місяці тому
In this talk, Matthew discusses developing a framework called DELTA (Distributed Execution of Lambdas with Tradeoff Analysis) on top of Globus Compute that effectively acts as a scheduling layer to manage endpoints and route submitted tasks to an appropriate endpoint. Speaker: Matthew Baughman Session Date: September 27, 2024
MPI+FaaS: Extending Parsl and Globus Compute to Represent and Execute MPI Tasks
Переглядів 192 місяці тому
In this talk, Yadu discusses extending Parsl and Globus Compute to represent and execute MPI tasks. Speaker: Yadu Babuji Session Date: September 27, 2024
Parsl at ALCF: Use Cases and Challenges for IRI, Aurora, and Beyond
Переглядів 222 місяці тому
In this talk, Christine talks about use cases and challenges with using Parsl at the Argonne Leadership Computing Facility (ALCF). Speaker: Christine Simpson Session Date: September 27, 2024
Using Globus Compute to Streamline Federated Learning Applications
Переглядів 402 місяці тому
In this talk, Zilinghan elaborates on how Globus Compute can make federated learning easier in various application scenarios. Speaker: Zilinghan Li Session Date: September 27, 2024
Synergies Among Parsl, MLOPs, and Custom Cloud Clusters
Переглядів 332 місяці тому
In this talk, Lola presents a vision and initial proof of concept results of the potential synergies of using three technological frameworks in concert: 1) an MLOPs workflow built on industry-standard open source tools (MLFlow, DVC, and GitHub Actions) that is orchestrated by 2) Parsl running on 3) custom cloud clusters. This work is the result of her summer 2024 internship at Parallel Works. S...
Scalable Earth Observation ML Workflow in Climate Applications
Переглядів 362 місяці тому
A large-scale earth observation and earth system offers valuable insights for advancing climate research, but it also presents significant challenges in terms of processing and analysis. In this talk, Takuya demonstrates a development of automated multi-facility workflow leveraging Globus software that orchestrates data collection, preprocessing, machine learning process, and data management at...
Scaling ML Interpretability Experiments Using Parsl
Переглядів 262 місяці тому
In this talk, Mansi discusses her work with scaling machine learning interpretability experiments using Parsl. Speaker: Mansi Sakarvadia Session Date: September 27, 2024
Seesaw: Elastic Scaling for Task-Based Distributed Programs
Переглядів 602 місяці тому
In this talk, Matthew discusses the research he has conducted regarding different algorithms experimented with to enable scaling down behavior with the HTEX in Parsl. Research applies to the interchange aspect of the HTEX and the concept of adding modularity to HTEX. Speaker: Matthew Chung Session Date: September 27, 2024
Developing Distributed HPC Capabilities of an Open Science Platform for Robust Epidemic Analysis
Переглядів 132 місяці тому
In this talk, Valerie discusses her work with developing distributed high-performance computing (HPC) capabilities for OSPREY (Open Science Platform for Robust Epidemic Analysis). Speaker: Valerie Hayot-Sasson Session Date: September 27, 2024
Creating Wide-Area Distribution Systems with DynoStore and Globus Compute
Переглядів 142 місяці тому
In this talk, Dante discusses DynoStore - a system based on abstractions called data containers that enable the creation of wide-area storage systems. DynoStore load-balances data through data containers and includes resilience mechanisms to mitigate failures in the storage infrastructure. In combination with Globus Compute, he helped create different applications for the management of health a...
The Globus Compute Dataset: An Open Function-as-a-Service Dataset From the Edge to the Cloud
Переглядів 222 місяці тому
The Globus Compute Dataset: An Open Function-as-a-Service Dataset From the Edge to the Cloud
Multi-User Globus Compute Endpoints
Переглядів 452 місяці тому
Multi-User Globus Compute Endpoints
Future of Globus Compute
Переглядів 142 місяці тому
Future of Globus Compute
Extending Globus Compute with RO-Crate Provenance Models
Переглядів 282 місяці тому
Extending Globus Compute with RO-Crate Provenance Models
Enabling Economical and Scalable Genomic Workflows
Переглядів 852 місяці тому
Enabling Economical and Scalable Genomic Workflows
Replacing Channels with Globus Compute Executors in Parsl
Переглядів 142 місяці тому
Replacing Channels with Globus Compute Executors in Parsl
Globus Compute Update
Переглядів 102 місяці тому
Globus Compute Update
Tracking File Provenance with Parsl
Переглядів 152 місяці тому
Tracking File Provenance with Parsl
Diamond - An Integration Portal for Using Globus Compute via a Frontend
Переглядів 173 місяці тому
Diamond - An Integration Portal for Using Globus Compute via a Frontend
A Workflows Ecosystem for ESGF Data
Переглядів 173 місяці тому
A Workflows Ecosystem for ESGF Data
Federated Numerical Weather Prediction Workflows with MPAS
Переглядів 163 місяці тому
Federated Numerical Weather Prediction Workflows with MPAS
Parsl and TaskVine: Interactions Between DAG Managers and Workflow Executors
Переглядів 253 місяці тому
Parsl and TaskVine: Interactions Between DAG Managers and Workflow Executors
TaskVine Overview
Переглядів 313 місяці тому
TaskVine Overview
An Update on Parsl Sustainability
Переглядів 93 місяці тому
An Update on Parsl Sustainability
Leveraging Globus API for High-Performance Data Transfer and Computation
Переглядів 163 місяці тому
Leveraging Globus API for High-Performance Data Transfer and Computation