Odyssey: A Toolkit to Build Foundation Models Using Electronic Health Records - Vector Intern Talks

Adib's talk explores the development of Project Odyssey, a toolkit for developing foundation models with Electronic Health Record (EHR) data, leveraging the FL7 FHIR data format. During this initiative, Adib developed a groundbreaking Transformer model that significantly expands the maximum context length by fourfold and excels across a spectrum of healthcare tasks when fine-tuned as a unified model. Additionally, he employed the Mamba structure on this dataset for the first time, achieving state-of-the-art results in this domain. The next phase of the project involves deploying this model on the GEMINI dataset to ensure it generalizes well across various hospital settings in Canada. This work serves as a significant stepping stone towards scalable and efficient healthcare AI, poised to impact patient care positively across the nation.
Do you want to gain hands-on ML experience? Explore Vector’s internship opportunities: vectorinstitut...