Phi 3 and Arctic: Outlier LMs are hints

Models that seem totally out of scope from recent open LLMs give us a sneak peek of where the industry will be in 6 to 18 months.
This is AI generated audio with Python and 11Labs.
Source code: github.com/natolambert/interc...
Original post: www.interconnects.ai/p/phi-3-...
0:00 Phi 3 and Arctic: Outlier LMs are hints
1:01 Arctic & open mixture of expert trends
6:10 Phi 3, synthetic data, and small models
Fig 1: huggingface.co/datasets/natol...
Fig 2: huggingface.co/datasets/natol...
Fig 3: huggingface.co/datasets/natol...

[@khanra17]

Are you a human or just ai generated text with ai tts?
because these is very very very poor video.