10/24/2023 - Local AI: Marcus on Running Private Models + Salon Explores AI Limits

An AI Salon community session exploring locally running AI models for privacy and creative applications. Marcus demonstrates a Raspberry Pi system running a 7 billion parameter model for image recognition, poetry writing, and more - detailing speed, spatial awareness, and the ability to specialize models.
The group also dives into advances allowing small devices to run models previously requiring vast compute, creative use cases, challenges to open source progress, the pace of change and consumer adoption and business applications. Useful for creatives, developers and anyone concerned about privacy or looking to push the boundaries of what’s possible in AI.
#aisalon #localai #privacyai #openai
Marcus on Running Private AI Locally
01:19:21 - Privacy benefits of local AI
01:20:00 - Raspberry Pi running 7 billion parameter AI
01:22:11 - Local AI speed limitations
01:28:24 - Multimodality showing early promise
01:32:05 - Spatial awareness in image recognition
01:34:03 - Specialized AI for creative applications
01:36:26 - Local AI limitations
Additional Topics Covered
00:39 - Raspberry Pi running 7 billion parameter AI
01:34 - AI image recognition and multimodality
01:48 - Slow public adoption of large language models
02:27 - Guide to install local AI yourself
03:18 - AI fiction writing unbound by ethics
04:18 - The future of personal AI assistants
05:16 - Inclusivity in exploring AI
07:32 - AI Salon values
09:17 - One year since GPT-3 launch
13:13 - GP3 features - vision, browsing, analysis
20:01 - Microsoft and Google earnings show AI promise
22:29 - Running optimized models locally
32:36 - Evolution pace in open source AI
44:05 - Creativity benefits of unrestricted models
47:51 - AI progress reliance on big tech data
55:16 - Past fears of word processors vs AI writing
59:07 - Using AI to find jobs
01:00:30 - Preparing workforces for AI
01:06:29 - Transitioning AI Salon to Mighty Networks
01:10:08 - Microsoft CoPilot rollout
01:13:13 - AI business revenue and growth
01:15:46 - Consumer AI familiarity still low