Intel Unnati GenAI Chatbot 04 IIntroduction to GenAI and Simple LLM Inference on CPU
Вставка
- Опубліковано 6 вер 2024
- Introduction to GenAI and Simple LLM Inference on CPU and fine-tuning of LLM Model to create a Custom Chatbot
Description:
This problem statement is designed to introduce beginners to the exciting field of Generative Artificial Intelligence (GenAI) through a series of hands-on exercises. Participants will learn the basics of GenAI, perform simple Large Language Model (LLM) inference on a CPU, and explore the process of fine-tuning an LLM model to create a custom Chatbots.
Major Challenges:
Pre-trained Language Models can have large file sizes, which may require significant storage space and memory to load and run.
Learn LLM inference on CPU.
Understanding the concept of fine-tuning and its importance in customizing LLMs.
Create a Custom Chatbot with fine-tuned pre-trained Large Language Models (LLMs) using Intel AI Tools.
Outcomes:
Participants will gain a foundational understanding of Generative AI and its applications.
Participants will be able to perform simple LLM inference on a CPU and understand the process of fine-tuning LLMs for custom applications.
Participants will have to create a 5-page report on Problem, Technical Approach and Results