LLM Training/Fine-tuning

Welcome to the AI Training module! This notebook serves as an introduction to the fundamental concepts and techniques used in training artificial intelligence models.

In this module, we’ll explore various aspects of AI training, including:

• Data preparation and preprocessing

• Model selection and architecture

• Training algorithms and optimization techniques

• Evaluation metrics and performance assessment

• Fine-Tuning T5-Small on a Single GPU
• Fine-Tuning GPT-2 on a Single GPU
• Fine-Tuning TinyLlama on a Single GPU
• Instruction Tuning Olmo-1b
• Getting Started with Axolotl: Fine-Tuning Gemma 2B