🤖 Large Language Models & Autonomous Agents: Sub-Curriculum Index

Welcome to the Large Language Models & Autonomous Agents curriculum. This track covers the full lifecycle of modern Generative AI: autoregressive LLM architectures, in-context prompt engineering, parameter-efficient fine-tuning (LoRA/QLoRA), autonomous ReAct agents, multi-agent state machines with LangGraph, and enterprise safety guardrails.

Every guide in this series strictly follows a two-part learning format:

  • ⚡ Quick Dive: Comparison matrices, prompt patterns, fine-tuning memory math, and guardrail rules.
  • 📖 Extended Guide: Complete Python code implementations, agent loop state graphs, LoRA training configs, and security architectures.

📚 Curriculum Roadmap

# Guide Primary Topics Covered
01 Large Language Models Architecture Autoregressive decoding, KV-Caching, context windows, tokenizer vocabularies, and compute scaling laws.
02 Prompt Engineering & In-Context Learning Zero-shot, Few-shot, Chain-of-Thought (CoT), Tree-of-Thoughts (ToT), Directional stimulus, and structured JSON output generation.
03 Fine-Tuning: PEFT, LoRA & QLoRA Parameter-Efficient Fine-Tuning, Low-Rank Adaptation (LoRA), 4-bit NF4 Quantization (QLoRA), and Hugging Face peft/trl.
04 AI Agents: ReAct, Planning & Tools Reasoning and Acting (ReAct) execution loops, function calling schemas, tool execution sandboxes, and long-term memory.
05 Multi-Agent Systems & LangGraph Hierarchical supervisor patterns, cyclical state graphs with LangGraph, agent debate, and Human-in-the-Loop workflows.
06 LLM Safety & Guardrails Direct/indirect prompt injection defenses, input/output guardrails (NeMo, Llama Guard), and PII exfiltration mitigation.