Skip to main content Calendar
Week 1Introduction to foundation models
- Mehr 4
- Lecture 1Introduction to foundation models
- Dr. Soleymani
Slides PDF
Video OCW
Week 2Language models: Architectures and training I
- Mehr 9
- Lecture 2 Transformers: Encoder model
- Dr. Asgari
Slides PDF
Video OCW
Week 3Language models: Architectures and training II
- Mehr 18
- Lecture 3 Transformers: Decoder model
- Dr. Asgari
Slides PDF
Video OCW
Week 4Adapting LLMs to new tasks or domains I
- Mehr 23
- Lecture 4 Transformers: Encoder-decoder model
- Dr. Asgari
Slides PDF
Video OCW
- Mehr 25
- Lecture 5 Prompting for zero-shot and few-shot learning
- Dr. Rohban
Slides PDF
Video OCW
Week 5Adapting LLMs to new tasks or domains II
- Mehr 30
- Lecture 6 Parameter-efficient fine-tuning I
- Dr. Rohban
Slides PDF
Video OCW
- Aban 2
- Lecture 7 Parameter-efficient fine-tuning II
- Dr. Rohban
Slides PDF
Video OCW
Assignment 1 Quera
Week 6Adapting LLMs to new tasks or domains III
- Aban 7
- Lecture 8 In-context learning understanding
- Dr. Soleymani
Slides PDF
Video OCW
- Aban 9
- Lecture 9 Reliability in prompting LLM: Uncertainty, calibration, factuality
- Dr. Soleymani
Slides PDF
Video OCW
Week 7Data & Evaluation I
- Aban 14
- Lecture 10 Multilingual LM
- Dr. Asgari
Slides PDF
Video OCW
- Aban 16
- Lecture 11 Data preprocessing
- Dr. Asgari
Slides PDF
Video OCW
- Aban 19
- Assignment 1 Deadline
Week 8Data & Evaluation II
- Aban 21
- Lecture 12 Effect of pre-training data on LLMs
- Dr. Rohban
Slides PDF
Video OCW
- Aban 22
- Assignment 2 Quera
- Aban 23
- Lecture 13 Training LMs with instructs
- Dr. Rohban
Slides PDF
Video OCW
Week 9Further alignment and empowerment of LLMs I
- Aban 28
- Lecture 14 Training LMs with human feedback
- Dr. Rohban
Slides PDF
Video OCW
- Aban 30
- Lecture 15 Evaluation: HELM framework
- Dr. Asgari
Slides PDF
Video OCW
Week 10Further alignment and empowerment of LLMs II
- Azar 5
- Lecture 16 Model zoo
- Mr. Ghahroodi
Slides PDF
Video OCW
- Azar 7
- Lecture 17 Reasoning: Chain of thought prompting
- Dr. Soleymani
Slides PDF
Slides PDF
Video OCW
Week 11Image-text and multimodal LMs I
- Azar 11
- Assignment 2 Deadline
- Azar 12
- Lecture 18 Knowledge in LLMs
- Dr. Soleymani
Slides PDF
Video OCW
Assignment 3 Quera
- Azar 14
- Lecture 19 Vision Language Models (VLMs)
- Dr. Soleymani
Slides PDF
Video OCW
Week 12Image-text and multimodal LMs II
- Azar 19
- Lecture 20 Large Multi-modal Models (LMMs)
- Dr. Soleymani
Slides PDF
Video OCW
- Azar 21
- Lecture 21 Multi-modal Agents
- Dr. Soleymani
Slides PDF
Video OCW
- Azar 24
- Assignment 3 Deadline
Week 13Model zoo
- Azar 28
- Lecture 22 Retrieval-based LLMs
- Dr. Asgari
Slides PDF
Video OCW
Week 14Student Presentations
- Dey 3
- Lecture 23 Student Presentations
Video OCW
- Dey 5
- Lecture 24 Student Presentations
Video OCW
- Dey 7
- Lecture 25 Student Presentations
Video OCW
Week 15Student Presentations
- Dey 10
- Lecture 26 Student Presentations
Video OCW
- Dey 12
- Lecture 27 Student Presentations
Video OCW
Week 17Exam