Lecture Materials - 2025 Fall

🌸🎉 Welcome to Ewha AI, Fall 2025 Incoming Students!

2025 Fall Semesters

Reinforcement Learning

• • Syllabus (Tentative)

  • Week1: Lecture 1-2 (Video:20250901, 20250903)

  • Week2: Lecture3-4 Imitation learning part1

  • Week3: Lecture3-4 Imitation learning part2 (video)

  • Week4: Lecture 5-6: RL_concepts , Policy Gradient  

  • Week5: Policy Gradient (Continue)
    Lecture 7: Off Policy Policy Gradient  (REINFORCE_with_TF_from_Scratch_Code)

  • Week7: Lecture 8: Actor-Critic Algorithm 

  • Week8: Midterm-Review, 10/22 - Midterm

  • Week 9: Lecture 9: Actor-Critic Algorithm Part 2
    Lecture 10:Value based methods (policy iteration) : Video

  • Week10: Lecture11-12: Q-learning 

  • Week11: Lecture 13: DQN

  • Week12: Lecture 14: Continuous Q learning, Lecture15 Offline RL1 VIDEO

  • Week 13:  Lecture16-17 Offline RL2

  • Week14: Lecture18: RL-based LLM post training(part1) video
    Lecture 19: RL based LLM post trainng(part2) video

  • Week 15: Lecture 20: RL based LLM post training(part3) video
    Final Review

Data Structure

• • Syllabus (Tentative)

  • Week1: Lecture 1, Lecture 2: Python_Basic (Video:  20250901,)

  • Week2: Lecture-3-Computational Complexity & Searching

  • Week3: Lecture 4-5: Array & Linked-list (Video)

  • Week4: Linked-list (continued)

  • Week5: Lecture 6: Homework1 (Search, Recursion)   Solution Video (Video1, Video2)
    Homework2 (Array, LinkedList)
          Lecture 7: Stack&Queue

  • Quiz Solution

  • Week6-7: Lecture8. Tree 

    • Video (Solution Video: HW1, HW2, HW3, HW4, HW5, HW6, HW7)

  • Week8-9: Lecture 9-10. Sorting Algorithm  

  • Week10: Lecture 11: PQ and Heap, Lecture 12: Heap2

  • Week11: PQ_Heap_Problemsolving (video)

  • Week 12: Problem solving session 2

  • Week 13: Hash table Graph 

  • Week 14: Graph 2 (Video) ProblemSolving (video) 

  • Week 15: ProblemSolving video