Lecture Materials - 2025 Fall

🌸🎉 Welcome to Ewha AI, Fall 2025 Incoming Students!

2025 Fall Semesters

Reinforcement Learning

• • Syllabus (Tentative)

  • Week1: Lecture 1-2 (Video:20250901, 20250903)

  • Week2: Lecture3-4 Imitation learning part1

  • Week3: Lecture3-4 Imitation learning part2 (video)

  • Week4: Lecture 5-6: RL_concepts , Policy Gradient  

  • Week5: Policy Gradient (Continue)
    Lecture 7: Off Policy Policy Gradient  (REINFORCE_with_TF_from_Scratch_Code)

  • Week7: Lecture 8: Actor-Critic Algorithm 

  • Week8: Midterm-Review, 10/22 - Midterm

  • Week 9: Lecture 9: Actor-Critic Algorithm Part 2
    Lecture 10:Value based methods (policy iteration) : Video

Data Structure

• • Syllabus (Tentative)

  • Week1: Lecture 1, Lecture 2: Python_Basic (Video:  20250901,)

  • Week2: Lecture-3-Computational Complexity & Searching

  • Week3: Lecture 4-5: Array & Linked-list (Video)

  • Week4: Linked-list (continued)

  • Week5: Lecture 6: Homework1 (Search, Recursion)   Solution Video (Video1, Video2)
    Homework2 (Array, LinkedList)
          Lecture 7: Stack&Queue

  • Quiz Solution

  • Week6-7: Lecture8. Tree 

    • Video (Solution Video: HW1, HW2, HW3, HW4, HW5, HW6, HW7)

  • Week8-9: Lecture 9-10. Sorting Algorithm