Date Description
2021-09-02 History, Motivation, and Combinatorial Games
2021-09-07 Backtracking, Game Complexity, Nim-sum
Slow Nim solver
2021-09-09 Sprague-Grundy Theorem
2021-09-14 Using Sprague-Grundy; Minimax and Dynamic Programming
Chomp solver (slow recursive and faster memoized)
Tic-Tac-Toe slow recursive, memoized, dynamic programming
2021-09-16 Value Iteration for Combinatorial Games; Markov Decision Processes; Yahtzee
2021-09-21 Optimal Policies; Dynamic Programming; Min info for Markov Property
2021-09-23 Shut the Box
2021-09-28 Policy Evaluation; Policy Iteration
Policy Iteration for Solitaire Pig
2021-09-30 Value Iteration; Simultaneous Games
Value Iteration for Solitaire Pig
2021-10-05 Finding an Equilibrium
2021-10-07 Linear Programming
Python with scipy
Java with JOptimizer
  Exam #1 Practice and solutions
2021-10-12 Minimax
2021-10-14 Transposition Tables, Iterative Deepeing, Alpha-Beta Pruning
2021-10-26 Scout, MTD-f
2021-10-28 Monte Carlo Tree Search
2021-11-02 Variations of MCTS
2021-11-04 Genetic Algorithms
2021-11-09 TD-learning
TD(0) for Solitaire Pig
2021-11-11 Q-learning, Linear Approximators, Coarse Coding
Q-learning for Solitaire Pig
2021-11-16 Artificial Neural Networks
2021-11-18 ANN Supervised Learning
Iris Classification using Keras
2021-11-30 Deep Q Learning; AlphaGo
DQN for QFL
2021-12-02 AlphaGo Zero; Policy Gradient methods
2021-12-07 Procedural Content Generation
  Exam #2 Practice and solutions