1. Learning Process Model
    1. Function curves
      1. linear
      2. geometric
    2. Bayesian updating
      1. trial-by-trial behavior not satisfactory
      2. asymptotic convergence and consistent
    3. Markov chain
    4. Machine learner?
    5. Desired prop.
      1. knowledge increases on average
      2. abstracting out a func. from certain model
  2. Stochastic System Model
    1. States
      1. connection/detection
    2. Transitions
    3. Reward/Cost measure
    4. Controls
  3. Issues
    1. Sample path dependency
      1. ``long-run behavior'' summary as solution
  4. Analysis
    1. Time-separable trick
    2. MDP
      1. SSP
        1. relentless attacker
        2. Never-Expel dominates
      2. Discounted
        1. prob. of attacker giving up