Notation And Dependencies

Symbol Table

The “Introduced” column lists the chapter that owns the general definition of each symbol. Many symbols first appear concretely in the Chapter 0 worked example before they are defined in general; the column points to the latter.

Introduced In Chapter 0

  • Code Test: finite state space with Code Test states (general definition in Chapter 2).
  • Code Test: finite action space with Code Test actions (general definition in Chapter 2).
  • Code Test: actor parameter in Code Test (general definition in Chapter 2).
  • Code Test: critic parameter in Code Test (general definition in Chapter 2).
  • Code Test: dynamic state distribution in Code Test (general definition in Chapter 2).

Introduced In Chapter 1

  • Code Test: semiflow on Code Test (constructed for the coupled system in Chapter 3).

Introduced In Chapter 2

  • Code Test: softmax policy.
  • Code Test: actor feature vectors.
  • Code Test: critic feature vectors.
  • Code Test: product occupancy Code Test.
  • Code Test: generator family for the controlled chain.
  • Code Test, Code Test: critic matrix and forcing vector.
  • Code Test: boundary-confinement damping matrix Code Test.
  • Code Test: prescribed Lipschitz closure map Code Test.
  • Code Test: phase space Code Test.
  • Code Test: critic coercivity constant (coercivity role in Chapter 4).
  • Code Test: fast-law timescale parameter (central in Chapter 7).

Introduced In Chapter 4

  • Code Test: critic drift bound.
  • Code Test: absorbing critic radius Code Test.
  • Code Test: compact absorbing set Code Test.

Introduced In Chapter 5

  • Code Test: omega-limit set of Code Test.
  • Code Test: compact global attractor.

Introduced In Chapter 6

  • Code Test: frozen invariant law of Code Test.
  • Code Test: invariant-law closure map Code Test.
  • Code Test: stationary occupancy after the bridge theorem.

Introduced In Chapter 7

  • Code Test: exact attractor at timescale Code Test.
  • Code Test: reduced (lifted) attractor.

Chapter Dependency Diagram

The chapters are designed for linear reading:

  1. Ch 0: Worked Example
  2. Ch 1: Prerequisite Bridge
  3. Ch 2: General Model
  4. Ch 3: Well-Posedness
  5. Ch 4: A Priori Estimates
  6. Ch 5: Global Attractor
  7. Ch 6: Controlled Chain Closure
  8. Ch 7: Fast-Slow Reduction
  9. Ch 8: Outlook and Open Problems

Chapter 6 also draws on the generator family introduced in Chapter 2. Chapter 8 contains no new theorems and can be read independently after Chapter 7.

Chapters 0—8 above form the theoretical core. The application chapters are read after Chapter 8 in the order Ch 9 → Ch 10 → Ch 11 (Chapter 9 defines the Model Specification Protocol that Chapters 10 and 11 execute, and Chapter 11 builds on Chapter 10); they introduce model-specific symbols local to each chapter (the Y-graph generators Code Test of Chapter 10, the hub-and-spoke construction of Chapter 11) rather than new core notation. Appendix A maps the core theorems to their Lean formalization, and Appendix B collects computational methods and a phase-portrait blueprint.

Conventions

  • Indices. States are indexed by Code Test, actions by Code Test. State-action pairs are Code Test.
  • Probability. Code Test denotes the probability simplex on Code Test. Elements Code Test are column vectors with Code Test and Code Test; the adjoint generator Code Test acts on distributions, while Code Test acts on observables.
  • Norms. Code Test is the Euclidean norm unless otherwise specified. The simplex uses the Code Test distance Code Test, which equals twice the total-variation distance.
  • Overloaded letters. The letter Code Test names both the number of actions in the model data and the compact absorbing set constructed in Chapter 4; context always disambiguates.
  • Closure maps. Code Test always denotes a prescribed Lipschitz closure map. Code Test denotes the invariant-law map identified by the bridge theorem (Chapter 6). The two coincide once the bridge theorem is in place, but the distinction matters in Chapters 2—5.