Chapter 11: Network Routing Under Endogenous Traffic

Chapter 10 showed that filter bubbles in a recommendation platform appear as boundary equilibria of the coupled actor-critic-law system, and that reward design controls the regime: at the baseline parameters the diverse interior equilibrium attracts and the bubble equilibria repel, while stronger engagement incentives push the platform toward–and across–the threshold where bubble lock-in becomes attracting. The model had five states on a Y-graph, a two-dimensional actor with block-diagonal features, and an engagement-diversity reward tension that created the boundary equilibria.

This chapter applies the same protocol to a different domain: network routing. The starting point is the three-state retail-to-vet routing chain that first appeared in Chapter 2, Section 2.8 and was carried through Chapters 6—7 to illustrate the bridge theorem and the fast-slow reduction. That model had three operational states and showed the generator construction in action, but it was not developed into a full attractor-level study of the traffic configurations the network can settle into.

We extend the three-state chain to a five-state hub-and-spoke network whose equilibrium set contains a balanced interior routing configuration and two spoke lock-in configurations pinned at the actor boundary. At the baseline parameters the balanced configuration attracts and the lock-in configurations repel–a numerical observation we mark as such where it appears–and the design lesson is a regime story: reward levers move the network toward, and across, the threshold at which spoke lock-in becomes attracting. The hub’s role as a reference state for minorization–already visible in the three-state model–becomes the structural anchor that makes the bridge theorem and tracking estimate apply with explicit computable constants.

11.1 From the Retail-Vet Chain to a Full Network

The Section 2.8 routing model had three states: a retail hub (state 1) where customers enter, a health-discovery funnel (state 2) where customers encounter veterinary content, and a vet-booking page (state 3) where the high-value conversion happens. The routing agent chose between two presentation modes–retail-safe and vet-push–and the softmax mixture of two action-conditioned generators determined how customers flowed through the funnel.

Three structural features made the three-state model work within the Chapter 2 framework:

  1. State-independent features. The actor features did not depend on the state: Code Test, Code Test for all Code Test. A single scalar parameter Code Test controlled the routing bias at every node simultaneously.

  2. Reference-state reachability. The retail hub was reachable from every state at rates bounded below by a positive constant independent of Code Test. This gave the minorization condition that Chapter 6 needs.

  3. Explicit generator construction. The generators Code Test and Code Test were built directly from the customer-flow topology, and the softmax mixture inherited the generator property.

All three features survive in a larger network, with one qualification we flag now and prove later. The model we build here has five states instead of three, but the construction follows the same pattern: state-independent features give a scalar policy axis, the hub remains uniformly reachable–though, as the next paragraphs explain, only in two steps from the deepest nodes–and the generators are built from the network’s adjacency structure.

The main difference is that the five-state network has two competing spoke branches instead of a single funnel. The routing agent can direct traffic left (toward the A—C branch) or right (toward the B—D branch), and the equilibrium set includes a configuration for each direction. This is the routing analogue of the recommendation chapter’s filter bubbles: instead of competing content niches, we have competing traffic destinations.

Structural comparison with the three-state chain. The Ch2.8 model and the hub-and-spoke network are related by reinterpretation, not by inclusion. The retail hub (state 1) plays the role of the central hub Code Test; the health-discovery funnel (state 2) corresponds to the primary destination Code Test; the vet-booking page (state 3) corresponds to the secondary destination Code Test. The graphs differ in one decisive edge. The Ch2.8 generators keep a direct return edge from the deepest state to the hub: Code Test uniformly on the actor box, so every state reaches the hub in a single jump and the one-step minorization hypothesis of Proposition 6.6 holds directly. The hub-and-spoke network deliberately removes that edge: the secondary destination Code Test connects only through Code Test, the hub is reachable from Code Test in two steps but not in one, and Proposition 6.6 no longer applies as stated. Section 11.4 proves the two-step substitute.

On the action side, Ch2.8’s vet-push action Code Test (which drives traffic deeper into the funnel) corresponds to Ch11’s left-bias Code Test (which drives traffic into the Code TestCode Test branch); the Ch2.8 retail-safe action Code Test (which keeps mass at the hub) is replaced in Ch11 by a competing right-bias Code Test that drives traffic into a mirror funnel Code Test. The Ch2.8 reward asymmetry between core retail and vet booking generalizes to the Ch11 reward asymmetry between matching and mismatching routing modes at primary and secondary destinations (Code Test, Code Test, and the mirror inequalities at Code Test).

The structural promotion is therefore twofold: the single funnel becomes one of two competing mirror branches, and the binary action set is reinterpreted from “advance versus hold” to “advance left versus advance right”. A single funnel has only one direction in which traffic can self-reinforce. The two-branch network supports two distinct self-reinforcing directions, one for each spoke, and the boundary equilibria at Code Test are the configurations each direction selects. Whether those configurations attract is a parameter question, and Sections 11.5—11.6 answer it.

11.2 Model Specification: The Hub-and-Spoke Network

We execute the full Model Specification Protocol.

Step 1. State space. Five nodes on a hub-and-spoke network:

  • Code Test: Central hub. The primary entry point where traffic arrives. Moderate revenue is earned passively from hub traffic.
  • Code Test: Primary destination A. A service node connected to the hub. Moderate service-specific revenue.
  • Code Test: Primary destination B. A second service node, also connected to the hub. Symmetric to Code Test in the baseline model.
  • Code Test: Secondary destination via A. A high-value service node reachable only through Code Test. The highest revenue in the left branch.
  • Code Test: Secondary destination via B. A high-value service node reachable only through Code Test. The highest revenue in the right branch.

The network topology is a diamond with tails: Code Test. There are no direct connections between the two branches (Code Test and Code Test are connected only through Code Test), and the secondary destinations are accessible only through their primary nodes.

Step 2. Action space. Two routing modes:

  • Code Test (Left-bias): route traffic preferentially toward the Code TestCode Test branch.
  • Code Test (Right-bias): route traffic preferentially toward the Code TestCode Test branch.

Step 3. Actor features. Scalar actor (Code Test) with state-independent features, matching the Section 2.8 pattern:

Code Test

A positive Code Test favors right-bias at every node. A negative Code Test favors left-bias. The actor box is Code Test.

Step 4. Critic features. Scalar critic (Code Test) with matching state-independent features:

Code Test

The critic tracks a single signal: the reward advantage of right-bias over left-bias.

Step 5. Rewards. The reward table reflects the network’s value structure: secondary destinations carry the highest-value services, and the rewards are asymmetric across branches to create competing incentives.

  • At the hub Code Test: Code Test and Code Test.
  • At state Code Test: Code Test and Code Test.
  • At state Code Test: Code Test and Code Test.
  • At state Code Test: Code Test and Code Test.
  • At state Code Test: Code Test and Code Test.

At the hub, both routing modes earn the same moderate reward. At primary destinations, the matching routing mode earns more: left-bias at Code Test earns 0.5 versus 0.2 for right-bias, and vice versa at Code Test. At secondary destinations, the advantage is extreme: left-bias at Code Test earns 1.2 versus 0.1 for right-bias. This encodes the domain logic: the high-value service at Code Test is designed for left-routed traffic, and the service at Code Test is designed for right-routed traffic. Routing mismatches earn little.

The reward asymmetry between branches creates competing incentives. If traffic concentrates at Code Test and Code Test, the left-bias rewards dominate and the gradient pushes Code Test negative. If traffic concentrates at Code Test and Code Test, the right-bias rewards dominate and the gradient pushes Code Test positive. At the hub, the rewards are balanced and do not favor either direction.

Parameters. Temperature Code Test, critic regularization Code Test, actor box radius Code Test.

11.3 The Generator Family: Network Topology as Generator Structure

We construct two action-conditioned generators from the network’s adjacency graph, following the method of Chapter 9.4.

Left-bias generator Code Test: Under left-bias routing, traffic flows preferentially from the hub toward Code Test and from Code Test toward Code Test. Return rates to the hub are maintained at moderate levels. The right branch has reduced forward rates.

Code Test

The rows are indexed by Code Test. The columns are indexed in the same order. Reading the entries:

  • Hub Code Test: Exits at total rate 1.6. Transitions to Code Test at rate 1.2 (fast, left-biased) and to Code Test at rate 0.4 (slow).
  • Primary Code Test: Returns to hub at rate 0.4, advances to Code Test at rate 0.6.
  • Primary Code Test: Returns to hub at rate 0.6 (faster return from non-preferred branch), advances to Code Test at rate 0.2 (slow forward under left-bias).
  • Secondary Code Test: Returns to Code Test at rate 0.8. High-value destination with significant residence time.
  • Secondary Code Test: Returns to Code Test at rate 0.6. Lower residence time at the non-preferred secondary.

Right-bias generator Code Test: Under right-bias routing, the pattern reverses: traffic flows toward Code Test and Code Test.

Code Test

The entries are the left-right mirror of Code Test: the Code Test rate is now 1.2 (fast), Code Test is 0.4 (slow), and the B-branch forward rates are high while the A-branch forward rates are low.

Verification of the generator property. Both matrices have nonnegative off-diagonal entries and rows that sum to zero (check each row). The softmax mixture

Code Test

is formed state by state. Because the features are state-independent, the softmax weights Code Test and Code Test are the same at every state. Therefore

Code Test

a global convex combination. The mixture inherits the generator property and is smooth in Code Test.

Hub reachability. The hub Code Test is reachable from every state in at most two steps:

  • From Code Test: direct, Code Test at rate Code Test.
  • From Code Test: direct, Code Test at rate Code Test.
  • From Code Test: two steps, Code Test at rates Code Test and Code Test.
  • From Code Test: two steps, Code Test at rates Code Test and Code Test.

All lower bounds are independent of Code Test because the softmax assigns positive weight to both actions and both generators have positive return rates to the hub. This establishes the reference-state reachability condition.

11.4 Reference-State Minorization and the Bridge Theorem

The reference-state structure identified in Section 11.3 feeds the Chapter 6 minorization criterion, but with one structural caveat. Proposition 6.6 (Chapter 6, Section 6.5) postulates a uniform lower bound on the direct one-step jump rate Code Test for every Code Test. In our hub-and-spoke generators Code Test and Code Test, the secondary destinations Code Test and Code Test have Code Test and reach the hub only via the primary nodes, so the literal Proposition 6.6 hypothesis fails. A two-step version of the minorization condition does hold: the propagator Code Test at a fixed time Code Test–rather than the infinitesimal generator–has every column dominating a uniform multiple of Code Test. Chapter 10 met the same obstruction on the Y-graph–its deep-engagement states reach the diverse root only through the niche-discovery states–and resolved it with the two-step minorization of Section 10.4 (“Reference-state structure”). We state and prove the analogous lemma here with this chain’s constants, then explain why the same Dobrushin decomposition that drives Proposition 6.6 carries the same downstream conclusions.

Lemma 11.1 (Two-step reference-state minorization). There exist constants T_{\min} > 0$ and \alpha_2 > 0$ such that for every \theta \in [-1,1]$ and every i \in \{H, A, B, C, D\}$,

Code Test

Proof. For states with a direct edge to the hub, Proposition 6.6’s one-step argument applies with the rate lower bound

Code Test

For Code Test itself, mass leaves only at total rate Code Test (read off the Code Test entry, which is Code Test in both Code Test and Code Test), so by Gronwall Code Test for all Code Test.

For states Code Test and Code Test, the chain reaches the hub only by first jumping to a primary node. The relevant rate is

Code Test

Set Code Test (the time scale for the Code Test or Code Test step) and Code Test (for the Code Test or Code Test step), so Code Test.

By the same integrating-factor argument used in Proposition 6.6’s proof, the Code Test-component of the propagator started at Code Test, evaluated at Code Test, satisfies

Code Test

where Code Test is the global maximum exit rate. (Proposition 6.6’s integrating-factor argument gives the bound Code Test at time Code Test; we record the weaker form obtained from Code Test with Code Test.) Numerically, Code Test.

Once mass has reached Code Test, apply Proposition 6.6’s one-step argument from Code Test to Code Test with rate at least Code Test and propagator running for an additional Code Test. The mass at Code Test at time Code Test, starting from Code Test, is at least the product

Code Test

The same bound applies to the path Code Test by the L-R symmetry of the rate lower bounds. For the directly connected states Code Test and for Code Test itself, the same integrating-factor estimate at time Code Test yields a lower bound of similar order. Taking Code Test as the minimum over all five starting states gives a uniform constant; the bound from Code Test and Code Test is the binding one, so we record Code Test. Code Test

The two-step minorization furnishes exactly what Proposition 6.6’s Dobrushin argument needs: a column-domination bound on a fixed-time propagator Code Test, uniform in Code Test. The proof of Proposition 6.6 (Chapter 6, Section 6.5) decomposes Code Test with Code Test column-stochastic–we write Code Test for the remainder matrix of that proof, keeping Code Test for the actor box radius–then iterates on the zero-mass subspace Code Test. The same decomposition with Code Test replaced by Code Test delivers uniform exponential mixing.

Proposition 11.2 (Mixing and Lipschitz invariant law). Under Lemma 11.1, the frozen chain mixes uniformly exponentially: there exist C_{\mathrm{mix}}, \gamma > 0$ independent of \theta$ such that

Code Test

where \mathcal Z$ is the zero-mass subspace. Consequently, for each \theta \in [-1,1]$ the generator Q_\theta$ has a unique invariant law \mu_\theta \in \Delta_5$, and the map \theta \mapsto \mu_\theta$ is Lipschitz with constant L_\mu \leq L_Q \cdot C_{\mathrm{mix}}/\gamma$, where L_Q = \sup_\theta \|dQ_\theta^*/d\theta\|_{1\to 1}$ is the Lipschitz constant of the adjoint generator in the operator norm induced by the \ell^1$ norm on laws, as in Assumption 2.8.

Proof sketch. Apply the Dobrushin decomposition of Proposition 6.6 to Code Test using the column-domination bound from Lemma 11.1. The argument is the same as that of Proposition 6.6 with Code Test replaced by Code Test and Code Test by Code Test, and yields

Code Test

The Lipschitz consequence for Code Test follows by differentiating the stationary equation Code Test along Code Test and using the spectral-gap inverse from Code Test; see Chapter 6, Theorem 6.4. Code Test

The propagation chain with explicit numbers. Lemma 11.1 gives Code Test and Code Test. Hence

Code Test

The Lipschitz constant Code Test of Code Test is bounded, using Code Test, by

Code Test

with Code Test and Code Test (the adjoint acts on laws, so the relevant norm is the maximum row-sum of Code Test, attained at row Code Test), giving Code Test. Hence

Code Test

These constants are not sharp–the column-domination bound from a two-step path through a slow link is intentionally pessimistic–but they are explicit. The propagation chain runs from the minorization pair Code Test to the exponential mixing rate Code Test, then to the Lipschitz constant Code Test, and finally into the singular-limit tracking estimate of Theorem 7.3 with all constants in place.

Pathwise contraction and tracking. Proposition 7.6 of Chapter 7 is the pathwise (non-autonomous) analogue of Proposition 6.6 and again requires a direct one-step jump rate to the reference state. The same two-step modification applies: replacing the one-block bound Code Test of Proposition 7.6 by the two-step bound Code Test of Lemma 11.1 gives the pathwise contraction estimate with constants Code Test above. This is legitimate because Lemma 11.1’s proof uses only jump-rate bounds that hold for every Code TestCode Test, Code Test, exit rates at most Code Test–so each Gronwall and integrating-factor step, and the Chapman—Kolmogorov factorization, apply verbatim to the evolution family generated along any measurable actor path Code Test; the two-step column-domination bound therefore holds pathwise with the same pair Code Test. Pathwise contraction in turn lets Theorem 7.3 deliver the finite-time tracking estimate and Corollary 7.5 the upper-semicontinuity of attractors as Code Test.

11.5 The Full Routing System and Its Equilibria

Phase space. The system lives on Code Test, with dimension Code Test. Compactness of the long-time dynamics is derived, not assumed: the Chapter 4 estimates construct the compact absorbing set, and the exact-system theorem of Chapter 7, Section 7.1 turns it into the global attractor for the generator-law model. The forcing bound is Code Test, so with Code Test the Chapter 4 radius Code Test gives the compact forward-invariant absorbing set Code Test, which is what Corollary 11.4’s invocation of the Chapter 7 exact-system theorem uses. (This model’s constant coercivity gives a sharper ball: Code Test and Code Test yield Code Test whenever Code Test, so Code Test is already forward invariant and absorbing. We keep the framework radius Code Test so the constants match the general construction.)

Occupancy and critic coefficients. Because the features are state-independent with Code Test, Code Test, the score function reduces to Code Test, with centered-feature average Code Test, where Code Test and Code Test are state-independent. Therefore

Code Test

using Code Test in the final equalities. The sanity check Code Test holds as required. The formulas match the analogous Chapter 0 expression (Section 0.8), with the sign convention reversed because here the right-bias action carries the positive feature.

The critic matrix simplifies to

Code Test

which is constant–a consequence of the state-independent features with Code Test for all Code Test. The critic equation is

Code Test

where Code Test. The critic equilibrium at fixed Code Test is Code Test.

Actor drift. The raw drift is

Code Test

Substituting the score formulas Code Test and Code Test, and using state-independence of Code Test and Code Test, the action sum at each state collapses:

Code Test

where the cross terms Code Test and Code Test factor as Code Test times the difference of the bracketed expressions. Summing over states gives the closed form

Code Test

since Code Test at every state. With Code Test and Code Test, the drift simplifies further:

Code Test

This matches the Section 2.8 routing drift Code Test term for term: a population-weighted reward differential, a critic term Code Test from the Code Test critic features, and the entropy pull Code Test. Chapter 0’s Code Test shows the same structure one model earlier, with two differences: its reward differential is the constant Code Test, and its critic term is Code Test rather than Code Test because the Chapter 0 critic features take values in Code Test rather than Code Test. The damped drift is Code Test.

The full system:

Code Test Code Test Code Test

Equilibria. Three classes of equilibria have domain meaning.

Left-spoke equilibrium (\theta = -1$). The policy strongly favors left-bias. Traffic flows through the hub to Code Test and then to Code Test, where the high-value left-routing service earns reward 1.2. The frozen invariant law Code Test concentrates mass on the Code TestCode Test branch. The hub retains some mass (it is the entry point), but the right branch is underutilized.

Right-spoke equilibrium (\theta = +1$). By the reward symmetry, the mirror configuration: traffic concentrates on Code TestCode Test, and the high-value right-routing service earns the dominant reward.

Interior equilibrium. On the reduced manifold (with Code Test and Code Test), the closed form Code Test makes the sign-of-advantage argument direct. The reduced advantage is

Code Test

with the bracket function

Code Test

The reward table is invariant under the involution Code Test: Code Test, Code Test, Code Test, Code Test, Code Test. The generators satisfy the matching mirror identity Code Test under the same state permutation. Combined with Code Test, the frozen invariant law obeys Code Test, where Code Test is the mirror map Code Test, Code Test, Code Test fixed (we reserve Code Test for the sigmoid). Each summand of Code Test is therefore odd in Code Test:

Code Test

So Code Test. Continuity of Code Test on Code Test together with oddness forces Code Test, giving an interior zero at Code Test. The prefactor Code Test is nonzero, hence Code Test; the damping factor Code Test equals Code Test at Code Test and does not vanish, so the full reduced drift vanishes at Code Test.

Proposition 11.3. The hub-and-spoke routing system has at least three equilibria: two boundary equilibria at \theta = \pm 1$ and one interior equilibrium at \theta = 0$.

Proof. The boundary equilibria exist because Code Test, and the critic and distribution equations have unique fixed points at frozen Code Test by constant coercivity Code Test together with the uniform exponential mixing of Proposition 11.2. For the interior equilibrium, the bracket function Code Test defined above is odd in Code Test by the L-R reward and generator symmetry, so Code Test; since the prefactor Code Test is strictly positive, this gives Code Test. The critic and distribution components again have unique fixed points at Code Test, with Code Test by the same odd-symmetry argument and Code Test the unique invariant law of Code Test. Hence Code Test is the interior equilibrium. Code Test

Remark. The L-R reward symmetry forces the interior equilibrium to be at Code Test exactly. Asymmetric reward tables would shift the interior zero away from the origin and would generally require an explicit intermediate-value-theorem argument (sign of Code Test at Code Test versus Code Test). The reward sweep in Exercise 11.7 scales Code Test and Code Test together, which preserves the symmetry; the interior zero stays pinned at Code Test throughout the sweep.

Corollary 11.4. The hub-and-spoke routing system has a compact global attractor \mathcal{A}$ containing all three equilibria.

Proof. The model data satisfy Assumption 2.7 and the generator regularity assumption 2.8. The law equation is in generator form, so the prescribed-closure attractor theorem of Chapter 5 is not the theorem being invoked directly. Instead, apply the exact-system theorem of Chapter 7, Section 7.1 with Code Test. It gives a continuous semiflow on Code Test, the compact absorbing set Code Test, and the unique compact global attractor Code Test. Equilibria are invariant, hence contained in Code Test. Code Test

11.6 Attractor Structure and Routing Policy Design

Scope of this section. The theorems proved in Sections 11.4—11.5 give: (i) existence of at least three equilibria (Code Test, per Proposition 11.3); (ii) existence of a compact global attractor that contains all three (Corollary 11.4); (iii) a Lipschitz frozen-law map Code Test and a singular-limit tracking estimate as Code Test (Proposition 11.2 and Theorem 7.3). The stability type of the equilibria and the basin structure are not proved in these notes. For those questions we report numerical computations, marked as such, and the design discussion at the end of the section rests on the numerical regime picture.

Balanced operation (numerical). At the interior equilibrium Code Test, the routing policy is symmetric: Code Test, so traffic is sent to both branches with equal preference. The frozen invariant law Code Test is the unique solution of Code Test on the simplex; solving the linear system numerically (Exercise 11.1 carries out the computation) gives

Code Test

By the L-R symmetry of Code Test the law is exactly mirror-symmetric across the two branches, and the operational reading is balance rather than hub dominance: the hub holds about 17% of the traffic–less than either primary node–while the branches split the remainder equally and the high-value services at Code Test and Code Test both run at moderate utilization. No branch is starved.

Spoke lock-in (numerical). At the boundary equilibria Code Test, the routing policy is fully committed: Code Test at Code Test and the mirror at Code Test. The frozen invariant law at Code Test, computed numerically (Exercise 11.2 carries out the computation),

Code Test

places about 67% of the traffic on the Code TestCode Test branch and only 18% on Code TestCode Test: the high-value left service runs hot while the right branch is starved. This is the routing analogue of the filter-bubble configuration in Chapter 10. The boundary equilibrium is created by parameter saturation (Code Test at Code Test), not by the vanishing of the advantage signal: Code Test is generally nonzero, but the damping factor kills the actor velocity. The gradient interpretation is that the policy is pinned at the boundary by the actor box, not chosen by the system.

Stability at baseline (numerical). Whether the lock-in configurations attract is decided by the bracket function Code Test on the reduced manifold. The closed-form drift makes the competition visible: when Code Test concentrates on the left branch, Code Test pulls Code Test toward Code Test and the critic term reinforces the pull, while the entropy term Code Test–equal to Code Test at Code Test–pulls back toward balance. Computing Code Test numerically along Code Test at the baseline rewards shows the entropy term winning everywhere:

Code Test

with a single zero at Code Test and slope Code Test. On the reduced flow every interior trajectory moves toward the balanced equilibrium, and the lock-in equilibria repel: at Code Test the reward feedback Code Test is no match for the entropy pull Code Test. The full system’s linearization agrees. Because the damping factor Code Test vanishes at the boundary, the Code Test-row of the Jacobian at Code Test has zero entries in the Code Test and Code Test columns, so its diagonal entry–Code Test at Code Test, and the same value at Code Test by the mirror symmetry–is an exact eigenvalue, positive and independent of Code Test. At the baseline parameters the network is monostable: balance attracts, lock-in repels. These are numerical statements; the sign structure of Code Test and the eigenvalue are computed, not proved.

The lock-in regime (numerical). The baseline conclusion is not the end of the design story, because the reward scale is a lever. Scale the two secondary matching rewards together, Code Test, keeping the rest of the table fixed. The scaling preserves the L-R mirror symmetry, so the interior equilibrium stays at Code Test throughout (the Remark after Proposition 11.3), and recomputing Code Test along the sweep locates two thresholds. At Code Test the slope Code Test turns positive: the balanced equilibrium loses stability, and a mirror pair of attracting interior equilibria splits off–a pitchfork bifurcation, in dynamical-systems language–and drifts outward as Code Test grows. At Code Test the boundary values Code Test and Code Test change sign: the attracting pair reaches the actor box, and beyond this value the lock-in equilibria Code Test attract while Code Test repels. The network is then bistable, and which spoke wins depends on the initial routing bias. The domain lesson is the regime story: the high-value services need only dominate the baseline reward Code Test by roughly a factor of three before self-reinforcing traffic concentration becomes the stable outcome. Both thresholds are numerical observations about this model, computed from the reduced bracket function; Appendix B records the sweep values and describes how to reproduce the corresponding phase-portrait computations.

The fast-slow reading. When network equilibration is fast (traffic redistributes quickly in response to routing changes, small Code Test), Theorem 7.3 supplies the finite-time tracking estimate and Corollary 7.5 the upper-semicontinuity of attractors as Code Test. The reduced system is two-dimensional in Code Test on the invariant-law graph and is more tractable than the full six-dimensional system. This is a proved consequence of the framework–not a numerical observation–modulo the caveat that the rate constants Code Test and Code Test of Section 11.4 are explicit but pessimistic.

Design principle (numerical). A routing operator who wants balanced utilization should keep the network on the monostable side of the regime thresholds, and the drift formula identifies which levers actually move them. The lever that matters is the secondary reward asymmetry: Code Test and Code Test are what feed Code Test once traffic concentrates on a spoke, so keeping the secondary matching rewards below the pitchfork threshold (Code Test in the baseline geometry) keeps balance attracting. A lever that does not work: raising the common hub reward Code Test leaves Code Test unchanged at every Code Test, because the hub contributes Code Test; it enters only through the critic forcing Code Test, and in our sweeps it slightly weakens the balanced equilibrium’s attraction (Code Test rises from Code Test at Code Test to Code Test at Code Test). A structural lever that does work: raising the return rates to the hub in both generators re-mixes traffic faster, weakens the dependence of Code Test on Code Test, and strengthens balance (doubling the Code Test and Code Test rates moves Code Test from Code Test to Code Test and shrinks Code Test from Code Test to Code Test). All of these are numerical observations about this model, not theorems; the framework supplies the attractor’s existence and the equilibrium count, and the thresholds come from the computations reported in Appendix B.

11.7 Summary and Bridge to Appendix B

This chapter extended the Section 2.8 three-state routing chain to a five-state hub-and-spoke network and showed that the same Model Specification Protocol that produced the recommendation model in Chapter 10 produces a structurally parallel attractor study for a routing network.

The boundary equilibria of the routing model are spoke lock-in traffic configurations rather than content-niche filter bubbles, but the mathematical mechanism is the same: self-reinforcing feedback between the policy and the population distribution creates the lock-in equilibria, and reward design decides the regime. At the baseline parameters the balanced interior configuration attracts and lock-in repels (numerically), while scaling the secondary matching rewards past a numerically located threshold makes lock-in the stable outcome.

Three domain-specific insights came from the analysis. First, the hub’s role as a reference state for minorization is structural, but the topology charges a price: removing the direct secondary-to-hub edge forces the two-step minorization of Lemma 11.1, with explicit computable constants. Second, spoke lock-in equilibria are boundary artifacts created by parameter saturation, not by incentive alignment–and whether they attract is a reward-regime question, not a topological one. Third, the fast-slow reduction gives a practical simplification: when traffic equilibrates quickly, the reduced actor-critic system on the invariant-law graph governs the routing outcome.

Appendix B records the numerical sweep data for the routing model and describes how to compute phase portraits for both the recommendation and routing models.

Exercises

Exercise 11.1 (Verify: frozen invariant law at the hub). Compute the frozen invariant law Code Test at Code Test by solving Code Test with the simplex constraint. At Code Test, the policy is balanced: Code Test, so Code Test. What fraction of traffic is at the hub? Is the distribution symmetric between the two branches? Compare with the values reported in Section 11.6.

Exercise 11.2 (Compute: left-spoke equilibrium). At Code Test:

(a) Compute the softmax weights: Code Test, Code Test.

(b) Form the mixture generator Code Test and solve for the invariant law Code Test.

(c) What fraction of traffic is at the secondary destination Code Test?

(d) Compute the critic equilibrium Code Test. Is Code Test positive or negative, and what does its sign mean in domain terms?

Exercise 11.3 (Verify: minorization constants). Compute the two-step transition probability from state Code Test to state Code Test under the mixture generator Code Test: the path Code Test with rates from Code Test. Verify that this probability is positive and compute an explicit lower bound.

Exercise 11.4 (Break: dead-end topology). Remove the edge from Code Test to Code Test in both generators: set Code Test and adjust the diagonal entries to maintain row-sum-zero. Now state Code Test is absorbing: under every policy, traffic that reaches Code Test never leaves. (Removing the edge in Code Test alone would not break anything–the softmax floor keeps the mixed rate Code Test on the actor box; check this first.)

(a) Does the hub minorization of Lemma 11.1 still hold? From which starting state does it fail?

(b) What happens to the invariant law of the mixture generator at Code Test? Compute it: where does all the mass end up?

(c) Is the bridge theorem (Chapter 6) actually broken? Check whether uniform exponential mixing (Assumption 6.2) survives with Code Test in the role of reference state, and reconcile your answer with (a): minorization at a chosen reference state is sufficient for mixing, not necessary. What is broken here is the routing model, not the theorem.

Exercise 11.5 (Connect: three-state versus five-state mixing). Compute the spectral gap of Code Test at Code Test for both the Section 2.8 three-state chain and the Chapter 11 five-state chain. Which chain mixes faster? Give a topological reason: how does the diameter of the state graph relate to the spectral gap?

Exercise 11.6 (Extend: adding a shortcut). Add a direct shortcut between Code Test and Code Test under left-bias: set Code Test (and correspondingly Code Test under right-bias), adjusting the diagonals to keep row sums zero. Reconstruct Code Test and Code Test with the new edges.

(a) How does the left-spoke equilibrium change? Does more traffic reach Code Test?

(b) Does the reference-state minorization improve? Show that Code Test now has a direct route to the hub with mixed rate Code Test, so Code Test qualifies for the one-step argument of Proposition 6.6; compare the resulting one-step constant with the two-step constant Code Test of Lemma 11.1.

Exercise 11.7 (Connect: reward design and the lock-in regime). The routing operator wants the balanced interior equilibrium to attract all initial conditions.

(a) Explain why convergence cannot hold literally from every point of the phase space as long as the boundary equilibria exist (equilibria are invariant), and why the operationally meaningful question is whether the balanced equilibrium attracts the interior.

(b) Scale the secondary matching rewards together by setting the C-left and D-right rewards equal to a common value rho, and recompute the bracket function B(theta) of Section 11.5 numerically along a grid in rho. Locate the two regime thresholds reported in Section 11.6: the pitchfork value rho about 2.58, where the derivative B’(0) changes sign, and the lock-in value rho about 3.71, where the two boundary values B(-1) and B(+1) change sign.

(c) Explain in domain terms why raising the common hub reward is not a substitute lever. The hub rewards for L and R are kept equal, so show that the hub contribution cancels in Delta r(mu) for every mu.