CV Courseversity

Game Theory and Strategic Decision-Making

Introduces normal-form games, dominant strategies, and Nash equilibrium, plus cooperative bargaining and mechanism design, as the framework for reasoning about multi-agent AI systems whose payoffs depend on each other's choices.

“Two self-driving cars approach a merge point where each must decide whether to yield or push through, an ad platform runs an auction among competing bidding agents for the same slot, and a pair of reinforcement-learning agents trained adversarially against each other (as in a GAN) each try to outmaneuver the other's strategy. In every case, the best action for one agent depends on what the others do. This module gives you the mathematics of strategic interaction — payoff matrices, dominant strategies, and Nash equilibrium — that let you predict, or design, the outcome of these encounters.”

Strategic Games and Nash Equilibrium · 15 min

A game, in the formal sense the Stanford Encyclopedia of Philosophy uses, is defined by a set of players, a set of strategies available to each player, and a payoff for every player given every combination of strategies chosen; the classic way to display a two-player game with a small number of strategies is a payoff matrix, a "strategic-form" or "normal-form" representation that is well suited to simultaneous-move situations. John Nash's 1950 paper "Equilibrium Points in N-Person Games" gave the field its central solution concept: Nash defined a strategy combination as an equilibrium point precisely when it is "self-countering" — informally, when each player's strategy is a best response to the strategies the others are playing, so no single player could gain by unilaterally deviating. The Stanford Encyclopedia of Philosophy underscores that Nash equilibrium (NE) is a minimum requirement for rational play rather than a strong prediction — it can be a comparatively "weak" solution concept, since a game may have multiple Nash equilibria and NE alone provides no way to say which one rational players will actually reach.

The Prisoner's Dilemma is the canonical worked example, singled out in the Stanford Encyclopedia entry as an atypical but especially illuminating case where the logic of iterated elimination of dominated strategies yields a single, decisive prediction. Consider two players who can each Cooperate or Defect, with payoffs (Player 1, Player 2): both Cooperate → (3,3); Player 1 Cooperates while Player 2 Defects → (0,5); Player 1 Defects while Player 2 Cooperates → (5,0); both Defect → (1,1). For either player, Defect strictly dominates Cooperate: whatever the other player does, defecting yields a strictly higher payoff (5 beats 3 if the other cooperates; 1 beats 0 if the other defects), so a rational player never needs to know what the opponent will do in order to know Defect is at least as good. Because both players reason this way, (Defect, Defect) — payoff (1,1) — is the unique Nash equilibrium, even though (Cooperate, Cooperate) — payoff (3,3) — would leave both players strictly better off. This gap between individually rational play and collectively optimal outcomes is exactly why the Prisoner's Dilemma remains the field's central cautionary example, invoked whenever self-interested agents (human or artificial) undermine an outcome that cooperation would have made better for everyone.

Strategic-form games as described above suppress information about sequencing — they assume simultaneous moves — while extensive-form games represent decisions as a tree, explicitly modeling which player moves when and what they know at each point, a distinction MIT's graduate game theory course develops in depth alongside solution techniques like backward induction, which solves a sequential game by reasoning from the final moves backward to the first. Every extensive-form game can be converted into an equivalent strategic-form representation for analysis, but doing so can obscure important structure, such as which player had to commit to a move before observing the other's choice — information that matters a great deal in practice even though it disappears once the game is flattened into a payoff matrix. This strategic apparatus shows up directly in modern AI: adversarial training setups such as generative adversarial networks (GANs) pit a generator against a discriminator in a structure resembling a two-player game, multi-agent reinforcement learning studies agents that must learn strategies while other learning agents adapt around them, and auction mechanisms used in advertising platforms are themselves games whose equilibria determine bidding behavior.

Cooperative Games, Bargaining, and Mechanism Design · 15 min

Everything in Lesson 1 falls under noncooperative game theory, which analyzes individual players choosing strategies independently, even when their interests partly align. Cooperative game theory instead studies what happens when players can form binding coalitions and must decide how to split the resulting joint payoff — a bargaining problem, distinct from the noncooperative setting precisely because agreements can be enforced rather than merely proposed. MIT's graduate game theory notes devote a dedicated unit to bargaining, including techniques like iterated conditional dominance for analyzing how rational bargainers narrow down a negotiated outcome from a wide range of possible splits to a specific, predictable agreement. Bargaining problems arise naturally in multi-agent AI whenever independently optimizing agents must share a limited resource — bandwidth, compute budget, or a physical space like a shared merge lane — and need a negotiated (rather than centrally dictated) allocation rule that each agent has an incentive to actually honor.

Mechanism design inverts the usual game-theoretic question: rather than taking the rules of a game as given and predicting the equilibrium outcome, it starts from a desired social outcome and asks what game (what set of rules, payments, or incentives) would lead self-interested, strategic players to produce that outcome as their equilibrium behavior. This is the theoretical backbone of auction design — an advertising platform running a real-time auction for an ad slot is, in effect, running a mechanism intended to elicit truthful or near-truthful bids from competing bidding agents while allocating the slot efficiently to whichever bidder values it most. Badly designed mechanisms create incentives for agents to bid strategically in ways that undermine the platform's own objectives — for example, bidding below one's true value to try to pay less, which distorts the allocation away from efficiency — which is precisely the failure mode mechanism design theory is built to analyze and avoid, by working out in advance which sets of rules make honest, straightforward play each participant's own best strategy.

For AI specifically, this strategic layer of game theory matters wherever multiple autonomous, self-interested systems interact: multi-agent reinforcement learning must contend with the fact that, unlike single-agent RL, the "environment" itself is adapting as other agents learn, so equilibrium concepts from game theory — not just optimization — are needed to characterize what a "solution" even means, since there may be no fixed optimal policy to converge to when every other agent is simultaneously updating its own policy. Negotiation agents, resource-allocation systems, and adversarial robustness analysis (where an attacker probing a model for weaknesses and a defender hardening it are modeled as players in a game) all draw on the same strategic-form and equilibrium concepts developed in Lesson 1, extended by the cooperative and mechanism-design tools introduced here. This underscores why algorithmic game theory has become its own bridge discipline between computer science and economics, with dedicated conferences and journals rather than remaining a subfield of either parent discipline alone.

Practice

Payoff Matrix at a Glance

Prisoner's Dilemma Payoff Matrix Player 2: Cooperate Defect P1: Cooperate P1: Defect (3, 3) (0, 5) (5, 0) (1, 1) Nash equilibrium (orange) is worse for both than mutual cooperation (blue).

The Prisoner's Dilemma payoff matrix: mutual defection is the unique Nash equilibrium, even though mutual cooperation yields a better outcome for both players.

  • A Nash equilibrium requires only that no single player can gain by deviating alone — it says nothing about whether the outcome is good for everyone.
  • The Prisoner's Dilemma shows individually rational play can produce a collectively worse outcome than mutual cooperation would.
  • Mechanism design flips the usual question: instead of predicting a game's equilibrium, it designs the game's rules to make a desired equilibrium emerge.

Recall Practice

Equilibrium basicsClick to reveal
Two delivery-routing agents can each choose 'take the highway' or 'take side streets.' If both taking the highway is a Nash equilibrium, what does that guarantee — and what does it not guarantee?
It guarantees that neither agent can improve its own outcome by unilaterally switching to side streets given the other stays on the highway; it does not guarantee this is the best possible outcome for either agent or for both combined.
Dominant strategiesClick to reveal
In a payoff matrix, if 'Defect' gives a player a strictly higher payoff than 'Cooperate' no matter what the other player does, what is 'Defect' called?
A (strictly) dominant strategy — a strategy that is optimal regardless of the other player's choice.
Cooperative vs noncooperativeClick to reveal
Two AI agents negotiating how to split a shared compute budget can form a binding agreement on the split. Which branch of game theory studies this kind of interaction?
Cooperative game theory, specifically the bargaining problem, since the agents can form binding agreements about how to divide the joint payoff rather than choosing strategies independently.
Mechanism designClick to reveal
An ad-auction platform wants bidding agents to reveal their true value for an ad slot rather than gaming the auction. What field studies how to design the auction rules to achieve this?
Mechanism design, which works backward from the desired outcome (truthful bidding) to the game rules and incentive structure that would make truthful bidding each agent's equilibrium strategy.

Glossary

Payoff Matrix
A table displaying every player's payoff for each combination of strategies in a normal-form (strategic-form) game.
Nash Equilibrium
A strategy combination in which no player can improve their own payoff by unilaterally changing strategy, given the others' strategies.
Dominant Strategy
A strategy that yields a player their best payoff regardless of what any other player chooses.
Prisoner's Dilemma
A canonical two-player game in which mutual defection is the unique Nash equilibrium despite mutual cooperation being better for both players.
Extensive-Form Game
A representation of a game as a decision tree, explicitly modeling the order of moves and what each player knows at each point.
Mechanism Design
The design of a game's rules and incentives so that self-interested, strategic players' equilibrium behavior produces a desired outcome, as in auction design.
Practical Activity

Finding the Nash Equilibrium of a Supplied 2×2 Payoff Matrix

This is a virtual, paper-based exercise using a small supplied 2×2 payoff matrix (not a live simulation or real multi-agent system). Learners identify each player's dominant strategy if one exists, work through each player's best response to each of the other's strategies, and determine the game's Nash equilibrium or equilibria entirely by hand.

Ready to test yourself?

5 questions on this module.

Start Quiz