Effective Hamiltonians and Scale Separation
An effective Hamiltonian is a reduced generator designed to reproduce specified predictions of a more detailed quantum model within a stated regime and accuracy. It may act on a low-energy subspace, on slow degrees of freedom, in a rotating frame, or only at stroboscopic times. Its value is not that it is smaller. Its value is that the discarded physics has been encoded systematically in corrected energies, induced couplings, dressed observables, or controlled error terms.
The word “effective” is incomplete unless four questions have answers:
- What is retained? A subspace, band, manifold, slow coordinate, or set of resonant states.
- What is reproduced? Energies, transition amplitudes, scattering poles, slow dynamics, or one-period evolution.
- In which regime? Below an energy cutoff, away from resonances, for weak coupling, at high drive frequency, or over a specified time window.
- To what accuracy? An order in a dimensionless ratio, a norm estimate, a leakage probability, or a benchmark against the full model.
This chapter organizes the main constructions. Projection Methods owns exact P/Q block reduction and state reconstruction, Feshbach Projection Formalism owns the continuum and resonance extension of energy-dependent elimination, Schrieffer–Wolff Transformation owns perturbative unitary block diagonalization, Rotating-Wave Approximation owns near-resonant time averaging, and Magnus Expansion together with Floquet-Magnus Expansion owns exponential and periodic effective generators.
Folded Effective Hamiltonians owns the Q-box derivative and folded-diagram route from an energy-dependent model-space equation to one energy-independent interaction.
Adiabatic Elimination owns the dynamical slow–fast reduction, memory and derivative corrections, the detuned Λ system, and trace-preserving effective operators for decaying fast sectors.
Born–Oppenheimer Approximation as Scale Separation owns the heavy–light mass expansion, exact electronic-channel equations, potential-energy surfaces, and diagnostics for nonadiabatic failure.
Average Hamiltonian Theory owns periodic control cycles, toggling-frame interval averages, pulse-order corrections, and selective interaction engineering.
Scale separation can be spectral, dynamical, or temporal. Projection with a resolvent, unitary block diagonalization, adiabatic elimination, and time averaging answer different questions, but each must carry the retained sector, expansion parameter, transformed observables, and error window into the reduced model.
What an Effective Hamiltonian Promises
Section titled “What an Effective Hamiltonian Promises”Let be the Hilbert space of the detailed model and the retained model space. An encoding isometry
identifies reduced states with physical states. A useful effective Hamiltonian satisfies a relation of the form
for the states, observables, and times of interest. The symbol hides the entire approximation problem. It may mean equality of selected eigenvalues through order , agreement of matrix elements up to an error , or equality only at integer multiples of a drive period.
No single reduced operator is required to reproduce every property of the full theory. Common targets include:
- the low-lying spectrum and level splittings;
- transition amplitudes among a selected group of states;
- projected Green functions and resonance poles;
- slow evolution after fast transients have decayed;
- dynamics in a rotating frame near a chosen resonance;
- one-period or stroboscopic evolution in a driven system.
The target determines the construction. A Hamiltonian optimized for low-energy eigenvalues need not reproduce short-time leakage. A stroboscopic Floquet Hamiltonian does not by itself describe micromotion inside each period. An energy-dependent optical Hamiltonian can reproduce a projected scattering resolvent without being a conventional Hermitian operator with a fixed spectrum.
Reduction is not deletion
Section titled “Reduction is not deletion”Simply replacing by its upper-left block can miss the leading physics. States outside the retained space may be only virtually occupied, yet excursions through them can shift energies and mediate interactions. Effective theory keeps those consequences while avoiding explicit evolution of the remote states.
For this reason,
in general. The projected Hamiltonian is only the zeroth approximation. Corrections record how the eliminated sector reacts to the retained one.
Subspaces and Energy Scales
Section titled “Subspaces and Energy Scales”Choose orthogonal projectors
In the decomposition
the Hamiltonian has block form
with and similarly for the other blocks.
Suppose the retained states occupy an energy window separated from the unwanted states by a gap or detuning , while the off-diagonal coupling has characteristic size . The natural expansion parameter is
When , leakage amplitudes are often of order , leakage probabilities of order , and virtual energy shifts of order
These scalings explain why “unoccupied” levels can matter. Their real population is small, but the phase accumulated from virtual excursions can be measurable over long times.
Choosing the model space
Section titled “Choosing the model space”The retained space should contain every state that mixes strongly on the scale being resolved. If two levels have detuning comparable with their coupling , placing one in and one in creates a denominator of order and destroys the expansion. Both belong in the model space and should be diagonalized together.
This is the central rule of Quasi-Degenerate Perturbation Theory:
Model-space rule: treat nearby states exactly; eliminate remote states perturbatively.
The boundary of is therefore physical and resolution dependent. A two-level model can be excellent for microwave dynamics and inadequate for a faster pulse that resolves leakage levels.
Projection and Resolvent Elimination
Section titled “Projection and Resolvent Elimination”For an exact eigenstate,
write
Projection gives
Whenever the required inverse exists with the appropriate boundary condition,
Substitution yields the exact projected equation
with
The second term is a self-energy. It contains virtual propagation through . This formula is exact but nonlinear in , and singularities of the -space resolvent can invalidate a naive expansion.
For a continuum with outgoing boundary conditions, the resolvent can acquire an imaginary part. The projected operator then becomes non-Hermitian and describes shifts together with resonance widths. That is a feature of the boundary-value problem, not a loss of unitarity in the full closed theory.
The exact block reduction, Schur-complement identity, state reconstruction, and projected normalization are developed in Projection Methods. Continuum boundary conditions, resonance interpretation, and scattering applications belong to Feshbach Projection Formalism.
Perturbative Block Diagonalization
Section titled “Perturbative Block Diagonalization”An alternative is to seek a unitary transformation that decouples and to a chosen order. Let and define
The generator is chosen so that
after working through order . The effective Hamiltonian is then
Expanding the exponential produces nested commutators:
Unlike the exact resolvent form, a Schrieffer–Wolff Hamiltonian can be made energy independent and Hermitian order by order for an isolated Hermitian problem. It is especially useful when one wants a reusable low-energy operator rather than a nonlinear eigenvalue equation.
Different block-diagonalization conventions can produce different-looking Hamiltonians related by a unitary transformation inside . Their matrix entries are not individually observable. Spectra and consistently transformed matrix elements are.
Eliminating Fast Degrees of Freedom
Section titled “Eliminating Fast Degrees of Freedom”Scale separation can be dynamical rather than purely spectral. Consider slow amplitudes coupled to a fast, far-detuned amplitude :
If is the dominant frequency and changes little during a time , the fast amplitude follows approximately:
Substitution gives
This is adiabatic elimination. The correction is the same virtual second-order process seen in projector and unitary languages. What differs is the organizing assumption: a fast amplitude is slaved to slow motion.
Setting is only the first term of an expansion. Adiabatic Elimination derives the exact transient and memory kernel, local derivative corrections, validity conditions, and the open-system effective jumps. Near resonance, is no longer fast and the eliminated state must be restored.
The Born–Oppenheimer approximation is a richer version of slow–fast separation. Electronic states are solved at fixed nuclear coordinates, generating potential-energy surfaces, while derivative couplings quantify the failure of perfect separation. A level crossing or small electronic gap can make those nonadiabatic couplings large.
Detuned Three-Level Preview
Section titled “Detuned Three-Level Preview”Two long-lived states can couple through a far-detuned excited state even when that excited state remains weakly populated. Eliminating the excited amplitude generates diagonal ac Stark shifts and an off-diagonal Raman coupling with the scale
The induced coupling and light shifts arise at the same perturbative order, while the excited-state population is suppressed by a factor of order . The full convention-sensitive derivation, differential light shift, bright and dark states, and spontaneous-scattering extension belong to Adiabatic Elimination.
The same leading virtual process can be organized as degenerate perturbation theory, a resolvent excursion, Schrieffer–Wolff block diagonalization, or adiabatic elimination. Their distinctions matter in higher-order normalization, observable reconstruction, time dependence, and dissipation.
Time-Dependent Effective Hamiltonians
Section titled “Time-Dependent Effective Hamiltonians”A time-dependent problem introduces another kind of scale separation: fast oscillations can average away while slow resonant dynamics survives.
Exact frame changes come first
Section titled “Exact frame changes come first”For a unitary frame transformation ,
This formula is exact. An approximation begins only when terms in are discarded or averaged. Confusing the frame change with the approximation hides the control parameter.
Near-resonant averaging
Section titled “Near-resonant averaging”In a rotating frame, resonant terms can become slowly varying while counter-rotating terms oscillate near twice the carrier frequency. The rotating-wave approximation drops those fast terms when the coupling and detuning are small compared with the fast frequency and when the observation window does not resolve the omitted micromotion.
The leading neglected effect is often not zero. It can include the Bloch–Siegert shift, leakage, or corrections to the rotation axis. Rotating-Wave Approximation develops those conditions quantitatively.
Average and Floquet generators
Section titled “Average and Floquet generators”For general time dependence, the Magnus Expansion writes evolution as
where is built from time integrals and nested commutators. Over an interval , one may define
For a cyclic pulse sequence, Average Hamiltonian Theory first transforms the internal Hamiltonian into the control toggling frame. Its zeroth-order weighted average selects the retained interaction, while ordered commutators quantify pulse-order and finite-cycle corrections.
For periodic driving, Floquet–Magnus Expansion applies the Magnus series directly to a one-period propagator at a chosen drive phase:
The Floquet Hamiltonian controls stroboscopic evolution. A separate micromotion operator is needed inside each period. High-Frequency Expansions owns the broader inverse-frequency framework: Floquet-space block diagonalization, the phase-independent van Vleck Hamiltonian, kick-operator dressing, resonant denominators, and local many-body prethermal regimes. Its simplest expansion parameter is schematically
where is a local energy or coupling scale. Resonances and many-body heating can limit the useful time window even when early terms are small.
States and Observables Must Be Dressed
Section titled “States and Observables Must Be Dressed”An effective Hamiltonian alone is not a complete reduction. Suppose the transformed state is
If , then reconstructing the physical state requires
to the same perturbative order. An observable must be transformed consistently:
Using with the bare projected observable can give the correct energy spectrum and incorrect transition strengths. The missing terms represent the small admixture of eliminated states.
The same warning appears in other languages:
- Feshbach elimination reconstructs with the resolvent.
- Adiabatic elimination includes derivative and initial-slip corrections.
- Floquet theory requires micromotion dressing for observables away from stroboscopic times.
- Open-system elimination generally modifies both the Hamiltonian and the effective jump operators.
Validity and Error Discipline
Section titled “Validity and Error Discipline”Every reduction should report more than the formal Hamiltonian.
Control parameter
Section titled “Control parameter”Identify a dimensionless ratio such as
If several gaps or frequencies exist, the smallest relevant denominator controls the worst case.
Leakage
Section titled “Leakage”Monitor
Small leakage supports a subspace description, but it is not sufficient by itself. Virtual phase shifts can accumulate while remains small.
Spectral and dynamical errors
Section titled “Spectral and dynamical errors”An operator error can produce an evolution error that grows with time. Duhamel’s identity gives, for bounded Hermitian generators,
Thus a small energy error does not justify arbitrary evolution times. If , the naive useful time can shrink as the desired phase accuracy becomes more demanding.
Resonance checks
Section titled “Resonance checks”Inspect denominators explicitly. A drive, threshold, avoided crossing, or continuum pole can make a nominally remote sector resonant. Near such a point:
- enlarge the retained space;
- change to a resonant frame;
- retain the relevant channel exactly;
- or abandon the expansion in favor of direct numerical evolution.
Independent benchmarks
Section titled “Independent benchmarks”For a finite model, compare low-energy eigenvalues and eigenvectors with direct diagonalization. For dynamics, compare projected populations, phases, and observables over the intended time window. Vary the cutoff, expansion order, and retained space. A single matching eigenvalue is not enough.
Nonuniqueness and Matching
Section titled “Nonuniqueness and Matching”Effective Hamiltonians are not unique. If is unitary inside the retained space,
then all consistently computed predictions agree. Time-dependent frame choices, Floquet gauges, and different perturbative generators create similar representational freedom.
The reliable objects are matched observables, not isolated coefficients. A practical matching procedure is:
- choose the retained degrees of freedom and operator basis;
- identify the expansion parameter and symmetries;
- calculate selected full-model amplitudes or energies;
- choose effective coefficients so the reduced model reproduces them;
- estimate the first omitted operators and verify against new observables.
This is the quantum-mechanical precursor of effective field theory. The QFT Bridge: EFT and Effective Hamiltonians explains what changes when infinitely many modes, locality, renormalization, and power counting enter.
Method Roadmap
Section titled “Method Roadmap”| Physical separation | Natural method | Typical output | Principal warning |
|---|---|---|---|
| Chosen subspace coupled to remote states | Projection or Feshbach method | Energy-dependent self-energy | Resolvent poles and boundary conditions |
| Several model-space states need one reusable interaction | Folded effective Hamiltonian | Energy-independent model-space operator | Q-box poles, root selection, and induced many-body terms |
| Low-energy and high-energy blocks with weak mixing | Schrieffer–Wolff transformation | Hermitian energy-independent low-energy Hamiltonian | Transform states and observables |
| Slow amplitudes coupled to fast amplitudes | Adiabatic elimination | Algebraic slow-sector generator | Initial transients and derivative corrections |
| Heavy and light coordinates | Born–Oppenheimer method | Potential-energy surfaces | Small gaps and nonadiabatic couplings |
| Near-resonant and fast counter-rotating terms | Rotating-wave approximation | Slowly varying rotating-frame Hamiltonian | Bloch–Siegert shifts and strong-drive failure |
| Rapid cyclic pulse control | Average Hamiltonian theory | Toggling-frame cycle Hamiltonian | Commutator corrections and finite pulses |
| General time-ordered evolution | Magnus expansion | Single exponential generator | Convergence and long-time accumulation |
| One-period logarithm at a chosen drive phase | Floquet–Magnus expansion | Stroboscopic Hamiltonian | Branch, phase, and micromotion conventions |
| Off-resonant rapid periodic drive | High-frequency expansions | Effective Hamiltonian plus periodic kick | Resonances, asymptotic truncation, and heating |
| Weakly occupied decaying sector | Effective open-system operators | Effective Hamiltonian and jump operators | Eliminating only the Hamiltonian is incomplete |
These methods can overlap. The same three-level atom can be treated by projection, block diagonalization, or adiabatic elimination. Prefer the formulation whose assumptions and target observable are easiest to state and verify.
Applications Across Quantum Physics
Section titled “Applications Across Quantum Physics”- Elementary quantum mechanics: nearly degenerate levels, double-well doublets, spin–orbit reductions, and low-energy scattering channels.
- Atomic, molecular, and optical physics: Raman transitions, light shifts, dark-state manifolds, rotating frames, cavity-mediated interactions, and Born–Oppenheimer surfaces.
- Quantum information: qubit subspaces, leakage corrections, dispersive gates, and perturbative gadgets, together with pulse averaging.
- Quantum matter: the exact Hubbard-dimer superexchange benchmark and effective masses, many-body lattice and impurity reductions, projected bands, and high-frequency Hamiltonian engineering.
- Nuclear physics: model-space interactions, optical potentials, folded Hamiltonians, and reaction channels.
- Open quantum systems: eliminated excited states can induce both coherent shifts and dissipative jump processes.
- Quantum field theory: integrating out heavy modes produces symmetry-allowed effective operators whose coefficients are fixed by matching.
The common logic is scale aware rather than field specific: retain what the experiment resolves, encode what it does not, and carry an error estimate.
Common Mistakes
Section titled “Common Mistakes”- Calling the effective Hamiltonian without checking virtual -space corrections.
- Eliminating a state whose detuning is comparable with its coupling.
- Quoting a small coupling without dividing by the relevant gap or frequency.
- Matching eigenvalues while leaving states and observables undressed.
- Treating an energy-dependent Feshbach operator as an ordinary fixed Hermitian Hamiltonian.
- Setting a fast derivative to zero without estimating derivative and initial-transient corrections.
- Using a rotating-wave or high-frequency Hamiltonian without specifying the frame or observation times.
- Ignoring micromotion because stroboscopic evolution is accurate.
- Assuming small leakage guarantees small phase error.
- Extrapolating a finite-order Hamiltonian to arbitrarily long times.
- Comparing coefficients from two effective Hamiltonians without checking whether they are related by a unitary change of basis.
- Forgetting that open-system elimination changes dissipative operators as well as coherent dynamics.
Exercises
Section titled “Exercises”1. Derive the exact projected equation
Section titled “1. Derive the exact projected equation”Starting from the block eigenvalue equation, eliminate and derive .
Solution
The projected equations are
Rearranging the second equation gives
Assuming the required resolvent exists,
Substitution into the first equation yields
The first two rows define the effective Hamiltonian and the -space resolvent.
2. Eliminate one remote level
Section titled “2. Eliminate one remote level”Let
Take the first basis state as . Find the exact energy-dependent effective Hamiltonian and the low-energy eigenvalue through second order.
Solution
Here
Therefore
The eigenvalue equation is
or
For the root near zero, expand the denominator using :
The sign reverses if the eliminated state lies below rather than above the retained state.
3. Diagnose a Raman reduction
Section titled “3. Diagnose a Raman reduction”A three-level Λ system has Rabi frequencies and , one-photon detuning , two-photon detuning , and excited-state linewidth . State the dimensionless ratios that must be small for a coherent two-state reduction, and identify what must be added if spontaneous emission cannot be neglected.
Solution
At minimum,
Drive-envelope frequencies must also be small compared with , and the intended duration must not amplify neglected phase errors. If matters, the fast response uses the complex scale , but a non-Hermitian Hamiltonian alone is incomplete. Effective Lindblad jump operators must be retained to describe scattering and preserve trace. The canonical derivation is in Adiabatic Elimination.
4. Bound the dynamical error
Section titled “4. Bound the dynamical error”Let and be bounded Hermitian operators. Use Duhamel’s identity to show
Solution
Define
Then
Integrating from to gives the difference of the two propagators. Unitary invariance of the operator norm implies
The triangle inequality for the integral then yields the stated bound. It makes explicit why a small generator error can accumulate over long times.
5. Dress an observable
Section titled “5. Dress an observable”Let be anti-Hermitian. Expand
through first order. Under what condition is sufficient to that order?
Solution
The Baker–Campbell–Hausdorff expansion gives
Therefore
The bare projection is sufficient through first order only if
This can occur because of symmetry or block structure, but it should be checked rather than assumed.
6. Choose the retained space
Section titled “6. Choose the retained space”Three unperturbed levels have energies , , and , with couplings of characteristic size . Assume
Which levels belong in , and what is the natural perturbative parameter?
Solution
The levels at and are separated by an amount comparable with their coupling. They mix strongly and must both be retained:
The level at is remote and belongs in . Coupling to it can be expanded in
Inside , the detuning and coupling should be diagonalized together. Expanding in would be uncontrolled because that ratio is of order unity.
Cross-Links
Section titled “Cross-Links”- Projectors
- Small Parameters and Error Estimates
- Quasi-Degenerate Perturbation Theory
- Projection Methods
- Folded Effective Hamiltonians
- Adiabatic Elimination
- Feshbach Projection Formalism
- Schrieffer–Wolff Transformation
- Rotating-Wave Approximation
- Average Hamiltonian Theory
- Magnus Expansion
- Floquet–Magnus Expansion
- High-Frequency Expansions
- Effective Hamiltonians in Quantum Information
- Effective Hamiltonians in Quantum Matter
- QFT Bridge: EFT and Effective Hamiltonians
- Matrix Diagonalization
References
Section titled “References”- H. Feshbach, “Unified theory of nuclear reactions,” Annals of Physics 5, 357–390 (1958).
- H. Feshbach, “A unified theory of nuclear reactions. II,” Annals of Physics 19, 287–313 (1962).
- J. R. Schrieffer and P. A. Wolff, “Relation between the Anderson and Kondo Hamiltonians,” Physical Review 149, 491–492 (1966).
- S. Bravyi, D. P. DiVincenzo, and D. Loss, “Schrieffer–Wolff transformation for quantum many-body systems,” Annals of Physics 326, 2793–2826 (2011).
- C. Bloch, “Sur la théorie des perturbations des états liés,” Nuclear Physics 6, 329–347 (1958).
- C. Cohen-Tannoudji, J. Dupont-Roc, and G. Grynberg, Atom–Photon Interactions: Basic Processes and Applications, Wiley (1992).
- F. Reiter and A. S. Sørensen, “Effective operator formalism for open quantum systems,” Physical Review A 85, 032111 (2012).
- S. Blanes, F. Casas, J. A. Oteo, and J. Ros, “The Magnus expansion and some of its applications,” Physics Reports 470, 151–238 (2009).
- N. Goldman and J. Dalibard, “Periodically driven quantum systems: Effective Hamiltonians and engineered gauge fields,” Physical Review X 4, 031027 (2014); see also the published erratum.
- A. Eckardt and E. Anisimovas, “High-frequency approximation for periodically driven quantum systems from a Floquet-space perspective,” New Journal of Physics 17, 093039 (2015).
- S. Teufel, Adiabatic Perturbation Theory in Quantum Dynamics, Springer (2003).
- P. W. Anderson, “Antiferromagnetism. Theory of superexchange interaction,” Physical Review 79, 350–356 (1950).