Get Started Free

Mars Climate Orbiter & Hubble Mirror Flaw: Testing Rigor That Works (Part V)

By
November 2, 2025

In our series on declining engineering rigor, we’re exploring how a “culture of convenience” and a failure to question assumptions can lead to catastrophe. Few places demonstrate the stakes of this problem and the solution better than space exploration. Two of NASA’s most famous missions, one a tragic loss and the other a near-total failure, serve as the ultimate case studies in the cost of unverified assumptions.

A Moment Under Pressure

The navigation room at JPL is too bright for 2 a.m. The plots on the wall look clean until one thin line begins to drift. It’s September 23, 1999, the morning of Mars Climate Orbiter’s insertion into Mars orbit. Radio lag forces everyone to live in the past by minutes, but the math is here now, and it is uncompromising. A flight dynamics engineer squints, then stands. The last delta-V estimates aren’t matching the expected corridor. If their altitude is off by tens of kilometers, Mars won’t be an orbiter; it will be a shred of metal and insulation.

The probe is not only a weather scout. It’s also a communications relay for the soon-to-arrive lander. One spacecraft means two missions’ worth of dependency. The board room number is the one no one wants to say out loud: $327.6 million in project cost on the line, with no pause button to press.

In a different decade and a different room, in Perkin-Elmer’s optical lab in the late 1980s, a technician slides a gleaming assembly called a null corrector into position. It’s the master template that tells a polishing machine when a meter-class mirror is “perfect.” The device says the mirror is flawless. Later, Hubble’s first images say otherwise: stars blur into doughnuts. Somewhere, the calibrator that certifies perfection wasn’t perfect at all.

Two scenes, one question the teams can’t dodge: What if the interface lies and the instrument that verifies it lies, too?

The Root Cause: Three Systemic Patterns of Failure

Pattern 1: Interface ambiguity masquerading as speed.

At JPL, the trajectory errors trace back to a banal villain: units. A ground-side program produced impulse data in pound-seconds, while the navigation software expected newton-seconds. Numbers flowed, tests ran, doors opened, and the mismatch slipped through reviews as “nominal.” It wasn’t. The orbiter arrived too low and was lost during orbit insertion.

Pattern 2: Calibration theater—believing the jig over physics.

Hubble’s mirror flaw wasn’t a rough job; it was precisely wrong. The null corrector’s lens spacing was off by about 1.3 mm, so the polishing machine drove the primary to the wrong figure with exquisite consistency. The error at the edge? About 2.2 microns thinner than a flake of paint, enough to wreck contrast. Contradictory benches warned of trouble but were discounted because the “gold-standard” jig said all was well.

Pattern 3: Siloed reviews—disciplines talk past each other.

The MCO board found gaps in end-to-end interface control and verification; no single review stitched the assumptions across software, operations, and navigation into one chain of custody. On Hubble, optical metrology and QA did not force a second, independent path to “yes.” Both programs were busy, both were professional, and both normalized a fragile shortcut.

$800 Million: The Financial Price of Avoidable Mistakes

Space makes errors cinematic. Business makes them recurring.

  • Direct loss: The MCO project’s $327.6M vanished in minutes (development, launch, and ops) along with its planned relay role. That is over a quarter-billion-dollar accounting entry tied to avoidable verification debt.
  • Repair as tax on shortcuts: Restoring Hubble’s vision required an 11-day shuttle mission with a record five EVAs and specialized optics (COSTAR, a new camera). Contemporary histories peg the repair scale at roughly $500M, excluding the enormous opportunity cost of three years of degraded science.

Translate that to an executive scoreboard: margin volatility from defects, cash burn from rework and field campaigns, risk from reputation loss. Whether it’s a telescope or a turbine line, a bad interface or a mis-calibrated jig shows up as change failure rate ↑, FPY ↓, iteration velocity ↓, and a creeping culture of firefighting.

The Fix: A New Standard for Engineering Control

The counterfactual isn’t complicated:

  • Make interface contracts, not comments. Units, coordinate frames, ranges, and tolerances are live contracts enforced at build and run time. If data crosses a boundary, the contract travels with it. MCO’s “pound-seconds vs. newton-seconds” becomes impossible to hide because the boundary asserts, logs, and fails loudly.
  • Calibrate the calibrator. Every critical test device (null corrector, load cell, simulator) requires a second-source verification; a different physics path with the autonomy to disagree. Hubble’s jig would have been caught if the independent path had non-negotiable authority.
  • Independent V&V is a management control, not a luxury. After MCO/MPL, NASA formalized Independent Verification & Validation (IV&V) as a risk control, a separate line of sight to mission-ending mistakes. On Earth, that translates to an independent team and tooling that interrogate models, tests, and telemetry; not to slow you down, but to stabilize you.

One before/after KPI callout:

  • Before: Interface failures detected in flight/test; change failure rate 12–20%, time-to-root-cause weeks.
  • After: Boundary contracts + second-source calibration + IV&V; change failure rate 5–8%, time-to-root-cause hours–days.

And when rigor compounds, you get a Hubble-in-reverse: JWST’s alignment hit milestones cleanly; teams declared optics “working successfully,” then delivered first-light images on schedule.

The 4-Point Playbook for Independent Verification

1) Contract → Turn assumptions into executable checks

  • What changes: Every cross-team interface (software ↔ hardware, lab ↔ ops) carries machine-readable units/ranges and rejects mismatches.
  • KPI moved: Time-to-root-cause ↓, change failure rate ↓.
  • Micro-example: A propulsion API refuses “lbf·s” where “N·s” is bound; the call fails with a clear traceback (and a log you can audit).

2) Cross-examine → Calibrate the calibrator

  • What changes: Critical jigs and simulators must pass an orthogonal verification (different method, different team).
  • KPI moved: FPY (First Pass Yield) ↑, scrap/rework ↓.
  • Micro-example: A reflective null corrector is checked against an inverse optical setup; a 1.3 mm spacing drift trips a stop-ship.

3) Red-team the model → Independent V&V with veto power

  • What changes: A standalone IV&V cadence challenges requirements, test coverage, and telemetry health—and can block release.
  • KPI moved: iteration velocity ↑ (fewer rollbacks), defects escaping to system test ↓.
  • Micro-example: The IV&V team seeds unit-mismatch faults in end-to-end sims; any acceptance plan that can’t detect them is rejected.

4) Wire physics to ops → Telemetry that screams, not whispers

  • What changes: “Saturation/limit” counters and health channels expose drift early (e.g., unexpected trim burns, thermal margin creep).
  • KPI moved: time-to-detect ↓, unplanned downtime ↓.
  • Micro-example: Navigation dashboards flag thruster trim trending 10× nominal, the MCO “early smoke” most teams rationalize away.

Case Study: Stabilizing the System, Quarter-by-Quarter

A European satellite builder noticed a pattern: late-stage vibration tests kept failing “mysteriously.” Systems blamed structures; structures blamed payload; payload blamed a “quirky” shaker. The COO greenlit a two-week intervention:

  1. Interface contracts were added to every data handoff (units, frames, tolerances).
  2. The shaker’s calibration was re-verified with an independent optical method.
  3. An IV&V mini-team red-teamed the test scripts and telemetry.

The second-source check found a drifted accelerometer inside the shaker table, just enough to under-report peaks and push teams into false fixes. The interface contracts caught a unit slip between two analysis tools. Tests stabilized; tempers cooled.

KPI snippet:

  • Time-to-root-cause: from 14 days → 36 hours.
  • Repeat test failures: from 3 of 5 → 0 of 6 in the next campaign.
  • Change failure rate: from 18% → 7% (quarter over quarter).

Not heroic. Just math, physics, and independence.

Your 5-Point Action Plan: What to Audit Today

  1. Name your top 5 interfaces (where units/frames/tolerances cross teams). For each, ship a machine-readable contract and a failing test if violated.
  2. List your top 3 “never wrong” jigs/simulators. Assign a different team and a different method to re-verify them this quarter. Publish the pass/fail.
  3. Stand up a lightweight IV&V cadence with the authority to block. Start with one hairy change per sprint.
  4. Add two “physics counters” to telemetry; one that catches saturation, one that catches drift. Make them loud.
  5. Pre-mortem the next launch/release. Ask, “Where could a 1.3 mm or an lbf·s slip live in our stack?” Don’t move on until someone shows you the test that would catch it.

Next in This Series…

This chapter closed out testing discipline in space, the cost of assuming versus the payoff from independent verification. Next: Part 6 moves from orbit to the freeway: are today’s autonomous driving stacks being tested with the same cross-disciplinary rigor that saved Hubble and made JWST sing?


References

[1] NASA Science — Mars Climate Orbiter. Mission purpose, loss, relay role. Updated page. (NASA Science)
[2] NASA LLIS — MCO Mishap Investigation (Phase I, PDF). Root cause: unit mismatch; verification/ICD gaps. 1999. (llis.nasa.gov)
[3] NASA Science — Hubble’s Mirror Flaw. Null-corrector spacing error; spherical aberration. explainer. (NASA Science)
[4] NASA History — HST Servicing Mission (Chapter 16). Repair scale (~$500M), record five EVAs, ~11-day mission. (NASA)
[5] NASA OIG — IV&V of Software (IG-03-011, 2003). IV&V as critical management control post-MCO/MPL. (oig.nasa.gov)
[6] NASA News — JWST Alignment Milestone (2022-03-16). “Optics working successfully” counterexample where rigor worked. (NASA)

Leave A Comment

Subscribe

Get the latest updates directly in your email

Want to learn more?

We want to hear from you. Request demo today.

Request Demo
Read also