You can follow the thought.
Names and small functions explain the job. Sensor rules, evidence retrieval, and answer assembly have distinct responsibilities.
See the service boundaries ↗
Experiment 04 / Quality assurance
A convincing answer can still be wrong. Give our tiny system an inspection, sneak in a bug, and watch the checks catch it.
The slightly suspicious build
The same sensor rules, vision filtering, and backend pipeline used across this playground.
Ten checks. No results yet. Let’s see what this thing is made of.
Fixed test fixtures. Your saved readings stay untouched.
The broken build strips citations from the answer service. Restore them, then run the same checks again.
Select a check to see what it expects, then run the suite to collect evidence.
No green lights on credit. Results come from comparisons against the running simulation.
Captured during this check. An expected backend error can be evidence of a passing test.
This small suite runs in a browser worker. Its gate is a teaching demo, not this site’s CI or a production release decision. Passing these checks does not prove every behavior is correct.
What good looks like / code
Green tests are evidence, not a trophy. These are the habits this tiny system is trying to demonstrate.
Names and small functions explain the job. Sensor rules, evidence retrieval, and answer assembly have distinct responsibilities.
See the service boundaries ↗A request captures one state snapshot. Later slider changes cannot silently rewrite the answer’s evidence.
Inspect “No moving the goalposts” ↑Validate inputs. Keep offline readings marked last known. Stop when retrieval fails instead of manufacturing a plausible answer.
Inspect the failure checks ↑The expected source comes from the contract, independently of the answer. That is why removing citations makes the check fail.
Try the broken build ↑Stopping a run terminates its worker. Late messages cannot overwrite a newer result. An unfinished suite gets no passing gate.
Run, then stop ↑Keep rules visible and responsibilities small. A fix should address a concrete failure while the other checks keep their meaning.
Start with a clear definition ↗This demo’s ten checks cover a narrow slice. A production system also needs reviews, security and access checks, performance work, and feedback from the people using it.
Iteration / close the loop
The answer sounded reasonable, but QA found no source citation.
Our product contract requires evidence. Keep that requirement; fix answer assembly.
Switch back to the healthy build. Run the same checks. Then ask what important behavior still needs a test.
Green lights need a reason
Give each check a known temperature, scene, or question. A test should not depend on whoever touched the sliders last.
Run the shared simulation code. Backend checks capture service output; the deliberately broken build removes citations inside answer assembly.
Expected and actual values must agree. A refusal can pass. A polished answer without required evidence can fail.