Phase 33 · Lesson 06

Test Matrices Artifacts and Failure Diagnostics

≈ 2 min core reading · 99 source/companion words
Learning contract

What you should be able to do after this

  • Explain Test Matrices Artifacts and Failure Diagnostics without relying on framework buzzwords.
  • Connect the lesson to the phase outcome: Build a trustworthy GitHub Actions pipeline that verifies pull requests, creates immutable release artifacts, uses least privilege, caches safely, and controls deployment concurrency.
  • Reproduce the relevant behavior and verify it with evidence.
  • Diagnose at least one representative failure instead of guessing.
Figure 33.6 — TaskFlow boundary map
pull request
deterministic install
lint/typecheck/test/build
trusted main
immutable artifact
environment gate
deployment
This lesson belongs to Phase 33. Keep the full request/data path visible even when today's code changes only one box.
Instructor workflow: predict first → implement the smallest slice → run it → inspect evidence → break one assumption → diagnose → explain it back. Do not copy the whole code block before understanding the first failing boundary.

Test Matrices, Artifacts, and Failure Diagnostics Artifacts should help diagnose failed or expensive jobs, not become an uncontrolled data dump. Upload browser traces, coverage, release manifests, or test reports with explicit retention. Matrix jobs are useful when the same contract genuinely needs multiple environments; do not multiply cost without a compatibility requirement.

Engineer Job fails → Collect report → Upload artifact → inspects

Evidence on failure

What this changes in TaskFlow • Upload useful diagnostics

• Set retention deliberately

• Do not upload secrets or .env files

• Use matrices for real compatibility coverage

actions/upload-artifact current v7 line stores diagnostic/release files; never upload secrets.

Executable lesson studio · testing

Now turn the explanation into engineering skill.

Tests are executable behavioral contracts. Good tests protect meaningful invariants and failure cases, not implementation trivia.

By the end, you should be able to

  • Explain Test Matrices Artifacts and Failure Diagnostics in terms of concrete inputs, ownership, outputs, and evidence.
  • Implement or reproduce the smallest TaskFlow slice that demonstrates this testing concept.
  • Diagnose one representative testing failure using observable evidence instead of trial-and-error.
Figure 33.6B — Mental model
behavior contract
arrange
act
assert
regression signal
Read left-to-right while implementing. When debugging, walk right-to-left until the first observed fact differs from your prediction.
Code-along sequence

One coherent change at a time

  1. 01

    Restate the goal of “Test Matrices Artifacts and Failure Diagnostics” as one observable behavior. Write the success signal before touching code.

  2. 02

    Trace the boundary map: behavior contract → arrange → act → assert → regression signal. Mark the one boundary this lesson changes.

  3. 03

    Inspect the current repository state and record the exact files, route, table, or runtime involved. Avoid creating an abstraction before you can name the existing owner.

  4. 04

    Implement the smallest vertical slice. Add one coherent change, run the narrowest verification command, and read the output before continuing.

  5. 05

    Connect the slice to TaskFlow’s phase artifact: .github/workflows/ci.yml plus release/deploy workflows that build once, tag by commit SHA, and gate promotion.. Verify behavior from the outside as a user or API client would.

  6. 06

    Create one controlled failure that is safe to reproduce. Predict the symptom first, capture evidence, locate the earliest broken boundary, then fix only that cause.

  7. 07

    Close the reference and rebuild or explain the core change from memory. Record what you would monitor or test before trusting the same change in production.

tsAssert behavior that matters to the user/domain
it("rejects deleting another member's task", async () => {
  const response = await asUser(bob).delete(`/tasks/${aliceTask.id}`);
  expect(response.status).toBe(403);
  expect(await taskStillExists(aliceTask.id)).toBe(true);
});

Do not copy this as a finished answer. Predict what each boundary does, type the smallest useful slice, run it, then compare the result with your prediction.

Verification

Prove the happy path

  1. Run the narrowest relevant command or request and require a clean exit/status.
  2. Inspect the boundary-specific evidence: terminal output, Network panel, database row/query plan, test report, container health, or deployment logs.
  3. Repeat the behavior once after the change so a one-off cached or stale result cannot masquerade as success.
Break it on purpose

Build debugging memory

  1. Broad write permissions for all jobs
  2. Change one assumption in the testing example—identity, input, configuration, ordering, connectivity, or state—and predict the exact symptom before running it.
SymptomInvestigation path
Test passes alone but fails in suite

Look for shared database state, timers, globals, unordered execution, or missing cleanup before adding retries.

Mock-heavy test gives false confidence

Move the highest-risk boundary to an integration test with the real adapter/database.

Closed-reference challenge

Can you transfer the idea?

Without copying the final source, create a second small scenario that applies “Test Matrices Artifacts and Failure Diagnostics” to a different TaskFlow resource or input. Write the acceptance criteria first, implement it, and provide the evidence that each criterion is satisfied.

Explain-back

Answer these without reopening the solution

  1. What problem does Test Matrices Artifacts and Failure Diagnostics solve in TaskFlow, and what would be observably wrong without it?
  2. Which part of the testing boundary owns the decision, and which neighboring layer must not own it?
  3. What evidence proves the happy path instead of merely suggesting it worked?
  4. Name one realistic failure or abuse case and the first place you would inspect.
  5. If requirements doubled tomorrow, which part of this design should stay stable and which part is allowed to change?
Lesson studio

Turn the reading into skill

01

Do it

Add environment protection/permissions for deployment and ensure stale production runs are not silently canceled mid-release.

Use the smallest change that demonstrates this lesson. Stop after it works and capture evidence.
02

Break it safely

Broad write permissions for all jobs

Predict the symptom before causing the failure. Then locate the earliest boundary where reality diverges from expectation.
03

Explain it back

Why does this responsibility live here, what input does it trust, what output proves success, and what would go wrong if another layer owned it?

If your explanation is vague, repeat the boundary trace before moving on.
Exit ticket

Before marking complete

Close the reference. Reproduce the core idea from memory or explain the exact request/data flow aloud. Then check your diff or notes for accidental shortcuts that bypass validation, authorization, error handling, or verification earned in earlier phases.