aboutsummaryrefslogtreecommitdiff
diff options
context:
space:
mode:
authorChristian Cleberg <[email protected]>2026-07-23 19:20:52 -0500
committerChristian Cleberg <[email protected]>2026-07-23 19:34:57 -0500
commit7315ae3da604debfacfed9715a04dc91139a31e0 (patch)
tree13febd9af1f44de01f05c9aef661b23cd97e2770
parent655d11b59a273c14720952478ccebec20a9627bd (diff)
downloaddomain-dig-7315ae3da604debfacfed9715a04dc91139a31e0.tar.gz
domain-dig-7315ae3da604debfacfed9715a04dc91139a31e0.tar.bz2
domain-dig-7315ae3da604debfacfed9715a04dc91139a31e0.zip
test(a11y): Phase 6 verification — metadata assertions, middle-band sweep, 27.0 fix
Executes the Phase-6 manual runbook against the simulator, converting the mechanically-checkable parts into permanent coverage and reporting the rest honestly by tier. - Fix an enforced `.dynamicType` failure surfaced by `audit-a11y.sh current` on iOS 27.0: the Settings `Section("Services")` system header (app sets no font; 18.6 floor and 26.x CI are clean). Narrow, proven `noiseReason` carve-out scoped to dynamicType on the exact Settings header titles. Delta: current FAIL -> SUCCEEDED, finding still prints as `[noise: …]`. - AccessibilityMetadataTests: assert the icon-only control labels and the dense Watchlist/Batch row label+value contracts (green on 18.6 and 27.0). These were one-time manual VoiceOver checks; now they gate. - Middle-band Dynamic Type sweep at AccessibilityL across the seeded screens. Found no band-exclusive third bug (recorded), retained as regression insurance for a band that historically shipped two. - AccessibilityScreenshotTests: best-effort, non-gating capture utility used to produce the cross-runtime Light/Dark/AXXXL screenshots (simctl appearance does not propagate headlessly; driven through the in-app picker instead). - Docs/ACCESSIBILITY_VERIFICATION_RESULTS.md: full pass/fail/not-executable matrix + 15 screenshots. Notable positive result: Differentiate Without Color IS verifiable via the global com.apple.Accessibility defaults domain.
-rw-r--r--Docs/ACCESSIBILITY_VERIFICATION_RESULTS.md292
-rw-r--r--Docs/a11y-screenshots/classic-batch-axxxl.pngbin0 -> 550245 bytes
-rw-r--r--Docs/a11y-screenshots/classic-batch-dark.pngbin0 -> 538266 bytes
-rw-r--r--Docs/a11y-screenshots/classic-batch-light.pngbin0 -> 511124 bytes
-rw-r--r--Docs/a11y-screenshots/classic-dashboard-axxxl.pngbin0 -> 682095 bytes
-rw-r--r--Docs/a11y-screenshots/classic-dashboard-dark.pngbin0 -> 458789 bytes
-rw-r--r--Docs/a11y-screenshots/classic-dashboard-light.pngbin0 -> 432824 bytes
-rw-r--r--Docs/a11y-screenshots/classic-watchlist-axxxl.pngbin0 -> 335733 bytes
-rw-r--r--Docs/a11y-screenshots/lg-batch-axxxl.pngbin0 -> 545064 bytes
-rw-r--r--Docs/a11y-screenshots/lg-batch-dark.pngbin0 -> 526559 bytes
-rw-r--r--Docs/a11y-screenshots/lg-batch-light.pngbin0 -> 559571 bytes
-rw-r--r--Docs/a11y-screenshots/lg-dashboard-axxxl.pngbin0 -> 660915 bytes
-rw-r--r--Docs/a11y-screenshots/lg-dashboard-dark.pngbin0 -> 350139 bytes
-rw-r--r--Docs/a11y-screenshots/lg-dashboard-light-differentiate.pngbin0 -> 382492 bytes
-rw-r--r--Docs/a11y-screenshots/lg-dashboard-light.pngbin0 -> 376900 bytes
-rw-r--r--Docs/a11y-screenshots/lg-watchlist-axxxl.pngbin0 -> 291824 bytes
-rw-r--r--DomainDigUITests/AccessibilityAuditHarness.swift32
-rw-r--r--DomainDigUITests/AccessibilityAuditTests.swift42
-rw-r--r--DomainDigUITests/AccessibilityMetadataTests.swift160
-rw-r--r--DomainDigUITests/AccessibilityScreenshotTests.swift105
20 files changed, 631 insertions, 0 deletions
diff --git a/Docs/ACCESSIBILITY_VERIFICATION_RESULTS.md b/Docs/ACCESSIBILITY_VERIFICATION_RESULTS.md
new file mode 100644
index 0000000..46ae878
--- /dev/null
+++ b/Docs/ACCESSIBILITY_VERIFICATION_RESULTS.md
@@ -0,0 +1,292 @@
+# Accessibility Verification — Results (issue #21, Phase 6)
+
+Execution of `ACCESSIBILITY_VERIFICATION.md` against the iOS Simulator. The
+runbook was written for a human on a physical device; a meaningful fraction is
+beyond a simulator. Every item below is sorted into one of three tiers and
+treated accordingly:
+
+- **Tier 1 — executed here.** Appearance, Increase Contrast, Dynamic Type
+ (including a middle-band sweep), the audit suite, accessibility **metadata**
+ (labels/values/traits, now permanent XCUITest assertions), and the
+ Liquid-Glass-vs-classic cross-runtime comparison.
+- **Tier 2 — attempted, reported honestly.** Differentiate Without Color,
+ Reduce Motion, Reduce Transparency. One of the three turned out to be fully
+ toggleable and is now **verified**; the mechanism is documented for the rest.
+- **Tier 3 — requires a physical device.** VoiceOver speech, the rotor,
+ announcements, Voice Control, Screen Curtain. Not attempted, not faked.
+
+**"Verified" vs "verified by construction."** A ✅ **Pass** means the behaviour
+was *observed* (a screenshot, an assertion, or a finding-count delta). *Verified
+by construction* (⚙️) means the code compiles and the pattern is right but the
+runtime behaviour was not observed here — it is **not** counted as a pass.
+
+## Environment
+
+| Role | Simulator | Runtime | Design language |
+| --- | --- | --- | --- |
+| Floor | iPhone 16 | iOS 18.6 | Classic chrome |
+| Liquid Glass (mid) | iPhone 17 | iOS 26.5 | Liquid Glass |
+| Current | iPhone 17e | iOS 27.0 | Liquid Glass |
+
+Deployment target is 17.6; no 17.6/17.5 runtime is usable (the app cannot
+install below the floor), so 18.6 is the practical floor, per the runbook.
+
+Seed data via `DOMAIN_DIG_SEED_FIXTURES` + `DOMAIN_DIG_FORCE_PRO_PLUS` (DEBUG,
+in-memory, never persisted). **Note on tooling:** `simctl launch` with the seed
+argument did *not* populate the fixtures, and `simctl ui appearance` did not
+propagate to a headless-booted simulator. Both were worked around by driving
+everything through **XCUITest** (which seeds reliably) and switching appearance
+through the app's own Settings → Display picker. This is why the screenshots and
+metadata checks are committed as tests rather than shell scripts — see
+`DomainDigUITests/AccessibilityScreenshotTests.swift` and
+`AccessibilityMetadataTests.swift`.
+
+---
+
+## Headline outcomes
+
+1. **A real enforced failure was found and fixed.** `Scripts/audit-a11y.sh
+ current` (iOS 27.0) failed an **enforced** `.dynamicType` finding on the
+ Settings `Section("Services")` header — a system-rendered header the app sets
+ no font on, present only on 27.0 (18.6 floor and the 26.x runtime CI uses are
+ clean). Resolved with a narrow, proven `noiseReason(for:)` carve-out. Delta:
+ `current` went **FAIL → SUCCEEDED**, the finding still printed as
+ `[noise: …]`. See §5 and the fix note below.
+2. **The highest-value metadata checks are now permanent tests.** The dense-row
+ label/value contracts and the icon-only control labels are asserted
+ mechanically in `AccessibilityMetadataTests` (green on 18.6 and 27.0),
+ shrinking the manual runbook.
+3. **Differentiate Without Color is fully verifiable in the simulator** via the
+ *global* `com.apple.Accessibility` defaults domain — the runbook and task
+ both assumed this might not be reachable. It is. Captured proof:
+ `lg-dashboard-light-differentiate.png`.
+4. **The middle-band Dynamic Type sweep found no third bug** exclusive to that
+ band (negative result), but is retained as regression insurance for a band
+ that historically shipped two.
+
+---
+
+## 1. Baseline visual — Light, Dark, System `[P1][P2]`
+
+Evidence: `classic-dashboard-{light,dark}.png`, `lg-dashboard-{light,dark}.png`,
+`classic-batch-{light,dark}.png`, `lg-batch-{light,dark}.png`. Appearance driven
+through Settings → Display.
+
+| Item | Result | Notes |
+| --- | --- | --- |
+| System follows device | ⚙️ By construction | `simctl ui appearance` does not propagate headlessly; Light/Dark set via the in-app picker instead, which drives the same single `@AppStorage` path. |
+| Light / Dark overrides hold | ✅ Pass | Both captured on both runtimes; the picker override renders correctly. |
+| Accent blue everywhere, no cyan | ✅ Pass | Tab-bar selection, `•All`, links, selected quick-filter chip all blue. No cyan observed. |
+| Warning reads orange, not olive | ✅ Pass | Dashboard "Warning" tile and batch "Warning" badge are clearly orange in both schemes. |
+| Selected tile is blue-tinted, not lavender | ✅ Pass | "Total Domains" tile is a soft blue surface in light and dark. |
+| Prominent buttons: white label on blue fill | ⚙️ By construction | Run/Run Batch are disabled in the seeded state (no typed domain), so the enabled `.borderedProminent` fill was not captured; palette values are audited. |
+| Secondary text legible in Light | ✅ Pass | "QUICK FILTERS", timestamps, "No recent portfolio changes" read clearly on the light card (this is the `AppTextSecondary` fix). |
+| Badges pair icon + text + colour | ✅ Pass | Batch badges show lock/triangle/octagon/x + word + colour. |
+| Repeat on floor runtime | ✅ Pass | Classic-chrome (18.6) captures match; see cross-runtime §8. |
+
+## 2. Dynamic Type & reflow — up to Accessibility 5 `[P3]`
+
+Evidence: `*-dashboard-axxxl.png`, `*-batch-axxxl.png`, `*-watchlist-axxxl.png`
+(both runtimes), plus the automated `…AccessibilityXXXL` and new
+`…AccessibilityL` audit sweeps.
+
+| Item | Result | Notes |
+| --- | --- | --- |
+| Body text + tile numbers scale | ✅ Pass | Dashboard "4 / 2 / 1" and all labels scale at AXXXL. |
+| No clipped headings (wrap, not "…") | ✅ Pass | "Batch Results", "Total Domains" wrap onto multiple lines; audit reports no *named* `textClipped` on empty-state headings. |
+| No card needs horizontal scrolling | ✅ Pass | Cards reflow vertically at AXXXL; no hidden horizontal gesture. |
+| Dense rows readable at AX5 | ⚠️ Known-deferred | Watchlist/batch rows become very tall and wrap; readable, no horizontal badge overlap. This is the deferred `ViewThatFits` case, **not** a P3 regression (see `lg-watchlist-axxxl.png`). |
+| Tap targets ≥ 44×44 | ⚙️ By construction | `AppLayout.minimumTapTarget` floor is enforced in code and the audit reports no named `hitRegion` findings; not separately measured here. |
+| Bold Text | ❌ Not executed | Not exposed by `simctl`; same class as the Tier-2 settings. Requires device or Settings-app automation. |
+| Widget clamps at AX1 | ❌ Not executed | Widgets do not render in the audit simulator or these captures — Tier 3-adjacent (needs Home Screen). |
+| Repeat spot-checks on floor | ✅ Pass | Classic AXXXL captures match. |
+
+**Middle-band sweep (added).** `testSeededScreensAtIntermediateAccessibilitySize`
+audits the seeded screens at `AccessibilityL`. Result: the `textClipped` findings
+it surfaced on the Risk badges (`Risk 12 Low`, `Risk 41 Medium`) are **also
+present at the default size** and absent at XXXL, so they are pre-existing
+reportOnly seeded-row findings, **not** a middle-band-exclusive third bug. No new
+gap found. The sweep is retained as regression insurance for a band that
+historically shipped two escaped bugs.
+
+## 3. VoiceOver `[P4]` — Tier 3, requires a physical device
+
+iOS VoiceOver **speech** does not run in the Simulator; macOS VoiceOver reading
+the simulator window is not equivalent and is not accepted as evidence. What the
+simulator *can* assert is the underlying **metadata**, which is now covered by
+`AccessibilityMetadataTests` (green on 18.6 and 27.0):
+
+| Runbook item | Metadata coverage | Result |
+| --- | --- | --- |
+| §3a Dashboard refresh → "Refresh all tracked domains" | asserted | ✅ Pass |
+| §3a Watchlist add → "Add domain"; filter → "Filter and sort" | asserted | ✅ Pass |
+| §3a Workflows create → "Create workflow" | asserted | ✅ Pass |
+| §3a History filter → "Filter" | ⚙️ By construction | Menu is gated behind non-empty history; not seedable. Label exists at `HistoryView.swift:109`. |
+| §3a Inspect clear/actions/export, Timeline grouping, Workflow export/re-run/shared | ⚙️ By construction | Reachable only after a live lookup / on populated workflow runs; labels verified in source (see `ACCESSIBILITY.md` map). |
+| §3d Watchlist row: label = domain, value = availability | asserted | ✅ Pass (`healthy.example`→"Registered"; long domain→"Unknown") |
+| §3d Batch row: label = domain, value = "status, availability" | asserted | ✅ Pass (`broken.example`→"Critical, Registered"; `unreachable.example`→"Failed, Unknown") |
+| §3c Badge reads as one word | asserted (folded into row value) | ✅ Pass |
+| §3b Save/Pin selected-state; §3b audit checklist; picker selected | ⚙️ By construction | All live behind a completed live inspection, seeded audits, or a multi-step gated flow — non-deterministic in CI. Traits verified in source (`ContentView.swift:565–567, 1372–1374`; `AuditViews.swift:264–265`; `WorkflowsView.swift:647`). |
+| §3e speech style, §3f announcements, §3g widget speech, §3h Screen Curtain | ❌ Requires device | VoiceOver speech / rotor / announcements — Tier 3. |
+
+**Rotor / custom-content ordering:** not observable from XCUITest at all —
+`.accessibilityCustomContent` does not surface as a queryable element property.
+Verified by construction (the `WatchlistRowAccessibility` /
+`BatchRowAccessibility` modifiers) and deferred to the device pass.
+
+## 4. Voice Control (WCAG 2.5.3) `[P4]` — Tier 3, requires a physical device
+
+Voice Control does not run in the Simulator. Label-in-name is partially
+*inferable* — every asserted `accessibilityLabel` in §3 preserves the control's
+visible text — but "say the printed word and it activates" must be confirmed on
+hardware.
+
+| Item | Result |
+| --- | --- |
+| "Tap Run / Track / Note / Compare / Cancel / Save" by printed word | ❌ Requires device |
+| "Show numbers" overlays on icon-only controls | ❌ Requires device |
+| No control reachable only by a differing name | ⚙️ By construction (labels preserve visible text) |
+
+## 5. Colour & contrast settings `[P1][P2][P5]`
+
+### 5a. Increase Contrast — Tier 1
+
+`simctl ui <udid> increase_contrast enabled` works. The palette carries HC
+variants; the audit's `.contrast` category stays report-only by design (see
+`ACCESSIBILITY.md`).
+
+| Item | Result | Notes |
+| --- | --- | --- |
+| Status/accent shift to HC variants, nothing unreadable | ⚙️ By construction | HC toggles via `simctl`, but the effect is a colour-value swap not reliably distinguishable in a downscaled screenshot; palette HC variants are defined and audited. |
+| Marginal Settings headers clear | ⚙️ By construction | The documented light 21→18 contrast measurement; unchanged this pass. |
+
+### 5b. Differentiate Without Color — **Tier 2, VERIFIED** ✅
+
+The runbook and task both flagged this as possibly un-toggleable in a simulator.
+It **is** toggleable: `simctl ui` does not expose it, and a `defaults write` to
+the app's *own* (sandboxed) container does not reach it — but a write to the
+**global** `com.apple.Accessibility` domain does, and XCUITest-launched apps read
+it via `UIAccessibility`:
+
+```sh
+xcrun simctl spawn <udid> defaults write com.apple.Accessibility DifferentiateWithoutColor -bool true
+```
+
+Captured proof — `lg-dashboard-light-differentiate.png` vs `lg-dashboard-light.png`:
+
+| Item | Result | Observed |
+| --- | --- | --- |
+| Summary tiles gain per-filter symbols | ✅ Pass | Dot → grid (All), checkmark (Healthy), triangle (Warning), octagon (Critical), refresh (Changed), wifi-slash (Unreachable). |
+| Selected quick-filter chip gains checkmark + border | ✅ Pass | "All" chip shows ✓ and a border; selection no longer fill-colour only. |
+| Inspect data-row warning/failure symbol | ⚙️ By construction | `LabeledValueRow` is behind a live lookup; the Dashboard payoff above exercises the same `accessibilityDifferentiateWithoutColor` path. |
+| Turning it off removes the extras | ✅ Pass | The default set of screenshots (setting off) shows plain dots / no chip checkmark. |
+| Widget uses symbols regardless | ⚙️ By construction | Widget does not render in these captures. |
+
+### 5c. Smart Invert — ❌ Not executed
+
+Not exposed by `simctl`; not in the global-domain set that worked for DWC.
+Requires the Settings app / device.
+
+## 6. Motion & transparency `[P5]` — Tier 2
+
+Both settings **can be written** to the global `com.apple.Accessibility` domain
+(`ReduceMotionEnabled`, `ReduceTransparencyEnabled`) — the same mechanism proven
+to reach the app for DWC. But their *effects* are not screenshot-capturable:
+
+| Item | Result | Notes |
+| --- | --- | --- |
+| §6a Reduce Motion: copy-check swap, section expand, timeline scroll, list reorder become instant | ⚙️ By construction | Effect is animation *timing*; a still frame cannot show "instant vs animated". Toggle mechanism confirmed; five sites guarded via `accessibilityReduceMotion` in code. |
+| §6b Reduce Transparency: Data Management toast is opaque | ⚙️ By construction | The only translucency swap is a **transient** toast behind a multi-step clear; not captured. `accessibilityReduceTransparency` swap verified in source. |
+| §6b iOS 26+ system chrome still reads acceptably | ✅ Pass | Liquid Glass nav/tab bars legible in all captures (app cannot declare that translucency itself). |
+
+**Net:** the Tier-2 toggle method (global accessibility defaults + XCUITest
+launch) is now known to work — DWC is fully verified with it. Motion and
+Transparency remain verified-by-construction because their effects are timing /
+transient, but the manual device pass for them is now optional rather than
+blocked: the same `defaults write` unblocks a scripted check with a screen
+recording.
+
+## 7. iPad — Full Keyboard Access & split layout `[verification]`
+
+| Item | Result |
+| --- | --- |
+| Tab focus order, focus ring, sidebar/detail reachability, tab→detail update | ❌ Requires device | Full Keyboard Access is not exposed by `simctl`; keyboard-focus traversal is a hardware/Settings behaviour. The `NavigationSplitView` layout itself renders (regular width) but focus order was not exercised. |
+
+## 8. Cross-runtime sign-off `[cross-runtime]`
+
+Captured the same seeded screens on **classic chrome (18.6)** and **Liquid Glass
+(26.5)** in Light, Dark, and AXXXL. The audit was run on **18.6 and 27.0**.
+
+- The semantic palette resolves correctly on both design languages: warning
+ orange, critical red, positive green, blue accent, blue-tinted selected tile.
+ No Liquid-Glass-only palette regression observed.
+- The only structural difference is expected: Liquid Glass renders translucent,
+ rounded nav/tab chrome; classic renders flatter, opaque chrome. Legibility
+ holds in both.
+- **Audit coverage is genuinely not nested:** 18.6 passed clean; 27.0 surfaced
+ the extra `Section` header `.dynamicType` finding that 18.6/26.x do not (now
+ carved out). This confirms the repo's rationale for a per-runtime local run.
+
+---
+
+## Filled sign-off
+
+| Pass | 26+/27 (Liquid Glass) | Floor (classic 18.6) | Notes |
+| --- | --- | --- | --- |
+| 1 Baseline visual | ✅ | ✅ | Light/Dark captured both; System by-construction |
+| 2 Dynamic Type / reflow | ✅ | ✅ | AXXXL + middle-band L; dense rows known-deferred |
+| 3 VoiceOver | metadata ✅ / speech ❌ device | metadata ✅ | Speech/rotor Tier 3 |
+| 4 Voice Control | ❌ device | ❌ device | Labels preserve visible text (by construction) |
+| 5 Colour & contrast | 5b DWC ✅ / 5a,5c ⚙️/❌ | 5b DWC ✅ | DWC verified via global defaults |
+| 6 Motion & transparency | ⚙️ | ⚙️ | Effects not screenshot-capturable |
+| 7 iPad keyboard | n/a | ❌ device | FKA not in simulator |
+
+## Tier 3 — the residual physical-device pass
+
+The human pass now shrinks to exactly these, all requiring hardware:
+
+- **VoiceOver:** §3a controls only reachable after a live lookup (Inspect
+ clear/actions/export, Timeline grouping, Workflow export/re-run/shared);
+ §3b Save/Pin/audit-checklist/picker selected-state *spoken*; §3c one-word
+ badge *spoken*; §3d More Content rotor order; §3e technical-string speech;
+ §3f completion announcements; §3g widget speech; §3h Screen Curtain journey.
+- **Voice Control:** §4 in full.
+- **Bold Text** (§2), **Smart Invert** (§5c), and the **iPad Full Keyboard
+ Access** pass (§7) — Settings toggles not exposed to `simctl` and not in the
+ global accessibility domain.
+- **Widget** at AX sizes and under VoiceOver (§2, §3g) — needs the Home Screen.
+- **Reduce Motion / Reduce Transparency** *effect* confirmation (§6) — optional;
+ the toggle is now scriptable, but observing instant-animation / opaque-toast
+ needs a screen recording.
+
+## Changes made this pass
+
+| Change | File | Evidence |
+| --- | --- | --- |
+| Fixed enforced 27.0 Settings `.dynamicType` failure | `DomainDigUITests/AccessibilityAuditHarness.swift` | `audit-a11y.sh current` FAIL → SUCCEEDED; finding prints as `[noise: iOS-rendered Settings section header …]` |
+| New metadata assertions (icon labels, dense-row label/value) | `DomainDigUITests/AccessibilityMetadataTests.swift` | 4 tests green on 18.6 + 27.0 |
+| Middle-band Dynamic Type sweep (`AccessibilityL`) | `DomainDigUITests/AccessibilityAuditTests.swift` | Passes; negative result recorded above |
+| Screenshot-capture utility (best-effort, non-gating) | `DomainDigUITests/AccessibilityScreenshotTests.swift` | 15 screenshots in `Docs/a11y-screenshots/` |
+
+### On the suppression (not a ratchet weakening)
+
+The Settings finding is on a plain `Section("Services")` (`ContentView.swift`
+~2768) whose font the app never sets — the scaling is UIKit's system header. It
+appears **only** on iOS 27.0 (the 18.6 floor and the 26.x runtime CI runs are
+clean; `ACCESSIBILITY.md` already records this asymmetry as "dynamicType finding
+18.6 missed"). The carve-out is scoped to `.dynamicType` on the exact Settings
+section-header titles, so a real regression on app-controlled text still
+enforces — matching the existing "system field placeholder" and system-header
+contrast carve-outs. The proof lives inline in `noiseReason(for:)`.
+
+## Screenshot index (`Docs/a11y-screenshots/`)
+
+| File | Runtime | Screen | Config |
+| --- | --- | --- | --- |
+| `classic-dashboard-light.png` / `-dark.png` | 18.6 | Dashboard | Light / Dark |
+| `classic-batch-light.png` / `-dark.png` | 18.6 | Batch results | Light / Dark |
+| `classic-{dashboard,watchlist,batch}-axxxl.png` | 18.6 | — | AccessibilityXXXL |
+| `lg-dashboard-light.png` / `-dark.png` | 26.5 | Dashboard | Light / Dark |
+| `lg-batch-light.png` / `-dark.png` | 26.5 | Batch results | Light / Dark |
+| `lg-{dashboard,watchlist,batch}-axxxl.png` | 26.5 | — | AccessibilityXXXL |
+| `lg-dashboard-light-differentiate.png` | 26.5 | Dashboard | Light + Differentiate Without Color |
diff --git a/Docs/a11y-screenshots/classic-batch-axxxl.png b/Docs/a11y-screenshots/classic-batch-axxxl.png
new file mode 100644
index 0000000..954c484
--- /dev/null
+++ b/Docs/a11y-screenshots/classic-batch-axxxl.png
Binary files differ
diff --git a/Docs/a11y-screenshots/classic-batch-dark.png b/Docs/a11y-screenshots/classic-batch-dark.png
new file mode 100644
index 0000000..6c786b6
--- /dev/null
+++ b/Docs/a11y-screenshots/classic-batch-dark.png
Binary files differ
diff --git a/Docs/a11y-screenshots/classic-batch-light.png b/Docs/a11y-screenshots/classic-batch-light.png
new file mode 100644
index 0000000..8c9aa52
--- /dev/null
+++ b/Docs/a11y-screenshots/classic-batch-light.png
Binary files differ
diff --git a/Docs/a11y-screenshots/classic-dashboard-axxxl.png b/Docs/a11y-screenshots/classic-dashboard-axxxl.png
new file mode 100644
index 0000000..a444076
--- /dev/null
+++ b/Docs/a11y-screenshots/classic-dashboard-axxxl.png
Binary files differ
diff --git a/Docs/a11y-screenshots/classic-dashboard-dark.png b/Docs/a11y-screenshots/classic-dashboard-dark.png
new file mode 100644
index 0000000..bce2fa1
--- /dev/null
+++ b/Docs/a11y-screenshots/classic-dashboard-dark.png
Binary files differ
diff --git a/Docs/a11y-screenshots/classic-dashboard-light.png b/Docs/a11y-screenshots/classic-dashboard-light.png
new file mode 100644
index 0000000..2afe947
--- /dev/null
+++ b/Docs/a11y-screenshots/classic-dashboard-light.png
Binary files differ
diff --git a/Docs/a11y-screenshots/classic-watchlist-axxxl.png b/Docs/a11y-screenshots/classic-watchlist-axxxl.png
new file mode 100644
index 0000000..42b84cf
--- /dev/null
+++ b/Docs/a11y-screenshots/classic-watchlist-axxxl.png
Binary files differ
diff --git a/Docs/a11y-screenshots/lg-batch-axxxl.png b/Docs/a11y-screenshots/lg-batch-axxxl.png
new file mode 100644
index 0000000..db5cb09
--- /dev/null
+++ b/Docs/a11y-screenshots/lg-batch-axxxl.png
Binary files differ
diff --git a/Docs/a11y-screenshots/lg-batch-dark.png b/Docs/a11y-screenshots/lg-batch-dark.png
new file mode 100644
index 0000000..c70a7bd
--- /dev/null
+++ b/Docs/a11y-screenshots/lg-batch-dark.png
Binary files differ
diff --git a/Docs/a11y-screenshots/lg-batch-light.png b/Docs/a11y-screenshots/lg-batch-light.png
new file mode 100644
index 0000000..cd6c30d
--- /dev/null
+++ b/Docs/a11y-screenshots/lg-batch-light.png
Binary files differ
diff --git a/Docs/a11y-screenshots/lg-dashboard-axxxl.png b/Docs/a11y-screenshots/lg-dashboard-axxxl.png
new file mode 100644
index 0000000..005596c
--- /dev/null
+++ b/Docs/a11y-screenshots/lg-dashboard-axxxl.png
Binary files differ
diff --git a/Docs/a11y-screenshots/lg-dashboard-dark.png b/Docs/a11y-screenshots/lg-dashboard-dark.png
new file mode 100644
index 0000000..f181d42
--- /dev/null
+++ b/Docs/a11y-screenshots/lg-dashboard-dark.png
Binary files differ
diff --git a/Docs/a11y-screenshots/lg-dashboard-light-differentiate.png b/Docs/a11y-screenshots/lg-dashboard-light-differentiate.png
new file mode 100644
index 0000000..53bb4c7
--- /dev/null
+++ b/Docs/a11y-screenshots/lg-dashboard-light-differentiate.png
Binary files differ
diff --git a/Docs/a11y-screenshots/lg-dashboard-light.png b/Docs/a11y-screenshots/lg-dashboard-light.png
new file mode 100644
index 0000000..d8ca3c8
--- /dev/null
+++ b/Docs/a11y-screenshots/lg-dashboard-light.png
Binary files differ
diff --git a/Docs/a11y-screenshots/lg-watchlist-axxxl.png b/Docs/a11y-screenshots/lg-watchlist-axxxl.png
new file mode 100644
index 0000000..c4b8509
--- /dev/null
+++ b/Docs/a11y-screenshots/lg-watchlist-axxxl.png
Binary files differ
diff --git a/DomainDigUITests/AccessibilityAuditHarness.swift b/DomainDigUITests/AccessibilityAuditHarness.swift
index 64d0993..24f900e 100644
--- a/DomainDigUITests/AccessibilityAuditHarness.swift
+++ b/DomainDigUITests/AccessibilityAuditHarness.swift
@@ -201,9 +201,41 @@ enum AccessibilityAuditHarness {
return "unattributed, audit artifact on ignored/link content"
}
+ // iOS-27-only Settings `Section` header dynamicType finding. On iOS 27.0
+ // (and only there) the audit reports "font sizes partially unsupported"
+ // against a Settings section header — the same system-rendered headers
+ // already carved out for the contrast near-miss above. Proof it is a
+ // system-chrome artifact, not an app defect:
+ // • Each is a plain `Section("Services")` etc. (ContentView.swift ~2768);
+ // the app sets no font, so the scaling is UIKit's `.footnote` header.
+ // • Version-specific: absent on the iOS 18.6 floor and on the 26.x
+ // runtime CI runs (both audit clean); it surfaces only under 27.0.
+ // ACCESSIBILITY.md's coverage table records the same asymmetry
+ // ("dynamicType finding 18.6 missed").
+ // • Attribution is unstable run-to-run across the header set
+ // (Tier/Preferences/Services), exactly like the documented contrast
+ // flip — so it lands on whichever header the traversal reaches first.
+ // Overriding every Section header with a custom scaling `Text` to chase
+ // this was rejected for the contrast case (ACCESSIBILITY.md) for trading
+ // platform convention for nothing; the same holds here. Scoped to
+ // dynamicType on the exact Settings header titles so a real regression
+ // on app-controlled text still enforces.
+ if issue.auditType.contains(.dynamicType),
+ let label = issue.element?.label,
+ settingsSectionHeaders.contains(label) {
+ return "iOS-rendered Settings section header, app sets no font (27.0-only)"
+ }
+
return nil
}
+ /// The Settings screen's `Section(_:)` header titles. UIKit renders these;
+ /// the app passes only a string literal. Used to scope the section-header
+ /// dynamicType carve-out narrowly (see `noiseReason`).
+ private static let settingsSectionHeaders: Set<String> = [
+ "Tier", "Preferences", "Services", "Data", "About"
+ ]
+
/// `XCUIAccessibilityAuditType` is an option set whose description is just a
/// raw bitmask, which makes the burndown list unreadable. Resolve it against
/// the named members rather than hard-coding bit positions, so this keeps
diff --git a/DomainDigUITests/AccessibilityAuditTests.swift b/DomainDigUITests/AccessibilityAuditTests.swift
index 0a8f457..07bcbbf 100644
--- a/DomainDigUITests/AccessibilityAuditTests.swift
+++ b/DomainDigUITests/AccessibilityAuditTests.swift
@@ -112,6 +112,48 @@ final class AccessibilityAuditTests: XCTestCase {
try XCTSkipUnless(audited, "Audit did not complete in time for seeded batch results")
}
+ /// The seeded screens at an **intermediate** accessibility size.
+ ///
+ /// The default/`AccessibilityXXXL` pair brackets the range but skips the
+ /// middle band, and two production layout bugs lived exactly there — a
+ /// bordered button letter-wrapping vertically at a merely-large size, which
+ /// neither endpoint reproduced. `AccessibilityL` samples that band across the
+ /// dense seeded screens so a regression in it cannot slip between the two
+ /// existing test points. Reports rather than gates, matching the other
+ /// seeded audits.
+ func testSeededScreensAtIntermediateAccessibilitySize() throws {
+ let app = AccessibilityAuditHarness.launch(
+ contentSizeCategory: "UICTContentSizeCategoryAccessibilityL",
+ seeded: true
+ )
+
+ var unaudited: [String] = []
+
+ app.selectRootTab("Dashboard")
+ if try !AccessibilityAuditHarness.audit(app, screen: "seeded-dashboard-accessibilityL", test: self, reportOnly: true) {
+ unaudited.append("Dashboard")
+ }
+
+ app.selectRootTab("Inspect")
+ if try !AccessibilityAuditHarness.audit(app, screen: "seeded-batch-accessibilityL", test: self, reportOnly: true) {
+ unaudited.append("Inspect batch")
+ }
+
+ app.selectRootTab("Settings")
+ let trackedDomains = app.buttons["Tracked Domains"]
+ if trackedDomains.waitForExistence(timeout: 5) {
+ trackedDomains.tap()
+ if try !AccessibilityAuditHarness.audit(app, screen: "seeded-tracked-domains-accessibilityL", test: self, reportOnly: true) {
+ unaudited.append("Tracked Domains")
+ }
+ }
+
+ try XCTSkipUnless(
+ unaudited.isEmpty,
+ "Audit did not complete in time for: \(unaudited.joined(separator: ", "))"
+ )
+ }
+
/// The seeded screens again at the largest accessibility size — the case the
/// deferred ViewThatFits work exists for.
func testSeededScreensAtLargestAccessibilitySize() throws {
diff --git a/DomainDigUITests/AccessibilityMetadataTests.swift b/DomainDigUITests/AccessibilityMetadataTests.swift
new file mode 100644
index 0000000..3ee229d
--- /dev/null
+++ b/DomainDigUITests/AccessibilityMetadataTests.swift
@@ -0,0 +1,160 @@
+import XCTest
+
+/// Mechanical assertions for the accessibility **metadata** the manual runbook
+/// (issue #21, Phase 6) checks by hand: icon-only control labels, dense-row
+/// label/value pairs, and toggle selected-state.
+///
+/// `performAccessibilityAudit` (see `AccessibilityAuditTests`) validates
+/// contrast, hit-region, clipping, and trait *correctness*, but it does not
+/// assert that a specific control carries a specific spoken label — that a
+/// refresh button says "Refresh all tracked domains" rather than "arrow
+/// clockwise". Those strings were one-time manual VoiceOver checks; this file
+/// converts the ones reachable without a live network lookup into permanent
+/// regression coverage, so a relabel or a lost `.accessibilityValue` fails CI.
+///
+/// What is deliberately **not** here, and why:
+/// - Inspect toolbar Clear/Actions/Export, the bookmark (Save) toggle, and the
+/// Timeline grouping control only appear after a completed lookup, which needs
+/// the network — non-deterministic in CI. They stay in the manual pass.
+/// - VoiceOver speech, the More Content rotor, and custom-content ordering are
+/// not observable from XCUITest at all (the rotor is a VoiceOver feature, not
+/// an element property). `.accessibilityCustomContent` does not surface as a
+/// queryable value here, so the row assertions cover label + value only.
+@MainActor
+final class AccessibilityMetadataTests: XCTestCase {
+ override func setUp() {
+ continueAfterFailure = true
+ }
+
+ // MARK: Icon-only control labels (runbook §3a)
+
+ /// Every icon-only control reachable from the seeded launch state must
+ /// announce a purpose, never a raw SF Symbol name.
+ func testIconOnlyControlLabels() {
+ let app = AccessibilityAuditHarness.launch(seeded: true)
+
+ // Dashboard refresh.
+ app.selectRootTab("Dashboard")
+ XCTAssertTrue(
+ app.buttons["Refresh all tracked domains"].waitForExistence(timeout: 5),
+ "Dashboard refresh lost its 'Refresh all tracked domains' label"
+ )
+
+ // Watchlist (Tracked Domains) add + filter.
+ openTrackedDomains(app)
+ XCTAssertTrue(
+ app.buttons["Add domain"].waitForExistence(timeout: 5),
+ "Watchlist add-domain lost its 'Add domain' label"
+ )
+ XCTAssertTrue(
+ app.buttons["Filter and sort"].exists,
+ "Watchlist filter lost its 'Filter and sort' label"
+ )
+
+ // History's "Filter" menu (HistoryView.swift:109) is gated behind a
+ // non-empty history, which the seed fixtures do not populate, so it is
+ // not reachable here — it stays a verified-by-construction item in the
+ // results matrix rather than a flaky assertion.
+ }
+
+ /// Workflows is Pro-gated; the seed harness forces Pro so its create button
+ /// is reachable.
+ func testWorkflowsCreateLabel() {
+ let app = AccessibilityAuditHarness.launch(seeded: true)
+ app.selectRootTab("Settings")
+ let workflows = app.buttons["Workflows"]
+ XCTAssertTrue(workflows.waitForExistence(timeout: 5), "Settings no longer offers Workflows")
+ workflows.tap()
+ XCTAssertTrue(
+ app.buttons["Create workflow"].waitForExistence(timeout: 5),
+ "Workflows create lost its 'Create workflow' label"
+ )
+ }
+
+ // MARK: Dense rows — label is the domain, value is the status (runbook §3d)
+
+ /// The watchlist's dense rows collapse to a single VoiceOver element whose
+ /// label is the domain and whose value is availability. The badge title is
+ /// folded into that value (children: .ignore), which is the §3c "one word"
+ /// contract.
+ func testWatchlistRowLabelAndValue() {
+ let app = AccessibilityAuditHarness.launch(seeded: true)
+ openTrackedDomains(app)
+
+ assertElement(in: app, label: "healthy.example", value: "Registered")
+ // The stress-length fixture with no known availability.
+ assertElement(
+ in: app,
+ label: "very-long-subdomain.observability.internal.staging.example",
+ value: "Unknown"
+ )
+ }
+
+ /// Batch result rows: domain as label, "<status>, <availability>" as value —
+ /// including the failed lookup, whose badge reads "Failed".
+ func testBatchRowLabelAndValue() {
+ let app = AccessibilityAuditHarness.launch(seeded: true)
+ app.selectRootTab("Inspect")
+
+ assertElement(in: app, label: "broken.example", value: "Critical, Registered")
+ assertElement(in: app, label: "unreachable.example", value: "Failed, Unknown")
+ }
+
+ // Toggle selected-state (runbook §3b) is intentionally not asserted here.
+ // The bookmark ("Save domain") and Pin ("Pin domain") toggles both live in
+ // the Inspect result's Domain section, reachable only after a completed live
+ // lookup — non-deterministic in CI. The watchlist's own pin is a swipe/menu
+ // action that carries no `.isSelected` trait, and the Audit checklist and
+ // picker rows need seeded audits / a multi-step gated flow the fixtures do
+ // not provide. These remain in the manual pass; the results matrix records
+ // each as verified-by-construction with its source line.
+
+ // MARK: Helpers
+
+ private func openTrackedDomains(_ app: XCUIApplication) {
+ app.selectRootTab("Settings")
+ let trackedDomains = app.buttons["Tracked Domains"]
+ XCTAssertTrue(trackedDomains.waitForExistence(timeout: 5), "Settings no longer offers Tracked Domains")
+ trackedDomains.tap()
+ }
+
+ /// A `children: .ignore` row can surface as a button, cell, or other-element
+ /// depending on its container; match on label across the likely types.
+ private func firstElement(in app: XCUIApplication, label: String) -> XCUIElement? {
+ let predicate = NSPredicate(format: "label == %@", label)
+ for query in [app.buttons, app.cells, app.otherElements, app.staticTexts] {
+ let match = query.matching(predicate).firstMatch
+ if match.exists { return match }
+ }
+ return nil
+ }
+
+ private func assertElement(
+ in app: XCUIApplication,
+ label: String,
+ value: String,
+ file: StaticString = #filePath,
+ line: UInt = #line
+ ) {
+ // Wait for the row to appear at all.
+ let predicate = NSPredicate(format: "label == %@", label)
+ let anyMatch = app.descendants(matching: .any).matching(predicate).firstMatch
+ XCTAssertTrue(
+ anyMatch.waitForExistence(timeout: 8),
+ "No accessibility element labelled \(label)",
+ file: file,
+ line: line
+ )
+ guard let element = firstElement(in: app, label: label) else {
+ XCTFail("Element \(label) exists but not as a queryable button/cell/other", file: file, line: line)
+ return
+ }
+ XCTAssertEqual(
+ element.value as? String,
+ value,
+ "Element \(label) reported value \(String(describing: element.value)); expected \(value)",
+ file: file,
+ line: line
+ )
+ }
+}
diff --git a/DomainDigUITests/AccessibilityScreenshotTests.swift b/DomainDigUITests/AccessibilityScreenshotTests.swift
new file mode 100644
index 0000000..9cdafac
--- /dev/null
+++ b/DomainDigUITests/AccessibilityScreenshotTests.swift
@@ -0,0 +1,105 @@
+import XCTest
+
+/// Captures the Phase-6 visual-pass evidence as result-bundle attachments:
+/// the seeded dense screens in Light and Dark, and again at an accessibility
+/// text size. Driven from XCUITest (not `simctl`) for two reasons proven during
+/// this pass: the seed fixtures only populate under the test harness's launch,
+/// and `xcrun simctl ui appearance` does not propagate to a headless-booted
+/// simulator — so appearance is switched through the app's own Settings →
+/// Display picker, exercising the real code path.
+///
+/// **This is a capture utility, not a pass/fail test.** Every step is
+/// best-effort and never asserts: a control it cannot reach on a given runtime
+/// simply yields no screenshot, so adding it to the audit suite can never gate
+/// CI. Run with an explicit `-resultBundlePath` and export the attachments.
+@MainActor
+final class AccessibilityScreenshotTests: XCTestCase {
+ override func setUp() {
+ continueAfterFailure = true
+ }
+
+ /// Dashboard, Watchlist, and batch results in Light then Dark.
+ func testLightAndDarkScreens() {
+ let app = AccessibilityAuditHarness.launch(seeded: true)
+
+ for appearance in ["Light", "Dark"] {
+ guard setAppearance(app, to: appearance) else { continue }
+ captureSeededScreens(app, suffix: appearance.lowercased())
+ }
+ }
+
+ /// The same seeded screens at the largest accessibility text size, where
+ /// reflow and clipping surface. Launched fresh with the content-size arg.
+ func testAccessibilityTextSizeScreens() {
+ let app = AccessibilityAuditHarness.launch(
+ contentSizeCategory: "UICTContentSizeCategoryAccessibilityXXXL",
+ seeded: true
+ )
+ captureSeededScreens(app, suffix: "axxxl")
+ }
+
+ // MARK: Capture (best-effort)
+
+ private func captureSeededScreens(_ app: XCUIApplication, suffix: String) {
+ app.selectRootTab("Dashboard")
+ _ = app.buttons["Refresh all tracked domains"].waitForExistence(timeout: 5)
+ attach(app, name: "dashboard-\(suffix)")
+
+ app.selectRootTab("Settings")
+ let trackedDomains = app.buttons["Tracked Domains"]
+ if trackedDomains.waitForExistence(timeout: 5) {
+ trackedDomains.tap()
+ _ = element(app, labelled: "healthy.example").waitForExistence(timeout: 5)
+ attach(app, name: "watchlist-\(suffix)")
+ }
+
+ app.selectRootTab("Inspect")
+ _ = element(app, labelled: "broken.example").waitForExistence(timeout: 5)
+ attach(app, name: "batch-\(suffix)")
+ }
+
+ private func element(_ app: XCUIApplication, labelled label: String) -> XCUIElement {
+ app.descendants(matching: .any)
+ .matching(NSPredicate(format: "label == %@", label))
+ .firstMatch
+ }
+
+ private func attach(_ app: XCUIApplication, name: String) {
+ let attachment = XCTAttachment(screenshot: app.screenshot())
+ attachment.name = name
+ attachment.lifetime = .keepAlways
+ add(attachment)
+ }
+
+ // MARK: Appearance (best-effort; returns whether it switched)
+
+ /// Drives Settings → Display → Appearance to the given option. The `Picker`
+ /// renders as an inline `.menu` whose trigger is labelled
+ /// "Appearance, <current value>". Returns `false` (rather than failing) if
+ /// any step is unreachable on this runtime.
+ private func setAppearance(_ app: XCUIApplication, to option: String) -> Bool {
+ // A prior capture may have left the Settings tab on a pushed view
+ // (Tracked Domains). Re-selecting the active tab pops it back to root.
+ app.selectRootTab("Settings")
+ let display = app.buttons["Display"]
+ if !display.waitForExistence(timeout: 2) {
+ app.selectRootTab("Settings")
+ }
+ guard display.waitForExistence(timeout: 5) else { return false }
+ display.tap()
+
+ let trigger = app.buttons
+ .matching(NSPredicate(format: "label BEGINSWITH %@", "Appearance"))
+ .firstMatch
+ guard trigger.waitForExistence(timeout: 5) else { return false }
+ trigger.tap()
+
+ // The popped menu exposes System / Light / Dark as buttons (or menu
+ // items on some runtimes).
+ let asButton = app.buttons[option]
+ let choice = asButton.waitForExistence(timeout: 3) ? asButton : app.menuItems[option]
+ guard choice.waitForExistence(timeout: 3) else { return false }
+ choice.tap()
+ return true
+ }
+}