feat: durable AUD0 outbox + dataset/search/ER HTTP surfaces + P065 stängd (kod, utan workflow-ändringar) #43

Merged

admin merged 68 commits from feat/aud0-outbox-code-20260907 into main 2026-09-07 17:53:04 +00:00

Conversation 0 Commits 68 Files Changed 41

+3659 -920

admin commented 2026-09-07 17:37:59 +00:00

Owner

Copy Link

Copy Source

Durable AUD0 outbox + dataset/search/ER surfaces — KOD utan workflow-ändringar

Ersatter #42 som blockeras av estate-skyddet pa .gitea/workflows/ (CI-hardningen:
Trivy blocking + Postgres-service + python-engine-gate kraver estate-policy-beslut
och dokumenteras separat — HARDNINGEN RORS EJ).

Samma 63 commits fran GitHub PR #10-head (e2437ab) + slutgransknings-fix 3edc56d,
minus de 2 workflow-commits. Kanoniserad FORST har (Gitea = source of truth).

Innehall

• Durable Postgres-outbox for AUD0 + OpenLineage (en central durability-boundary;
  dispatcher explicit durable:false; retry/backoff, leasing, SKIP LOCKED, dead-letter,
  tenant-binding, idempotency)
• DatasetService mot opt_datasets/opt_dataset_versions: immutable versions, monotont
  nummer under lock, idempotency med payload-drift-detektering, cross-tenant => NOT_FOUND
• HTTP: datasets/versions, ER candidates/internal/batch (rights_tag fail-closed),
  search definitions/query; OpenSearch forblir rebuildable projection
• ER split-brain stangd: Python thin adapter; stable-identifiers.v3; P065 STANGD
  med closure-record i STATUS.md

Verifierat (exekverat lokalt)

• typecheck EXIT 0 - unit 945/945 - next build EXIT 0
• real-Postgres 5/5 (inkl AUD0-outbox-durability; hardningens nya integration-jobb
  kors i CI nar estate godkanner workflow-andringen)

## Durable AUD0 outbox + dataset/search/ER surfaces — KOD utan workflow-ändringar Ersatter #42 som blockeras av estate-skyddet pa .gitea/workflows/ (CI-hardningen: Trivy blocking + Postgres-service + python-engine-gate kraver estate-policy-beslut och dokumenteras separat — HARDNINGEN RORS EJ). Samma 63 commits fran GitHub PR #10-head (e2437ab) + slutgransknings-fix 3edc56d, minus de 2 workflow-commits. Kanoniserad FORST har (Gitea = source of truth). ## Innehall - Durable Postgres-outbox for AUD0 + OpenLineage (en central durability-boundary; dispatcher explicit durable:false; retry/backoff, leasing, SKIP LOCKED, dead-letter, tenant-binding, idempotency) - DatasetService mot opt_datasets/opt_dataset_versions: immutable versions, monotont nummer under lock, idempotency med payload-drift-detektering, cross-tenant => NOT_FOUND - HTTP: datasets/versions, ER candidates/internal/batch (rights_tag fail-closed), search definitions/query; OpenSearch forblir rebuildable projection - ER split-brain stangd: Python thin adapter; stable-identifiers.v3; P065 STANGD med closure-record i STATUS.md ## Verifierat (exekverat lokalt) - typecheck EXIT 0 - unit 945/945 - next build EXIT 0 - real-Postgres 5/5 (inkl AUD0-outbox-durability; hardningens nya integration-jobb kors i CI nar estate godkanner workflow-andringen)

admin added 64 commits 2026-09-07 17:37:59 +00:00

feat(evidence): add durable AUD0 outbox schema ca0b060c6d

feat(evidence): implement durable AUD0 outbox and dispatcher 79942a2431

test(evidence): cover AUD0 outbox delivery and failure semantics 76a3cae776

test(evidence): verify AUD0 outbox durability against Postgres 2a79ae6e60

feat(lineage): route production evidence through durable AUD0 outbox 9f46e12447

feat(evidence): add protected AUD0 outbox dispatch endpoint 56b1ce01b3

security: protect evidence outbox dispatch as internal-only eab6a1fcce

ci: make HIGH/CRITICAL security findings block 0pt merges d9c398e4fb

ci: turn dedicated 0pt security scan into a blocking gate aef384b1e0

feat(er): expose canonical ER candidate engine to internal pipeline 71f2d13ae1

security: allow only authenticated internal access to canonical ER bridge 3d0c211af8

refactor(er): remove duplicate Python scoring engine ebb9521801

refactor(er): route production pipeline through canonical TS ER engine 21ff9af769

test(er): cover canonical bridge application and fail-closed behavior 257e6d3410

ci: make Python engine tests a blocking PR gate 09e3a01acd

security(er): validate internal ER bridge thresholds and scope 351afc54e1

feat(evidence): make standard AUD0 client durable by default 020a4be7e8

fix: centralize lineage durability in AUD0 client boundary f0958cf708

fix: use raw AUD0 client in outbox dispatcher 4c7132728a

fix: make conflicting company identifiers dominate ER matches 5338975eea

fix: enforce canonical hard non-match constraints across ER clusters 3826f115ec

test: prove hard non-match blocks transitive ER merge ad213b4400

test: pin lineage queued-vs-emitted semantics 6a687212a1

feat: add durable dataset registry repository 5dbd53045c

refactor: persist DatasetService through repository boundary ea02f4e9f7

feat: add durable dataset version store 298c965448

fix: scope dataset version idempotency uniqueness to real keys 8432d19d8c

refactor: extract canonical dataset version types a3bad9aa12

feat: add durable dataset version repository 906fe9ac37

fix: use postgres arrays and normalized idempotency comparison 3ccdcf0cf6

refactor: persist dataset versions and make lineage retry-stable 3c5850fbe5

test: prove dataset registry and versions against real Postgres 851e43d8db

ci: run durable dataset and AUD0 outbox tests on live Postgres 97f26834c7

feat: share durable dataset services across route modules 70fd81dc4d

feat: expose tenant-safe dataset registry HTTP surface 102e1e1616

feat: expose tenant-safe dataset describe route b5ffdbc091

feat: expose durable dataset version create and query routes e70acc8981

feat: expose tenant-safe dataset version describe route ccda286022

feat: persist versioned search index definitions 1c1d14a3eb

fix(er): require human review for score-only company matches 04d861b920

feat: add durable versioned search definition repository dd01fe76c9

test(er): pin review-only fuzzy company boundary 7e2b5304b7

refactor: make search definitions restart-safe 9961ac7e03

fix(er): country-qualify company registration identifiers e13d550837

chore: remove redundant search definition index 195c4611dc

test(er): cover country-qualified stable identifiers d45eb74772

refactor: return stable creation metadata for search definition audit 8dfd429a61

fix: audit only newly created durable search definitions 82f7475b91

feat: add production search composition root f3a8cf6cc2

feat: expose governed durable search definitions e400afc882

feat: expose tenant and purpose constrained search query route 84945a2ff7

auth: allow service-token search definition administration 6d02a5cd34

test: prove search definitions survive restart across Postgres and OpenSearch ed1abc4cd4

ci: require Postgres-backed search definition integration path 76038205ca

fix: pass registration country into canonical company identity rules 6f525c5c9e

refactor: centralize ER request validation 00e4636655

refactor: share ER request validation across HTTP surfaces 9782eaf42c

feat: harden canonical ER service and idempotent batch submission 243918a255

feat: add generic ER composition root 35a8ff0f2a

feat: expose generic tenant-safe ER candidate API 7d11ea895c

feat: expose idempotent N0D-backed batch ER submission d0cba02ee0

fix(er): refuse score-only matches at Python merge boundary 93c01d2264

docs(er): reconcile ecosystem acquisition plan with canonical ER architecture e2437ab09e

ci: behåller main:s workflows (estate-skyddade filer) ... 0eb9429932

CI-härdningen ur PR #10 (Trivy HIGH/CRITICAL blocking, Postgres-service i
integration, python-engine pytest-gate) berör .gitea/workflows/ och kräver
estate-policy-beslut — dokumenterad separat, hålls UTANFÖR denna merge så
koden kanoniseras utan blockering. Härdningens nya tester är exekverade
lokalt: real-Postgres 5/5 (DATABASE_URL-aktiverad outbox).

CODEOWNERS rules requested review from sax3l 2026-09-07 17:37:59 +00:00

admin added 3 commits 2026-09-07 17:50:05 +00:00

fix: slutgranskning av dataset/search/ER-ytorna + STATUS-sanning ... 3edc56dcdb

Slutgate inför merge (per fortsättningsplan):

Kontrakt: CreateDatasetVersionInput.artifact_refs → readonly string[]
(anropare får skicka 'as const'; servicen muterar aldrig); postgres.js
tx.array() får muterbar kopia vid INSERT.

Testkorrigeringar (stale mot starkare implementation — aldrig svagare):
- entity-resolution-http: request(body, undefined) triggade default-param
  och skickade GILTIGT token → 200. Tomt token = 'utan token' → 401 fail-closed.
- entity-resolution: /two records/ → /between 2 and 5000/ (bounds-aware validering)
- search-service: omformat purpose-filter-test + NY negativ kontroll —
  rebuild avvisar dokument utan purpose_tags (fail closed, generation discarded)
- dataset-postgres.realinfra: sätter DATABASE_URL i setup så den durabla
  AUD0-outboxen aktiveras (testet ljög annars om durabilitet) — 5/5 mot live Postgres

STATUS.md: AUD0-klient + lineage-rader (outbox nu real-infra testad),
gap-listan (persistence/routes/outbox stängda, exakt vad som återstår),
P065 STÄNGD med closure-record (thin adapter, v3-semantik, hard-negative
transitivitet, fail-closed 401 — 4/4 planpunkter verifierade).

Verifierat: typecheck EXIT 0 · 945/945 unit · 5/5 real-Postgres · next build EXIT 0

Merge commit '3edc56d' into HEAD cc6fbd71c5

test(er): resolv-determinism — match-pairs behöver hard-rule decided_by ... 6befaa7be7

_apply_matches ignorerar medvetet decided_by=score (defence in depth:
score/fuzzy får aldrig skapa canonical identity-länkar) — testernas
stub-bridge returnerade score-pairs och förväntade ändå merge → CI-fail var
implementationen som hade rätt. Pairs är nu decided_by=stable-identifiers.v3.

Verifierat: pytest services/api/tests 6+14 pass, full unit 945/945,
typecheck EXIT 0, real-Postgres 5/5.

admin added 1 commit 2026-09-07 17:52:04 +00:00

ci: tar bort python-engine.yml — kräver estate-policy-beslut (skyddade filer) ... 3c9abda020

Ny blockerande pytest-gate + Postgres/OpenSearch/ClickHouse-härdningen i
ci.yml ur PR #10 berör .gitea/workflows/ (estate-skydd). De nya real-infra-
testerna är exekverade lokalt (Postgres 5/5; OpenSearch/CH-gate behåller
main:s konfig tills beslut) — hålls utanför merge så koden landar.

admin merged commit into main 2026-09-07 17:53:04 +00:00

Sign in to join this conversation.

Reviewers

No Reviewers

sax3l

Labels

No items

No labels

Milestone

No items

No Milestone

Projects

Clear projects

No projects

Assignees

Clear assignees

siax-bot siax-ci siax-healer (siax-healer (CI self-healing agent)) admin (Simon Axelsson)

No Assignees

1 Participants

Notifications

Subscribe

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: admin/0pt#43