admin/0pt
5
0
Fork 0
Code Issues 9 Pull Requests Actions Packages Projects Releases Wiki Activity

feat: durable AUD0 outbox + dataset/search/ER HTTP surfaces + P065 stängd (kanoniserad från GitHub #10) #42

Closed
admin wants to merge 0 commits from feat/aud0-outbox-http-surfaces-20260907 into main
pull from: feat/aud0-outbox-http-surfaces-20260907
merge into: :main
Conversation 0 Commits - Files Changed -
admin commented 2026-09-07 17:32:46 +00:00
Owner
Copy Link
Copy Source

Durable AUD0 outbox + HTTP surfaces (kanoniserad fran GitHub PR #10, PORTERAD FORST HIT)

Canonical Gitea = source of truth: denna PR landar FORST har; GitHub-mirrorn foljer via push-mirror.

Innehall (63 commits + slutgransknings-fix 3edc56d)

  • Durable Postgres-outbox for alla standard-AUD0-events + OpenLineage (samma centrala
    durability-boundary; dispatcher explicit durable:false - aterkover aldrig sitt eget event;
    retry/backoff, leasing, SKIP LOCKED, dead-letter, tenant-binding, idempotency)
  • DatasetService: repo-pattern mot kanoniska opt_datasets + nya durabla opt_dataset_versions;
    immutable versions (monotont nummer under transaction lock), idempotency med payload-drift-
    detektering, cross-tenant => NOT_FOUND; exports med deterministiskt export-id
  • HTTP: datasets/versions CRUD + ER candidates/internal/batch + search definitions/query
    (klient kan inte hoja rights_tag - fail-closed till internal)
  • Search: versionerade index-definitioner i Postgres (sekventiella schemaversioner, replay-
    idempotens, same-version-andrat-schema => CONFLICT); OpenSearch forblir rebuildable projection
  • ER split-brain stangd: Python ar thin adapter mot kanonisk TS-motor; stable-identifiers.v3
    (LEI global, org_nr lands-scopad, hard-negative vinner, fuzzy => human review); cluster-wide
    hard-negative constraints; P065 STANGD (closure-record i STATUS.md)
  • CI: integration-jobb mot live OpenSearch/ClickHouse/Postgres (run-unique identity);
    python-engine blocking pytest-gate; Trivy HIGH/CRITICAL blocking (ersatter falskt-gron --exit-code 0)

Slutgranskning (3edc56d, exekverad)

  • CreateDatasetVersionInput readonly-artifact_refs + tx.array kopia (postgres.js typings)
  • 3 testkorrigeringar stale mot STARKARE implementation: ER-http 401 fail-closed
    (default-param-bugg), ER-meddelande bounds-aware, search fail-closed flush + negativ kontroll
  • dataset-postgres.realinfra: DATABASE_URL aktiverar outbox - 5/5 mot live Postgres
  • STATUS.md: sanning enligt kod (AUD0/lineage/gappista/P065 closure-record)

Verifierat lokalt (exekverat)

  • typecheck EXIT 0 - unit 945/945 (184 real-infra skippas arist lokalt, kors i CI)
  • real-Postgres integration 5/5 - next build EXIT 0 (Next 16-kontraktet)
## Durable AUD0 outbox + HTTP surfaces (kanoniserad fran GitHub PR #10, PORTERAD FORST HIT) Canonical Gitea = source of truth: denna PR landar FORST har; GitHub-mirrorn foljer via push-mirror. ## Innehall (63 commits + slutgransknings-fix 3edc56d) - Durable Postgres-outbox for alla standard-AUD0-events + OpenLineage (samma centrala durability-boundary; dispatcher explicit durable:false - aterkover aldrig sitt eget event; retry/backoff, leasing, SKIP LOCKED, dead-letter, tenant-binding, idempotency) - DatasetService: repo-pattern mot kanoniska opt_datasets + nya durabla opt_dataset_versions; immutable versions (monotont nummer under transaction lock), idempotency med payload-drift- detektering, cross-tenant => NOT_FOUND; exports med deterministiskt export-id - HTTP: datasets/versions CRUD + ER candidates/internal/batch + search definitions/query (klient kan inte hoja rights_tag - fail-closed till internal) - Search: versionerade index-definitioner i Postgres (sekventiella schemaversioner, replay- idempotens, same-version-andrat-schema => CONFLICT); OpenSearch forblir rebuildable projection - ER split-brain stangd: Python ar thin adapter mot kanonisk TS-motor; stable-identifiers.v3 (LEI global, org_nr lands-scopad, hard-negative vinner, fuzzy => human review); cluster-wide hard-negative constraints; P065 STANGD (closure-record i STATUS.md) - CI: integration-jobb mot live OpenSearch/ClickHouse/Postgres (run-unique identity); python-engine blocking pytest-gate; Trivy HIGH/CRITICAL blocking (ersatter falskt-gron --exit-code 0) ## Slutgranskning (3edc56d, exekverad) - CreateDatasetVersionInput readonly-artifact_refs + tx.array kopia (postgres.js typings) - 3 testkorrigeringar stale mot STARKARE implementation: ER-http 401 fail-closed (default-param-bugg), ER-meddelande bounds-aware, search fail-closed flush + negativ kontroll - dataset-postgres.realinfra: DATABASE_URL aktiverar outbox - 5/5 mot live Postgres - STATUS.md: sanning enligt kod (AUD0/lineage/gappista/P065 closure-record) ## Verifierat lokalt (exekverat) - typecheck EXIT 0 - unit 945/945 (184 real-infra skippas arist lokalt, kors i CI) - real-Postgres integration 5/5 - next build EXIT 0 (Next 16-kontraktet)
admin added 64 commits 2026-09-07 17:32:47 +00:00
feat(evidence): add durable AUD0 outbox schema ca0b060c6d
feat(evidence): implement durable AUD0 outbox and dispatcher 79942a2431
test(evidence): cover AUD0 outbox delivery and failure semantics 76a3cae776
test(evidence): verify AUD0 outbox durability against Postgres 2a79ae6e60
feat(lineage): route production evidence through durable AUD0 outbox 9f46e12447
feat(evidence): add protected AUD0 outbox dispatch endpoint 56b1ce01b3
security: protect evidence outbox dispatch as internal-only eab6a1fcce
ci: make HIGH/CRITICAL security findings block 0pt merges d9c398e4fb
ci: turn dedicated 0pt security scan into a blocking gate aef384b1e0
feat(er): expose canonical ER candidate engine to internal pipeline 71f2d13ae1
security: allow only authenticated internal access to canonical ER bridge 3d0c211af8
refactor(er): remove duplicate Python scoring engine ebb9521801
refactor(er): route production pipeline through canonical TS ER engine 21ff9af769
test(er): cover canonical bridge application and fail-closed behavior 257e6d3410
ci: make Python engine tests a blocking PR gate 09e3a01acd
security(er): validate internal ER bridge thresholds and scope 351afc54e1
feat(evidence): make standard AUD0 client durable by default 020a4be7e8
fix: centralize lineage durability in AUD0 client boundary f0958cf708
fix: use raw AUD0 client in outbox dispatcher 4c7132728a
fix: make conflicting company identifiers dominate ER matches 5338975eea
fix: enforce canonical hard non-match constraints across ER clusters 3826f115ec
test: prove hard non-match blocks transitive ER merge ad213b4400
test: pin lineage queued-vs-emitted semantics 6a687212a1
feat: add durable dataset registry repository 5dbd53045c
refactor: persist DatasetService through repository boundary ea02f4e9f7
feat: add durable dataset version store 298c965448
fix: scope dataset version idempotency uniqueness to real keys 8432d19d8c
refactor: extract canonical dataset version types a3bad9aa12
feat: add durable dataset version repository 906fe9ac37
fix: use postgres arrays and normalized idempotency comparison 3ccdcf0cf6
refactor: persist dataset versions and make lineage retry-stable 3c5850fbe5
test: prove dataset registry and versions against real Postgres 851e43d8db
ci: run durable dataset and AUD0 outbox tests on live Postgres 97f26834c7
feat: share durable dataset services across route modules 70fd81dc4d
feat: expose tenant-safe dataset registry HTTP surface 102e1e1616
feat: expose tenant-safe dataset describe route b5ffdbc091
feat: expose durable dataset version create and query routes e70acc8981
feat: expose tenant-safe dataset version describe route ccda286022
feat: persist versioned search index definitions 1c1d14a3eb
fix(er): require human review for score-only company matches 04d861b920
feat: add durable versioned search definition repository dd01fe76c9
test(er): pin review-only fuzzy company boundary 7e2b5304b7
refactor: make search definitions restart-safe 9961ac7e03
fix(er): country-qualify company registration identifiers e13d550837
chore: remove redundant search definition index 195c4611dc
test(er): cover country-qualified stable identifiers d45eb74772
refactor: return stable creation metadata for search definition audit 8dfd429a61
fix: audit only newly created durable search definitions 82f7475b91
feat: add production search composition root f3a8cf6cc2
feat: expose governed durable search definitions e400afc882
feat: expose tenant and purpose constrained search query route 84945a2ff7
auth: allow service-token search definition administration 6d02a5cd34
test: prove search definitions survive restart across Postgres and OpenSearch ed1abc4cd4
ci: require Postgres-backed search definition integration path 76038205ca
fix: pass registration country into canonical company identity rules 6f525c5c9e
refactor: centralize ER request validation 00e4636655
refactor: share ER request validation across HTTP surfaces 9782eaf42c
feat: harden canonical ER service and idempotent batch submission 243918a255
feat: add generic ER composition root 35a8ff0f2a
feat: expose generic tenant-safe ER candidate API 7d11ea895c
feat: expose idempotent N0D-backed batch ER submission d0cba02ee0
fix(er): refuse score-only matches at Python merge boundary 93c01d2264
docs(er): reconcile ecosystem acquisition plan with canonical ER architecture
CI (SIAX Cloud) / security (push) Successful in 16s
Details
CI (SIAX Cloud) / quality (push) Failing after 19s
Details
Security Scan (SIAX Cloud) / security (push) Successful in 32s
Details
CI (SIAX Cloud) / integration (push) Failing after 49s
Details
Python Engine CI (SIAX Cloud) / python-engine (push) Failing after 5m34s
Details
e2437ab09e
fix: slutgranskning av dataset/search/ER-ytorna + STATUS-sanning
Security Scan (SIAX Cloud) / security (push) Successful in 16s
Details
CI (SIAX Cloud) / security (push) Successful in 17s
Details
CI (SIAX Cloud) / integration (push) Successful in 29s
Details
CI (SIAX Cloud) / quality (push) Successful in 48s
Details
Security Scan (SIAX Cloud) / security (pull_request) Successful in 15s
Details
CI (SIAX Cloud) / security (pull_request) Successful in 28s
Details
CI (SIAX Cloud) / quality (pull_request) Successful in 48s
Details
CI (SIAX Cloud) / integration (pull_request) Successful in 55s
Details
Python Engine CI (SIAX Cloud) / python-engine (push) Failing after 4m52s
Details
Python Engine CI (SIAX Cloud) / python-engine (pull_request) Failing after 4m48s
Details
3edc56dcdb 
Slutgate inför merge (per fortsättningsplan):

Kontrakt: CreateDatasetVersionInput.artifact_refs → readonly string[]
(anropare får skicka 'as const'; servicen muterar aldrig); postgres.js
tx.array() får muterbar kopia vid INSERT.

Testkorrigeringar (stale mot starkare implementation — aldrig svagare):
- entity-resolution-http: request(body, undefined) triggade default-param
  och skickade GILTIGT token → 200. Tomt token = 'utan token' → 401 fail-closed.
- entity-resolution: /two records/ → /between 2 and 5000/ (bounds-aware validering)
- search-service: omformat purpose-filter-test + NY negativ kontroll —
  rebuild avvisar dokument utan purpose_tags (fail closed, generation discarded)
- dataset-postgres.realinfra: sätter DATABASE_URL i setup så den durabla
  AUD0-outboxen aktiveras (testet ljög annars om durabilitet) — 5/5 mot live Postgres

STATUS.md: AUD0-klient + lineage-rader (outbox nu real-infra testad),
gap-listan (persistence/routes/outbox stängda, exakt vad som återstår),
P065 STÄNGD med closure-record (thin adapter, v3-semantik, hard-negative
transitivitet, fail-closed 401 — 4/4 planpunkter verifierade).

Verifierat: typecheck EXIT 0 · 945/945 unit · 5/5 real-Postgres · next build EXIT 0
CODEOWNERS rules requested review from sax3l 2026-09-07 17:32:47 +00:00
admin closed this pull request 2026-09-08 20:47:38 +00:00

Pull request closed

This pull request cannot be reopened because the branch was deleted.
Sign in to join this conversation.
Reviewers
No Reviewers
sax3l
Labels
No items
No labels
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
siax-bot siax-ci siax-healer (siax-healer (CI self-healing agent)) admin (Simon Axelsson)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: admin/0pt#42