Files
accounted/lib/parties/__tests__/suggest.test.ts
T
fc04578818 feat(parties): suggestion pipeline from ledger keys and linked documents (#2172)
* feat(parties): phase 1 substrate, one party per counterpart

Adds the identity layer above customers and suppliers, which keep their
tables and every foreign key and gain a nullable party_id.

- parties: company-scoped identity with status (suggested | confirmed),
  kind, alias keys, origin and merged_into. One live party per org number
  and company, enforced by a partial unique index; merged losers leave the
  index so a merge can be undone. This is the unique key the
  duplicate-invoice guard has lacked, since suppliers never had one.
- party_facts: statements with a source, a rank (preferred | normal |
  deprecated) and two time axes, never overwritten.
- party_identities: bankgiro, plusgiro, IBAN and friends per party, with
  seen and paid counts and a known | unverified status.
- party_decisions: every human action on a party as a labelled example.
- normalize_org_number(text): SQL mirror of lib/invariants/org-number.ts
  (strip separators, drop the century on 12 digits, Luhn check, 10 digits).
- ensure_party(): find by org number inside the company, else create.
  Name-only rows never merge at insert time; a name merge is a recorded
  human decision.
- Backfill: one party per existing supplier and customer, merged on org
  number, suppliers first so both roles land on one party.
- Archive contract: the four tables are master data in the full archive.

Observed parties (keys derived from voucher and bank text) are not stored;
they stay computed by the ledger-context RPC. No posted entry is touched.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* feat(parties): observed parties from voucher text, ledger_key and its mirror

Migrants arrive with vouchers, not bank transactions, so the bank-keyed
ledger context is empty for them. This adds the description-keyed twin.

- public.ledger_key(text): legibility key on top of the frozen
  normalize_counterparty_key mirror: strips AP-register prefixes (levfakt,
  leverantörsfaktura från N, levbet, faktura, kvitto, utgift), the supplier
  number that follows them, and trailing 1-3 digit runs, never "inköp".
  Mirrored by lib/parties/ledger-key.ts; the pair is pinned by a shared
  fixture list in the pg test.
- public.get_observed_parties(company, from_date, limit): posted vouchers
  grouped by ledger_key(description) with occurrences, variants, expense
  and revenue SEK from the lines, first/last seen, median cadence and the
  Laplace-smoothed dominant result account. Excludes storno, opening
  balance, year-end and VAT settlement, and vouchers that carry a bank
  merchant name (those stay with get_ledger_deep_context). SECURITY
  INVOKER, so RLS scopes it. Never stored.
- lib/parties/classify.ts: the deterministic pre-classifier moved out of
  the evaluation script so product and evaluation share one implementation
  (0.965 agreement with the founder labels, party recall 0.99).
- lib/parties/observed.ts: RPC wrapper that classifies each row and
  derives a display rhythm from the cadence.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* fix(parties): tenant-safe composite foreign keys on every party link

Facts, identities, decisions, customers.party_id, suppliers.party_id and
parties.merged_into now reference parties(id, company_id), so a row can
only point at a party in its own company. ON DELETE SET NULL names
party_id so role rows keep their company_id. Adds a pg-real test that
rejects every cross-company link and checks company_id survives a party
delete.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* feat(parties): suggestion pipeline from ledger keys and linked documents

Phase 1c of the parties plan. Fills a migrant's register with suggested
parties from what the ledger already knows, never as facts:

- get_ledger_key_evidence(company): hard keys per ledger_key from the
  documents linked to posted vouchers (org number via normalize_org_number,
  VAT, bankgiro, plusgiro, printed name). Documents whose supplier org is
  the company's own are the company's sales invoices and only count in
  self_docs.
- apply_party_suggestions(company, user, items): upserts suggestions.
  Attaches by explicit party_id, org number or an exact alias key; never
  by name. Identities become known at two sightings. Idempotent.
- decide_parties(company, user, ids, kind, note): bulk confirm or dismiss
  with one party_decisions row each.
- parties.suggested_reason: the evidence summary the queue shows per row.
- lib/parties/suggest.ts: buildSuggestions (pure) and
  suggestPartiesForCompany. Keys that mix two org numbers keep neither the
  hard key nor identities; same-core live parties are reported as
  similar_to for a person to decide. coreKey() moves into ledger-key.ts.

55 unit tests and 14 pg-real tests pass locally.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* fix(parties): decide_parties dismisses suggested parties only

Dismiss is the queue's answer to a suggestion; a confirmed party is never
archived through it. Superagent P2 on #2172.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

* test(parties): type the rpc mock with its args so the ratchet stays clean

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

---------

Co-authored-by: Jakob Wennberg <311770904+jakobwennberg-oss@users.noreply.github.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-02 18:18:12 +02:00

195 lines
9.1 KiB
TypeScript

import { describe, expect, it, vi } from 'vitest'
import { coreKey } from '../ledger-key'
import type { ObservedParty } from '../observed'
import { buildSuggestions, suggestPartiesForCompany, type ExistingParty, type LedgerKeyEvidence } from '../suggest'
function observed(over: Partial<ObservedParty> & { key: string }): ObservedParty {
return {
name: over.key.toUpperCase(),
variants: [],
variant_count: 1,
occurrences: 3,
expense_sek: 3000,
revenue_sek: 0,
first_seen: '2026-01-10',
last_seen: '2026-03-10',
cadence_days: 30,
dominant_account_number: '4000',
dominant_account_share: 0.6,
dominant_account_count: 2,
dominant_account_total: 3,
label: 'party',
rhythm: 'monthly',
...over,
}
}
function evidence(over: Partial<LedgerKeyEvidence> & { key: string }): LedgerKeyEvidence {
return { docs: 0, self_docs: 0, orgs: [], vat_numbers: [], names: [], bankgiro: [], plusgiro: [], ...over }
}
const ORG = '5564300142'
describe('coreKey', () => {
it('strips AP prefixes, digit runs and legal forms', () => {
expect(coreKey('levfakt beijer byggmaterial ab 2089')).toBe('beijer byggmaterial')
expect(coreKey('Fortnox Finans AB')).toBe('fortnox finans')
expect(coreKey('inköp av varor')).toBe('av varor')
})
})
describe('buildSuggestions', () => {
it('skips keys the pre-classifier does not call party', () => {
const r = buildSuggestions({
observed: [observed({ key: 'inköp av varor', label: 'category' }), observed({ key: 'lön mars', label: 'payroll' })],
evidence: [],
existing: [],
})
expect(r.items).toHaveLength(0)
expect(r.skipped).toEqual([
{ key: 'inköp av varor', label: 'category' },
{ key: 'lön mars', label: 'payroll' },
])
})
it('creates a new suggested party from the ledger alone, with ledger facts and a reason', () => {
const r = buildSuggestions({ observed: [observed({ key: 'beijer byggmaterial' })], evidence: [], existing: [] })
expect(r.items).toHaveLength(1)
const item = r.items[0]!
expect(item.party_id).toBeUndefined()
expect(item.org_number).toBeUndefined()
expect(item.origin).toBe('ledger')
expect(item.display_name).toBe('BEIJER BYGGMATERIAL')
expect(item.alias_keys).toEqual(['beijer byggmaterial'])
expect(item.reason.attach).toBe('new')
expect(item.reason.occurrences).toBe(3)
expect(item.facts.map((f) => f.field)).toEqual(['dominant_account', 'cadence_days'])
expect(item.identities).toEqual([])
})
it('uses the document hard key: org number, printed name, VAT and identities', () => {
const r = buildSuggestions({
observed: [observed({ key: 'beijer byggmaterial' })],
evidence: [
evidence({
key: 'beijer byggmaterial',
docs: 3,
orgs: [{ org: ORG, n: 3 }],
vat_numbers: [{ vat: `SE${ORG}01`, n: 3 }],
names: [{ name: 'Beijer Byggmaterial AB', n: 3 }],
bankgiro: [{ value: '53170900', n: 3, first_seen: '2026-01-10', last_seen: '2026-03-10' }],
}),
],
existing: [],
})
const item = r.items[0]!
expect(item.org_number).toBe(ORG)
expect(item.origin).toBe('document')
expect(item.display_name).toBe('Beijer Byggmaterial AB')
expect(item.legal_name).toBe('Beijer Byggmaterial AB')
expect(item.vat_number).toBe(`SE${ORG}01`)
expect(item.identities).toEqual([
{ scheme: 'bankgiro', value: '53170900', first_seen: '2026-01-10', last_seen: '2026-03-10', seen_count: 3 },
])
expect(item.facts.map((f) => f.field)).toEqual(['dominant_account', 'cadence_days', 'org_number', 'legal_name'])
expect(item.reason.org_number).toBe(ORG)
})
it('withholds the hard key and identities when a key mixes two org numbers', () => {
const r = buildSuggestions({
observed: [observed({ key: 'vattenfall' })],
evidence: [
evidence({
key: 'vattenfall',
docs: 4,
orgs: [
{ org: ORG, n: 2 },
{ org: '5560125790', n: 2 },
],
bankgiro: [{ value: '51108348', n: 4, first_seen: '2026-01-01', last_seen: '2026-04-01' }],
}),
],
existing: [],
})
const item = r.items[0]!
expect(item.org_number).toBeUndefined()
expect(item.identities).toEqual([])
expect(item.reason.ambiguous_orgs).toEqual([ORG, '5560125790'])
})
it('attaches to an existing party by org number, then by exact alias key, never by name', () => {
const byOrg: ExistingParty = { id: 'p-org', display_name: 'Beijer AB', org_number: ORG, alias_keys: [], status: 'confirmed' }
const byAlias: ExistingParty = { id: 'p-alias', display_name: 'Loopia', org_number: null, alias_keys: ['loopia'], status: 'suggested' }
const lookalike: ExistingParty = { id: 'p-fortnox', display_name: 'Fortnox AB', org_number: '5566661012', alias_keys: [], status: 'confirmed' }
const r = buildSuggestions({
observed: [observed({ key: 'beijer byggmaterial' }), observed({ key: 'loopia' }), observed({ key: 'fortnox finans' })],
evidence: [evidence({ key: 'beijer byggmaterial', docs: 1, orgs: [{ org: ORG, n: 1 }] })],
existing: [byOrg, byAlias, lookalike],
})
const [beijer, loopia, fortnox] = r.items
expect(beijer!.party_id).toBe('p-org')
expect(beijer!.reason.attach).toBe('org_number')
expect(loopia!.party_id).toBe('p-alias')
expect(loopia!.reason.attach).toBe('alias_key')
// Same trade name is a question for a person, not a merge.
expect(fortnox!.party_id).toBeUndefined()
expect(fortnox!.reason.attach).toBe('new')
expect(fortnox!.reason.similar_to).toBeUndefined()
})
it('reports same-core live parties as similar_to on new suggestions', () => {
const existing: ExistingParty = { id: 'p1', display_name: 'Levfakt Beijer Byggmaterial AB 2089', org_number: null, alias_keys: [], status: 'suggested' }
const r = buildSuggestions({ observed: [observed({ key: 'beijer byggmaterial' })], evidence: [], existing: [existing] })
expect(r.items[0]!.party_id).toBeUndefined()
expect(r.items[0]!.reason.similar_to).toEqual([{ party_id: 'p1', display_name: 'Levfakt Beijer Byggmaterial AB 2089' }])
})
})
describe('suggestPartiesForCompany', () => {
function stubClient(opts: { observed: unknown[]; evidence: unknown[]; existing: unknown[]; apply: unknown }) {
const rpc = vi.fn(async (name: string, _args?: Record<string, unknown>) => {
if (name === 'get_observed_parties') return { data: opts.observed, error: null }
if (name === 'get_ledger_key_evidence') return { data: opts.evidence, error: null }
if (name === 'apply_party_suggestions') return { data: opts.apply, error: null }
return { data: null, error: { message: `unexpected rpc ${name}` } }
})
const range = vi.fn(async () => ({ data: opts.existing, error: null }))
const chain: Record<string, unknown> = {}
for (const m of ['select', 'eq', 'is', 'order']) chain[m] = vi.fn(() => chain)
chain.range = range
const from = vi.fn(() => chain)
return { client: { rpc, from } as never, rpc, from }
}
it('runs observed -> evidence -> existing -> apply and sums the RPC summary', async () => {
const { client, rpc } = stubClient({
observed: [
{ key: 'beijer byggmaterial', name: 'BEIJER', variants: [], variant_count: 1, occurrences: 3, expense_sek: 3000, revenue_sek: 0, first_seen: '2026-01-10', last_seen: '2026-03-10', cadence_days: 30, dominant_account_number: '4000', dominant_account_share: 0.6, dominant_account_count: 2, dominant_account_total: 3 },
{ key: 'inköp av varor', name: 'Inköp av varor', variants: [], variant_count: 1, occurrences: 1, expense_sek: 300, revenue_sek: 0, first_seen: '2026-03-15', last_seen: '2026-03-15', cadence_days: null, dominant_account_number: '4010', dominant_account_share: 0.5, dominant_account_count: 1, dominant_account_total: 1 },
],
evidence: [],
existing: [],
apply: { created: 1, attached: 0, identities: 0, facts: 2 },
})
const summary = await suggestPartiesForCompany(client, 'co', 'user')
expect(summary).toEqual({ observed: 2, suggested: 1, skipped: 1, created: 1, attached: 0, identities: 0, facts: 2 })
const applyCall = rpc.mock.calls.find((c) => c[0] === 'apply_party_suggestions')!
const args = applyCall[1] as unknown as { p_company_id: string; p_user_id: string; p_items: Array<{ key: string }> }
expect(args.p_company_id).toBe('co')
expect(args.p_user_id).toBe('user')
expect(args.p_items.map((i) => i.key)).toEqual(['beijer byggmaterial'])
})
it('does not call apply when nothing is a party', async () => {
const { client, rpc } = stubClient({ observed: [], evidence: [], existing: [], apply: null })
const summary = await suggestPartiesForCompany(client, 'co', 'user')
expect(summary.suggested).toBe(0)
expect(rpc.mock.calls.map((c) => c[0])).not.toContain('apply_party_suggestions')
})
it('surfaces RPC errors', async () => {
const rpc = vi.fn(async () => ({ data: null, error: { message: 'boom' } }))
await expect(suggestPartiesForCompany({ rpc } as never, 'co', 'user')).rejects.toThrow(/get_observed_parties failed: boom/)
})
})