Skip to content
kazma.
ع Star 6 Get Started

Smoke test matrix

Run after pulls that touch research, Knowledge Library, proxy, V2 memory, or Document Intelligence. Check off each row; note environment (local / Docker / SearXNG / proxy).

Automated (offline) subset — industry CI:

Terminal window
pwsh -File scripts/industry_smoke.ps1

Runs readiness, re-index skip, session cancel, proxy helpers, golden memory eval, and docs presence. Live network / LLM rows below still need a human.

Prerequisites (manual live rows)

  • App up (uvicorn / usual serve)
  • At least one LLM configured
  • Optional: SearXNG, Proxy Provider (anyIP), Neo4j
  • Preflight: GET /api/research/ready (add ?live=1 for a tiny live search)

#ActionExpectPass
R1Open /research → Start deep research (short topic, brief, 3 sources)Live panel stage log updates; session card appears☐
R2Let run finishStatus done; report path; MD open works☐
R3Start another run → Cancel mid-flightStatus cancelled; no hang; list refresh☐
R4Chat or /research deep <topic> (gateway)Progress messages or summary with report☐
R5Settings: force thin network if neededFail closed deep shows clear error (not silent empty)☐

#ActionExpectPass
K1Create lib + crawl a small public docs rootJob shows discovered/fetched/ingested☐
K2Refresh same lib immediatelyunchanged / skipped rise; few or zero new embeds☐
K3Remove a page from scope (or prune via re-discover)pruned count or gone URL absent from search☐
K4Enable auto_inject on lib; ask in chat about a doc factAnswer cites KB / footer☐
K5Settings → Memory → Smart Knowledge search on; technical Q without auto_injectStill injects from active libs with chunks☐

#ActionExpectPass
P1Settings → System → Proxy = none → TestDirect mode OK☐
P2Configure anyIP (or stub) → TestExit IP shown when valid☐
P3With proxy on: read_url hard pagehttpx path may use proxy; Playwright recovery still works☐
P4KB crawl with proxy onDiscover + fetch succeed (or clear failures)☐

#ActionExpectPass
M1Chat: “Remember my favorite color is teal.” then “What color do I like?”Recalls teal☐
M2Settings → Memory → Explain recall ONNext chat turn that uses memory shows a Memory used row, with channels, and a reload still shows it☐
M3Panel chipsBeliefs/episodes show fts5 / dense / belief_ppr / session_boost as applicable☐
M4With KB inject: technical doc questionPanel also lists KB rows with kb_rrf☐
M5Dashboard probeSame channel chips; Run golden eval returns pass rate☐
M6Multi-hop beliefs (works_at → located_in)Probe/chat can surface multi-hop object☐
M7Open /memory after restartPreviously payload-object concepts (literal objects) sit on a hub related_to edge, not a disconnected island☐
M8Inspect a grouped node → UngroupGrouping gone; beliefs unchanged☐
M9Truncation banner (graph > 200 nodes)Banner names nodes and connections hidden by slicing☐

#ActionExpectPass
D1Open /documents → upload a small .txt / PDFDocument appears; state progresses to ready (or clear fail code)☐
D2Open detail → content previewFenced/readable text; BiDi OK for Arabic if used (dir=auto)☐
D3Index into a library_id → searchHits return with citations inside untrusted fence☐
D4Ops panel: capacity + readinessSnapshot loads; multi-replica honesty if applicable☐
D5Gateway: /documents list (or /docs list)Opaque ids + titles☐
D6Agent tool document_import on workspace fileReturns document_id; not a path escape☐
D7python scripts/certify_documents.pyoverall_status not FAIL; canary_ready when core parsers ready☐
D8Settings → Documents → change a limit → save → re-readLive ConfigStore update without restart☐
D9(Optional) ClamAV installed → malware_scan on → upload clean fileAccept; readiness malware.available true☐
D10(Optional) PG + KAZMA_DOCUMENTS_METADATA_BACKEND=postgresops/readiness metadata_multi_replica true when pool up☐

Guide: Document Intelligence · Phase map · Ops.


#ActionExpectPass
X1HITL danger tool still promptsApprove/deny works☐
X2Model switch in UINext turn uses selected model☐
X3Long turnHeartbeats / synthesizing; no false “Done 0s” empty bubble☐

FieldValue
Date
Build / commit
Tester
Notes

Related: Recent features guide · Production checklist · Web research · Knowledge library · Document Intelligence · Diagnosis map.