Michael supplied the authoritative July 6 DOCX for Cradle of the Empire. Its SHA-256 is
81d172186475e8f9a63070ceacb85cac0ffb411159b02cf4acc59fb78eedc3b8. The deterministic
preparation is active and verified: 36 Markdown documents, 910 total chunks, 34 Heading 1
sections, and 629 resolved footnotes. The owner has since settled an Introduction-first retrieval
and evaluation boundary: 01_Front Matter.md, 02_Table of Contents.md,
03_Acknowledgments.md, and 04_Note on Illustrations.md are excluded, along with documents
matched by the 32_Bibliography.md sentinel under substring matching. This leaves 481
retrieval-eligible chunks and seven skipped documents; the Epilogue, Afterword, and appendices
remain in scope.
The supplied 594-page typeset PDF is now the first edition-locator authority. Its SHA-256 is
89d68cdc186432d4d4804fbaff6aac0deb599d351dd016fe250b25f2a4771b3f. A read-only feasibility
pilot found at least two exact 12-token PDF anchors for every one of the 481 eligible chunks:
39 preliminary spans covered one physical page, 360 covered two, 76 covered three, and 6 covered
four. The PDF uses Roman-numbered front matter (the Introduction begins on xi) and restarts
Arabic numbering at the Prologue; public citations must therefore say
Typeset PDF (July 6, 2026), p./pp. ..., never present a bare page number. This mapping is
presentation metadata over the current DOCX corpus, not a claim that the two files are identical.
At the initial July 6 activation, after explicit owner authorization, the 488 chunks then eligible
under the earlier scope were embedded with
text-embedding-3-small in 10 calls totaling 215,381 tokens. Archivist's local ledger estimates
the indexing cost at $0.00430762. That historical cost remains unchanged. The active
Introduction-first collection reuses 481 of those vectors, made no new embedding API calls, uses
explicit L2 distance, and matches the current text-free corpus manifest, whose SHA-256 is
b7ff94315a3f1f28c831e2c3ca62c385567d2b1447c19ff45139d175c3ff3c17.
The former April reader corpus remains recoverable under
old_manuscript/snapshots/2026-04-active-before-0706/; a second pre-promotion holding copy is
retained under runtime/corpus-staging/0706/replaced-active/. The shared Chroma store's nine
non-reader collections were preserved with identical records and metadata. The immediately
preceding 488-vector store and its manifest remain recoverable under
runtime/corpus-staging/introduction-scope-20260723/replaced-active/.
Current built-in RAG uses retrieval-authored-v5. High-confidence follow-up resolution is local.
Every historical/manuscript RAG turn makes one text-embedding-3-small query request, then uses the shared dense/BM25
reciprocal-rank-fusion retriever and context finalizer. A deterministic builder packages four to
eight source-bound units in retrieval order, targeting about 2,500 estimated evidence tokens under
a hard 4,500-token evidence ceiling. It preserves whole chunks whenever possible and otherwise
uses only a range of complete paragraphs.
Essential returns direct cited evidence without a prose-generation call, but it is not
providerless because it uses the embedding request. Every registered generated mode -- currently
Professional, Pretty Pink Princess, Baleful Black Baron, and Ruthless Red Realist -- adds exactly
one no-retry gpt-5.6-sol authored-response call with low reasoning and medium verbosity. The
existing QuestionPlan selects one closed answer-length profile. Ordinary questions target
500-700 reader-visible answer tokens with a 1,800-token API ceiling; questions carrying
BROAD_SYNTHESIS target 900-1,100 with a 2,400-token ceiling. Targets are advisory and never
authorize padding, repetition, or invention; concise special dispositions may be shorter. The
model may synthesize, paraphrase, and write in character. It returns typed grounded/persona runs
and one to three follow-up questions. Grounded runs name opaque dossier-unit IDs; local code
verifies those IDs and maps them to [Source N]. Input schema
archivist.authored_response_input/2 carries the profile; output schema
archivist.retrieval_authored_answer/1, renderer retrieval-authored-renderer-v1, one shared
client, and zero retries remain unchanged. The provider allowance is 35 seconds, with embedding capped at
eight seconds and authoring at thirty. Timeout, transport failure, provider exception/refusal,
structured-output rejection, or local contract-validation failure falls back to Essential without
retry and receives a text-free internal code. ID resolution is not proof of semantic entailment.
Before corpus loading, product-help-v1 answers a closed set of direct product-purpose and how-to
questions with fixed local copy. It works in every reader mode, makes no provider call, returns no
sources, and remains available without spend headroom. Historical, manuscript, compound,
multiline, and contextual near-misses continue to the grounded path.
Before that path, is_character_conversation_question(question, mode) recognizes a narrow set of
direct social/personal turns in every registered generated mode.
character-conversation-v3 sends just the question, selected character, and instructions to one
no-retry gpt-5.6-sol answer_generation call with low reasoning, low verbosity, a 12-second
timeout, and a 576-token
ceiling. It sends no conversation history, embedding, manuscript text, retrieval result, dossier,
source metadata, or citation. Its character_reply is fictional persona material and must end
with one to three explicit manuscript-leading questions. Provider failure, refusal, or invalid
output uses deterministic local dialogue for that character instead of Essential. Mixed,
historical, manuscript, Essential, and uncertain turns stay on the grounded path. Registry-derived
eligibility covers Professional, Princess, Baron, and Ruthless Red Realist now and future generated
modes automatically; Essential is excluded.
The current source reports this boundary through archivist.public_runtime_identity/4, including
answer_policy_version=retrieval-authored-v5, evidence_retrieval_kind=hybrid_bm25_rrf,
embedding_model=text-embedding-3-small, and generated_prose_model=gpt-5.6-sol. Frozen V26 and
the V27 experiment remain explicit development API compatibility policies; neither is selectable
in the reader UI. Results from their historical cohorts, and the narrow smoke for superseded
application-compiled-v1, do not measure the current product. Manual deployment and live identity
parity for this redesign remain unverified.
retrieval-authored-v1 lacked the narrow character-conversation branch; retrieval-authored-v2
hard-coded that branch for Princess and Baron; v3 generalized it but used the shorter authoring
boundary; and v4 retained one fixed 1,800-token authoring ceiling. All four are preserved as
historical/manual development or sealed evaluation identities rather than exposed as API
policies.
As of August 6, the active retrieval path was evidence-planned-v26, with query-planner-v11 and
evidence-coverage-v11. The familiar ten-question cohort was development data: it helped shape the
system and could not establish a held-out quality claim. On August 6 the owner completed and
mechanically cleaned a private 38-item held-out workbook spanning all six contracted strata; H020
was replaced and all 570 recorded chunk references were found in the frozen inventory. The
candidate remained held while one explicitly documented H039 reading was settled, the workbook was
converted to canonical private JSON, and the cohort was provenance-locked under
EVAL_CONTRACT.md. The practical standard preserves realistic user wording, treats claims as
independently scorable rubric units, permits materially useful background, bounds optional
must_not_claim tripwires, and records source-verified owner adoption or revision through
archivist.gold_provenance/3.
That work was subsequently completed and is preserved in the frozen evaluation record. This dated snapshot is not the current product architecture or current next-step list.
Current historical/manuscript RAG uses text-embedding-3-small for exactly one query-embedding request in every mode.
The four generated modes add gpt-5.6-sol with explicit low reasoning, medium verbosity, adaptive
ordinary/broad output guidance and corresponding 1,800/2,400-token API ceilings, and no automatic
retry. Essential omits that prose-generation call. The
current high-confidence follow-up resolver, fusion, and dossier builder are local. Narrow
Social turns in any registered generated mode instead make one compact Sol call and no embedding
or retrieval call.
This interactive authored-response configuration is not a formal evaluation result or a
retrospective pin for V26. Model identities, settings, prompt hashes, and dossier identity for a
future retrieval-authored-v5 measurement belong in that separately declared cohort's run
identity.
The bounded product latency smoke is a separate three-question, non-gold first-turn check of this full current path. Building or preparing it makes no provider call. A live run needs its own exact authorization, never retries, and reports only its three observations plus minimum, median, and maximum. It is not a p95 estimate, quality evaluation, SLA, or substitute for a declared cohort.
The reader-facing interface is being treated separately from retrieval quality. It supports a
multi-turn transcript, local contextual follow-up resolution, and exactly five selectable modes:
Professional, Essential, Pretty Pink Princess, Baleful Black Baron, and Ruthless Red Realist.
Professional is the new-visitor frontend default. Only their five matching appearances are selectable. Historical
mode IDs, profiles, definitions, and visual assets remain dormant for compatibility; they are not
offered by the current UI or public API. Their provenance records remain in
docs/archivist_modes.md.
Essential renders locally compiled direct evidence. In the other four modes the one optional model call authors reader-visible prose over the rich dossier, including one to three follow-up questions. Local code maps support IDs to citations. A timeout, transport failure, provider exception/refusal, structured-output rejection, or local contract-validation failure returns the Essential evidence rather than replaying the call; the internal class is text-free and the reader notice remains generic.
Eligible personal questions in any registered generated mode use the separate character-conversation route and therefore return no source panel or citations. Their deterministic failure fallback stays in character and still leads into the manuscript; it does not display the Essential-fallback notice.
The composer displays a Perspective note above the input and labels its collapsed disclosure Settings. Evidence scope remains separate from interpretation. The independent Historiographical lens, Voice, and Worldview selectors now sit under Advanced interpretive settings, together with an explicitly appearance-only selector limited to the same four appearances. A custom value applies to future turns, while each completed turn and retry retains its resolved mode and facets. The selected settings shape generated framing and prose but cannot widen the dossier or make an influence source historical evidence. No V26/V27 policy or latency selector appears in the UI. Any advanced facet or appearance override makes the active top-right and Settings-panel label exactly Custom. The explanation names the base preset because its character/influence remains active. An appearance-only override says explicitly that the underlying perspective is unchanged; completed-turn badges retain “{Preset} · Custom” for provenance.
Complete answer is the recommended fail-closed delivery default. Progressive response is an experimental Advanced setting. Essential may release locally compiled direct evidence before the terminal result. Generated prose remains terminal because support-ID validation is structural, not a semantic proof. Generated modes use the same one authored-response call as Complete answer, not an additional call. It is not chain-of-thought and is not the formal evaluation presentation.
The public demo at https://archivist.mcrombie.com searches the same complete 481-chunk
substantive corpus as local development.
The earlier representative-subset proposal is superseded. Manuscript protection moves to the
response boundary: the full corpus and Chroma index remain private on the server, while public
source cards expose edition-qualified locators and only brief, server-bounded quotations.
Local development retains the current full-passage source display because it is useful for diagnosing retrieval and citation failures. The public/development distinction is a server startup profile and cannot be selected by the browser. Public mode also removes the local upload, embedding, source-browser, source-file, index, mutable-budget, and budget-override surfaces.
Locator metadata is edition-specific and keyed by stable chunk ID. The first profile is
typeset_pdf_0706; later paperback, hardcover, and ebook profiles can be added without rebuilding
embeddings or changing retrieval. Ebook profiles may use locations or sections rather than pages.
See docs/public_demo_design.md for the source DTO, preliminary excerpt budget, mapping acceptance
criteria, and Cromblog integration gate.
The app is hosted as the Render service archivist-cradle-of-the-empire; its generated
onrender.com address remains enabled as a fallback. Cloudflare supplies a DNS-only archivist
CNAME, Render owns certificate issuance for the custom domain, and Cromblog's Vercel Production
environment points NEXT_PUBLIC_ARCHIVIST_URL at the canonical address.
The first live public-answer test found a boundary mismatch rather than a RAG failure. Public mode
correctly omitted private run_diagnostics, but the frontend treated that object as required and
crashed after the response arrived. Commit 1dd45aa made the public-only response fields optional,
guarded their reads, and moved the stored-vibe initializer into the CSP-compliant bundle. Public
payload omission and frontend optional handling are now paired release checks.