Preserve source offsets when splitting documentation
Answer citations point to chunks that cannot be located in the original guide.
- Focused work estimate
- 2h 30m + prerequisites
- Priority in the scenario
- Medium
- Engineering practice
- Text processing · Provenance
Estimated field mix
- Data engineering60%
- Applied AI40%
Field percentages are editorial estimates of the ticket's engineering focus. They total 100%; they are not measured time, proficiency scores, or ownership evidence.
Review it, then add it to your workspace.
The board opens an editable draft; nothing is saved until you confirm it. Sign-in and workspace permissions apply, and Demo boards remain ephemeral.
Project context
A fictional internal support team needs answers from product guides. Some guides are outdated or restricted, and fluent unsupported answers would create operational mistakes.
Setup prerequisites
- Author a synthetic document collection with two tenants, conflicting versions, and a deterministic model double; no model account required.
Preceding work
Complete these dependencies, or supply their agreed outputs before taking this ticket.
Acceptance criteria
- Retain source version and character ranges for each chunk.
- Keep headings with their relevant text within configured limits.
- Reject chunks whose ranges exceed the source.
Implementation constraints
- Choose deterministic splitting; do not fabricate missing text.
Verification to include
- Reconstruct cited text from saved offsets.
- Detect altered source content and invalid ranges.
Deliverables
- Chunking pipeline.
Rollout and recovery
Rebuild indexes under a new version; retain the previous complete index for recovery.
Value of the work
For the engineer: Practice retrieval boundaries, citation validation, and deterministic evaluation.
For the team: Create a reviewable assistant prototype with clear refusal, cost, and freshness behavior.
Evidence boundaries
Outcome Evidence: Tests, patches, and runbooks are requested deliverables. They become Outcome Evidence only through a qualified Mission and immutable Evidence IDs.
Ownership Evidence: Independent adaptation must be observed under a declared verification policy and cite immutable Evidence IDs. Completing a planning ticket establishes no Ownership Evidence.