Expose lease health without implying the holder is making progress
A scheduler renews its lease while stuck on one task, so the status page incorrectly reports healthy processing.
- Focused work estimate
- 1h 30m + prerequisites
- Priority in the scenario
- Medium
- Engineering practice
- Observability · Health semantics
Estimated field mix
- Distributed systems50%
- Site reliability50%
Field percentages are editorial estimates of the ticket's engineering focus. They total 100%; they are not measured time, proficiency scores, or ownership evidence.
Review it, then add it to your workspace.
The board opens an editable draft; nothing is saved until you confirm it. Sign-in and workspace permissions apply, and Demo boards remain ephemeral.
Project context
A fictional document service runs periodic retention planning on multiple application instances. Paused instances resume after lease expiry and can overlap newer schedulers.
Setup prerequisites
- Create a synthetic maintenance queue and two independent scheduler clients.
- Use fake time where possible and no destructive real retention actions.
Preceding work
Complete these dependencies, or supply their agreed outputs before taking this ticket.
- ALEASE-101 · Specify scheduler lease state with a separate authority epoch
- ALEASE-102 · Use one authoritative clock boundary for lease decisions
- ALEASE-103 · Classify maintenance actions that require fencing before side effects
- ALEASE-104 · Acquire a scheduler lease atomically under competing instances
- ALEASE-105 · Renew a scheduler lease only for the current holder and epoch
- ALEASE-106 · Fence maintenance writes after a paused scheduler resumes
- ALEASE-107 · Make scheduled maintenance occurrences idempotent across leadership changes
Acceptance criteria
- Report lease authority and work-progress timestamps separately.
- Distinguish no leader, active leader and stalled work.
- Keep unknown progress explicit after observation gaps.
Implementation constraints
- Use safe instance tokens rather than host secrets.
Verification to include
- Show an active progressing scheduler.
- Freeze progress while renewing the lease and show stalled work.
Deliverables
- Scheduler status projection
Rollout and recovery
Add status before alert thresholds; disable noisy alerts while retaining raw safe state.
Value of the work
For the engineer: Practice lease assumptions, fencing and stale-owner rejection.
For the team: Review safe coordination that remains explainable under pauses and recovery.
Evidence boundaries
Outcome Evidence: Tests, patches, and runbooks are requested deliverables. They become Outcome Evidence only through a qualified Mission and immutable Evidence IDs.
Ownership Evidence: Independent adaptation must be observed under a declared verification policy and cite immutable Evidence IDs. Completing a planning ticket establishes no Ownership Evidence.