Files
backup-tool/docs/runbooks/observability.md

18 lines
788 B
Markdown

# Observability and alert response
The proxy exposes `/livez`, `/readyz`, and Prometheus text at `/metrics`. Metrics use
no source paths, IDs, credentials, tokens, or secret values. Runtime logs are JSON
records with an event, timestamp, role, and request correlation ID where applicable.
Alert when any of the following remains non-zero or grows:
- `backup_tool_stale_execution_leases`
- `backup_tool_failed_executions`
- `backup_tool_corrupt_backups`
- `backup_tool_unavailable_repositories`
- `backup_tool_schedule_lag_seconds`
Also alert on low `backup_tool_filesystem_free_bytes`. For any alert, preserve logs,
validate `/readyz`, stop the worker before destructive repository investigation, and
use the matching metadata, repository, key, upgrade, or disaster-recovery runbook.