~bigbes/tarantool-etcd · parade

main · last commit 1 month ago · 2npkec0r

← Back to the parade

tarantool-etcd-huo etcd /metrics compatibility — match upstream Prometheus metric names + endpoint Lined Up

status: open P2 feature milestone:m2-production
bd update tarantool-etcd-huo --claim bd close tarantool-etcd-huo
Created byEugene Blikh
Ownerbigbes@gmail.com
Created2026-05-20T19:08:45Z
Updated2026-07-17T11:31:01Z
Description
Expose a Prometheus /metrics endpoint whose metric names, label sets, and types match upstream etcd's, so existing etcd Grafana dashboards, recording rules, and alerts work unchanged against tarantool-etcd. This is the compatibility layer on top of the underlying metrics integration (tarantool-etcd-unw): map our collected operational stats onto etcd's canonical series — e.g. etcd_server_has_leader, etcd_server_leader_changes_seen_total, etcd_mvcc_db_total_size_in_bytes, etcd_server_proposals_committed_total, grpc_server_handled_total{grpc_method,grpc_code}, etcd_network_peer_round_trip_time_seconds, etcd_debugging_mvcc_keys_total, etc. Scope to nail down: which series are meaningful for a Tarantool backend vs which must be emitted as constants/stubs to satisfy dashboards, the /metrics text-format exposition path (does it ride the JSON gateway or a dedicated listener), and a conformance check that scrapes both real etcd and tarantool-etcd and diffs the metric name/label surface.
Notes
etcd 3.7 metric surface additions (from the 3.7.0 announcement) — fold into the name/label diff, and note that the diff must be taken against a 3.7 scrape once tarantool-etcd-cc7 bumps the conformance backend off 3.6:

- etcd_server_request_duration_seconds (new, non-debugging — likely dashboard-relevant)
- etcd_debugging_server_watch_send_loop_watch_stream_duration_seconds
- etcd_debugging_server_watch_send_loop_watch_stream_duration_per_event_seconds
- etcd_debugging_server_watch_send_loop_control_stream_duration_seconds
- etcd_debugging_server_watch_send_loop_progress_duration_seconds

The four watch send-loop series are etcd_debugging_* and describe upstream's internal watch send loop, which our watch.lua (fiber.cond + kv_history catch-up) has no structural analogue for — candidates for the 'stub or omit' bucket rather than the 'map' bucket.

Depends on

Depended on by

Nothing depends on this issue.

No comments.

  • Eugene Blikh created the issue · 2026-05-20T22:08:44Z
  • Eugene Blikh added dependency on tarantool-etcd-unw · 2026-05-20T22:08:51Z
  • Eugene Blikh added label milestone:m2-production · 2026-05-21T14:37:05Z
  • Eugene Blikh updated notes to etcd 3.7 metric surface additions (from the 3.7.0 announcement) — fold into the name/label diff, and note that the diff must be taken against a 3.7 scrape once tarantool-etcd-cc7 bumps the conformance backend off 3.6: - etcd_server_request_duration_seconds (new, non-debugging — likely dashboard-relevant) - etcd_debugging_server_watch_send_loop_watch_stream_duration_seconds - etcd_debugging_server_watch_send_loop_watch_stream_duration_per_event_seconds - etcd_debugging_server_watch_send_loop_control_stream_duration_seconds - etcd_debugging_server_watch_send_loop_progress_duration_seconds The four watch send-loop series are etcd_debugging_* and describe upstream's internal watch send loop, which our watch.lua (fiber.cond + kv_history catch-up) has no structural analogue for — candidates for the 'stub or omit' bucket rather than the 'map' bucket. · 2026-07-17T14:31:00Z
Stored rows — what this pane was built from, as read
issues 1 row
id tarantool-etcd-huo
content_hash 96dcd8d31ebf9f5f56da997ac7d459e417b024ed5bd339a4a5c33c469b4e96c1
title etcd /metrics compatibility — match upstream Prometheus metric names + endpoint
description Expose a Prometheus /metrics endpoint whose metric names, label sets, and types match upstream etcd's, so existing etcd Grafana dashboards, recording rules, and alerts work unchanged against tarantool-etcd. This is the compatibility layer on top of the underlying metrics integration (tarantool-etcd-unw): map our collected operational stats onto etcd's canonical series — e.g. etcd_server_has_leader, etcd_server_leader_changes_seen_total, etcd_mvcc_db_total_size_in_bytes, etcd_server_proposals_committed_total, grpc_server_handled_total{grpc_method,grpc_code}, etcd_network_peer_round_trip_time_seconds, etcd_debugging_mvcc_keys_total, etc. Scope to nail down: which series are meaningful for a Tarantool backend vs which must be emitted as constants/stubs to satisfy dashboards, the /metrics text-format exposition path (does it ride the JSON gateway or a dedicated listener), and a conformance check that scrapes both real etcd and tarantool-etcd and diffs the metric name/label surface.
design
acceptance_criteria
notes etcd 3.7 metric surface additions (from the 3.7.0 announcement) — fold into the name/label diff, and note that the diff must be taken against a 3.7 scrape once tarantool-etcd-cc7 bumps the conformance backend off 3.6: - etcd_server_request_duration_seconds (new, non-debugging — likely dashboard-relevant) - etcd_debugging_server_watch_send_loop_watch_stream_duration_seconds - etcd_debugging_server_watch_send_loop_watch_stream_duration_per_event_seconds - etcd_debugging_server_watch_send_loop_control_stream_duration_seconds - etcd_debugging_server_watch_send_loop_progress_duration_seconds The four watch send-loop series are etcd_debugging_* and describe upstream's internal watch send loop, which our watch.lua (fiber.cond + kv_history catch-up) has no structural analogue for — candidates for the 'stub or omit' bucket rather than the 'map' bucket.
status open
priority 2
issue_type feature
assignee NULL
estimated_minutes NULL
created_at 2026-05-20T19:08:45Z
created_by Eugene Blikh
owner bigbes@gmail.com
updated_at 2026-07-17T11:31:01Z
closed_at NULL
closed_by_session
external_ref NULL
spec_id
compaction_level 0
compacted_at NULL
compacted_at_commit NULL
original_size NULL
sender
ephemeral 0
wisp_type
pinned 0
is_template 0
mol_type
work_type
source_system
metadata <binary>
source_repo
close_reason
event_kind
actor
target
payload
await_type
await_id
timeout_ns 0
waiters
hook_bead
role_bead
agent_state
last_activity NULL
role_type
rig
due_at NULL
defer_until NULL
no_history 0
started_at NULL
is_blocked 1
labels 1 row
issue_id tarantool-etcd-huo
label milestone:m2-production
dependencies 1 row
id a1b22d76-e1e3-5cb6-91c1-7a5f542192aa
issue_id tarantool-etcd-huo
type blocks
created_at 2026-05-20T22:08:51Z
created_by Eugene Blikh
metadata <binary>
thread_id
depends_on_issue_id tarantool-etcd-unw
depends_on_wisp_id NULL
depends_on_external NULL
events 3 rows
id 019f6fd8-1773-71e8-875a-6bd0a3199953
issue_id tarantool-etcd-huo
event_type updated
actor Eugene Blikh
old_value {"id":"tarantool-etcd-huo","title":"etcd /metrics compatibility — match upstream Prometheus metric names + endpoint","description":"Expose a Prometheus /metrics endpoint whose metric names, label sets, and types match upstream etcd's, so existing etcd Grafana dashboards, recording rules, and alerts work unchanged against tarantool-etcd. This is the compatibility layer on top of the underlying metrics integration (tarantool-etcd-unw): map our collected operational stats onto etcd's canonical series — e.g. etcd_server_has_leader, etcd_server_leader_changes_seen_total, etcd_mvcc_db_total_size_in_bytes, etcd_server_proposals_committed_total, grpc_server_handled_total{grpc_method,grpc_code}, etcd_network_peer_round_trip_time_seconds, etcd_debugging_mvcc_keys_total, etc. Scope to nail down: which series are meaningful for a Tarantool backend vs which must be emitted as constants/stubs to satisfy dashboards, the /metrics text-format exposition path (does it ride the JSON gateway or a dedicated listener), and a conformance check that scrapes both real etcd and tarantool-etcd and diffs the metric name/label surface.","status":"open","priority":2,"issue_type":"feature","owner":"bigbes@gmail.com","created_at":"2026-05-20T19:08:45Z","created_by":"Eugene Blikh","updated_at":"2026-07-17T14:27:37Z","labels":["milestone:m2-production"]}
new_value {"notes":"etcd 3.7 metric surface additions (from the 3.7.0 announcement) — fold into the name/label diff, and note that the diff must be taken against a 3.7 scrape once tarantool-etcd-cc7 bumps the conformance backend off 3.6:\n\n- etcd_server_request_duration_seconds (new, non-debugging — likely dashboard-relevant)\n- etcd_debugging_server_watch_send_loop_watch_stream_duration_seconds\n- etcd_debugging_server_watch_send_loop_watch_stream_duration_per_event_seconds\n- etcd_debugging_server_watch_send_loop_control_stream_duration_seconds\n- etcd_debugging_server_watch_send_loop_progress_duration_seconds\n\nThe four watch send-loop series are etcd_debugging_* and describe upstream's internal watch send loop, which our watch.lua (fiber.cond + kv_history catch-up) has no structural analogue for — candidates for the 'stub or omit' bucket rather than the 'map' bucket."}
comment NULL
created_at 2026-07-17T14:31:00Z
id 1efb78c9-f246-53ef-b807-43cdc05c2fac
issue_id tarantool-etcd-huo
event_type label_added
actor Eugene Blikh
old_value NULL
new_value NULL
comment Added label: milestone:m2-production
created_at 2026-05-21T14:37:05Z
id 68676f1e-a252-58c1-bbca-ef85611b030c
issue_id tarantool-etcd-huo
event_type created
actor Eugene Blikh
old_value
new_value
comment NULL
created_at 2026-05-20T22:08:44Z