~bigbes/tarantool-etcd · parade

main · last commit 1 month ago · 2npkec0r

← Back to the parade

tarantool-etcd-6js Learner: apply loop — InternalRaftRequest -> existing handlers Lined Up

status: open P2 task milestone:m5-clustering
bd update tarantool-etcd-6js --claim bd close tarantool-etcd-6js
Created byEugene Blikh
Ownerbigbes@gmail.com
Created2026-05-20T06:45:16Z
Updated2026-07-17T14:27:37Z
Description
Drive committed log entries into our storage. For each committed normal Entry: decode etcdserverpb.InternalRaftRequest, dispatch each command to the existing app-side handler via the *_internal (no-own-transaction) variants — put_internal/delete_range_internal, txn, lease grant/revoke, compact, auth mutations — inside one box.begin()/commit() per entry so applied_index advances atomically with the data. CRITICAL: our revision counter must adopt the entry's mod_revision/main-revision rather than allocating locally (revision alignment), so local reads return etcd-consistent revisions and our Watch subsystem (kv_history) reconstructs correct events for downstream clients. Skip/ignore command types we don't model yet, logging a warning, until coverage is complete.
Notes
Revision alignment is the same hard constraint the watch-mirror epic flagged (tarantool-etcd-zws) — but here the authoritative revision is in the log entry, not a Range response. Reuse the on_commit broadcast path (memory feedback_tarantool_trigger_broadcast) so local watchers wake correctly.

Depends on

  • tarantool-etcd-boq — Learner: raft state machine (follower/learner subset) blocks open
  • tarantool-etcd-4yb — Learner: raftpb + InternalRaftRequest proto schemas blocks open
  • tarantool-etcd-cnj — [epic] Raft-learner replica — join an etcd cluster as a non-voting member parent-child open

Depended on by

  • tarantool-etcd-q5f — Learner: snapshot receive (bbolt parse + bucket translation) blocks
  • tarantool-etcd-ovo — Learner: durable applied_index (WAL-equivalent for restart) blocks
  • tarantool-etcd-zkg — Learner: conformance — join real etcd cluster, assert log replication blocks

Prerequisite chain — everything this waits on, transitively

  • tarantool-etcd-boq — Learner: raft state machine (follower/learner subset) blocks open
  • tarantool-etcd-axs — Learner: rafthttp peer transport over nghttp2 blocks open
  • tarantool-etcd-umc — Learner: config block + role plumbing blocks open
  • tarantool-etcd-cnj — [epic] Raft-learner replica — join an etcd cluster as a non-voting member parent-child open
  • tarantool-etcd-7ey — Replica route: connect as read-only replica to an existing etcd cluster related open
  • tarantool-etcd-16d — Implement Maintenance.Snapshot RPC (streaming DB snapshot) related open
  • tarantool-etcd-4yb — Learner: raftpb + InternalRaftRequest proto schemas blocks open

Unblocks — everything waiting on this, transitively

  • tarantool-etcd-q5f — Learner: snapshot receive (bbolt parse + bucket translation) blocks open
  • tarantool-etcd-zkg — Learner: conformance — join real etcd cluster, assert log replication blocks open
  • tarantool-etcd-ovo — Learner: durable applied_index (WAL-equivalent for restart) blocks open

No comments.

  • Eugene Blikh created the issue · 2026-05-20T09:45:15Z
  • Eugene Blikh tarantool-etcd-q5f now depends on this · 2026-05-20T09:47:29Z
  • Eugene Blikh tarantool-etcd-ovo now depends on this · 2026-05-20T09:47:29Z
  • Eugene Blikh tarantool-etcd-zkg now depends on this · 2026-05-20T09:47:29Z
  • Eugene Blikh added dependency on tarantool-etcd-boq · 2026-05-20T09:47:29Z
  • Eugene Blikh added dependency on tarantool-etcd-4yb · 2026-05-20T09:47:29Z
  • Eugene Blikh added under epic tarantool-etcd-cnj · 2026-05-20T09:47:29Z
  • Eugene Blikh added label milestone:m5-clustering · 2026-05-21T14:37:38Z
Stored rows — what this pane was built from, as read
issues 1 row
id tarantool-etcd-6js
content_hash 6d5e7ff300f1cf1c4ed13261a9a4d20f53c41d1e464d039968328c85fc381326
title Learner: apply loop — InternalRaftRequest -> existing handlers
description Drive committed log entries into our storage. For each committed normal Entry: decode etcdserverpb.InternalRaftRequest, dispatch each command to the existing app-side handler via the *_internal (no-own-transaction) variants — put_internal/delete_range_internal, txn, lease grant/revoke, compact, auth mutations — inside one box.begin()/commit() per entry so applied_index advances atomically with the data. CRITICAL: our revision counter must adopt the entry's mod_revision/main-revision rather than allocating locally (revision alignment), so local reads return etcd-consistent revisions and our Watch subsystem (kv_history) reconstructs correct events for downstream clients. Skip/ignore command types we don't model yet, logging a warning, until coverage is complete.
design
acceptance_criteria
notes Revision alignment is the same hard constraint the watch-mirror epic flagged (tarantool-etcd-zws) — but here the authoritative revision is in the log entry, not a Range response. Reuse the on_commit broadcast path (memory feedback_tarantool_trigger_broadcast) so local watchers wake correctly.
status open
priority 2
issue_type task
assignee NULL
estimated_minutes NULL
created_at 2026-05-20T06:45:16Z
created_by Eugene Blikh
owner bigbes@gmail.com
updated_at 2026-07-17T14:27:37Z
closed_at NULL
closed_by_session
external_ref NULL
spec_id
compaction_level 0
compacted_at NULL
compacted_at_commit NULL
original_size NULL
sender
ephemeral 0
wisp_type
pinned 0
is_template 0
mol_type
work_type
source_system
metadata <binary>
source_repo
close_reason
event_kind
actor
target
payload
await_type
await_id
timeout_ns 0
waiters
hook_bead
role_bead
agent_state
last_activity NULL
role_type
rig
due_at NULL
defer_until NULL
no_history 0
started_at NULL
is_blocked 1
labels 1 row
issue_id tarantool-etcd-6js
label milestone:m5-clustering
dependencies 6 rows
id 180d56bc-568d-5b7c-910c-cd894fca5bdd
issue_id tarantool-etcd-q5f
type blocks
created_at 2026-05-20T09:47:29Z
created_by Eugene Blikh
metadata <binary>
thread_id
depends_on_issue_id tarantool-etcd-6js
depends_on_wisp_id NULL
depends_on_external NULL
id 21eff322-baea-5777-96c0-aa1d9ecc0c8a
issue_id tarantool-etcd-ovo
type blocks
created_at 2026-05-20T09:47:29Z
created_by Eugene Blikh
metadata <binary>
thread_id
depends_on_issue_id tarantool-etcd-6js
depends_on_wisp_id NULL
depends_on_external NULL
id 29587e21-8ef8-5670-a9b2-7fda202453e1
issue_id tarantool-etcd-zkg
type blocks
created_at 2026-05-20T09:47:29Z
created_by Eugene Blikh
metadata <binary>
thread_id
depends_on_issue_id tarantool-etcd-6js
depends_on_wisp_id NULL
depends_on_external NULL
id 4b460be3-cfb4-5c67-adef-70c73e85ef71
issue_id tarantool-etcd-6js
type blocks
created_at 2026-05-20T09:47:29Z
created_by Eugene Blikh
metadata <binary>
thread_id
depends_on_issue_id tarantool-etcd-boq
depends_on_wisp_id NULL
depends_on_external NULL
id c9094a55-23fe-55e2-b7f1-555fa5deb32b
issue_id tarantool-etcd-6js
type blocks
created_at 2026-05-20T09:47:29Z
created_by Eugene Blikh
metadata <binary>
thread_id
depends_on_issue_id tarantool-etcd-4yb
depends_on_wisp_id NULL
depends_on_external NULL
id d6b0eb2c-9583-5791-9b8e-1de69b956d02
issue_id tarantool-etcd-6js
type parent-child
created_at 2026-05-20T09:47:29Z
created_by Eugene Blikh
metadata <binary>
thread_id
depends_on_issue_id tarantool-etcd-cnj
depends_on_wisp_id NULL
depends_on_external NULL
events 2 rows
id f818cea8-4f11-58a8-8d4d-7d8dd9f31f73
issue_id tarantool-etcd-6js
event_type label_added
actor Eugene Blikh
old_value NULL
new_value NULL
comment Added label: milestone:m5-clustering
created_at 2026-05-21T14:37:38Z
id fa8820da-f652-52d9-b51f-d1bc3b91188c
issue_id tarantool-etcd-6js
event_type created
actor Eugene Blikh
old_value
new_value
comment NULL
created_at 2026-05-20T09:45:15Z