yugabyte/yugabyte-db

[DocDB] Metrics for vector compaction and flush

Closed

#28,578 opened on Sep 15, 2025

View on GitHub
 (2 comments) (0 reactions) (1 assignee)C (1,003 forks)batch import
2025.2 Backport Required2026.1 Backport Requiredarea/docdbgood first issuekind/enhancementpriority/medium

Repository metrics

Stars
 (8,229 stars)
PR merge metrics
 (Avg merge 17d 21h) (92 merged PRs in 30d)

Description

Jira Link: DB-18272

Description

Add metrics for vector compaction and flush related activities

Regular tables update the following compaction metrics:

  • rocksdb_compact_read_bytes
  • rocksdb_compact_write_bytes
  • compaction_tasks
  • rocksdb_compaction_times_micros_sum
  • rocksdb_compaction_times_micros_count

Need to think through the below counts/ Introduce specific counters for vector chunks

  • rocksdb_numfiles_in_singlecompaction_count
  • rocksdb_numfiles_in_singlecompaction_sum

Some of them are relevant to vector indexes. It would be good to update them for vector compactions as well. At the same time, we should add new metrics that describe vector compactions better.

Issue Type

kind/enhancement

Warning: Please confirm that this issue does not contain any sensitive information

  • I confirm this issue does not contain any sensitive information.

Contributor guide

Research direction
Study existing compaction metrics implementation in the codebase, particularly for regular tables, and extend them to vector compaction. Identify where vector compaction logic is handled and add metrics collection for relevant operations.
Tech stack
c
Domain
backenddatabase
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
Half day
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Mostly clear
Prerequisites
C++RocksDBMetrics
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
40