lizzy-0323/oasisdb

test: add benchmarks for OasisDB

Open

#29 opened on Jun 25, 2025

View on GitHub
 (2 comments) (0 reactions) (1 assignee)Go (16 forks)auto 404
good first issuehelp wantedtest

Repository metrics

Stars
 (99 stars)
PR merge metrics
 (PR metrics pending)

Description

We can use dataset to test OasisDB's performance.

What we need to do?

  1. download the dataset
  2. choose algorithm(here we can use hnsw for example)
  3. adjust the parameters to get a graph with recall as horizontal axix, and QPS as the vertical axis.

This is really important to help us to know the OasisDB's capability boundaries.

Contributor guide

Research direction
Set up a benchmark harness in Go using the existing OasisDB library. Download a standard vector dataset, implement HNSW algorithm, and tune parameters to generate a recall vs QPS plot. Focus on the test file structure and measurement accuracy.
Tech stack
go
Domain
database
Issue type
Test
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
2
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
GoGitBasic understanding of benchmarking
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
75