grafana/loki

Does loki support migrating from one s3 cluster to another

Open

#10,711 opened on Sep 26, 2023

View on GitHub
 (0 comments) (0 reactions) (0 assignees)Go (3,997 forks)batch import
help wantedtype/question

Repository metrics

Stars
 (28,187 stars)
PR merge metrics
 (Avg merge 7d 10h) (312 merged PRs in 30d)

Description

I have a requirement to switch from cluster 1 of s3 to cluster 2 of s3 to ensure that the data of cluster 1 and cluster 2 can be read simultaneously.

From the perspective of configuration format, it seems that I support writing one s3 cluster. How should I write the configuration, or loki does not support writing two s3 clusters at the same time

Contributor guide

Research direction
Investigate Loki's configuration for multiple storage backends and check if there is built in support for reading from two S3 clusters simultaneously. Look at the storage package code for any multi backend support or migration utilities.
Tech stack
go
Domain
backendinfrastructure
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Fresh
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
GitGo
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
75