Skip to content

Export/Import V2 & Dynamic Filter Support | Greptime Biweekly Report - No. 79

New `export import v2` feature enables data migration between clusters. Queries with dynamic filters run faster through `dyn filter` optimization.
Export/Import V2 & Dynamic Filter Support | Greptime Biweekly Report - No. 79
On this page

Summary ​

Development period: 2026-03-09 - 2026-03-22

Recent highlights:

  • New export import v2 feature for data migration between clusters
  • dyn filter optimization speeds up queries with dynamic filters
  • Unified flush and compaction for metric table storage

If you're on an older version, it's worth upgrading.

Contributors ​

Over the past two weeks, 15 contributors merged 43 PRs. 3 individual contributors made 3 PRs. Welcome new contributor @maximk777!

Individual contributors:

Highlights of Recent PRs ​

db#7785 feat: export import v2 pr1 ​

Adds the export-v2 and import-v2 commands with snapshot manifest and schema metadata handling. Initial support for DDL export/import over URI-based storage backends.

db#7754 test(fuzz): add metric table repartition fuzz target ​

New fuzz tests for metric table repartition operations. These cover edge cases where partition reorganization under load could cause data corruption or query failures.

db#7545 feat: use dyn filter ​

Pushes dynamic filters from sort operators down to region scanners, so ORDER BY ... LIMIT queries on non-indexed timestamp columns skip unnecessary data reads. In one benchmark, a 28-second query dropped to 0.2 seconds — roughly 700x faster.

db#7799 refactor: unify flush and compaction to always use FlatSource ​

Flush and compaction now share a single Arrow RecordBatch processing path. This removes duplicate code paths that could produce inconsistent SST file generation.

db#7797 fix: rm useless analyzer ​

Removed unnecessary query analyzers from the flow query pipeline that were causing bugs.

Good First Issue ​

Issue#7755 Feature request: Support EKS Pod Identity / ECS container credentials endpoint for S3 object storage ​

Upgrade GreptimeDB's OpenDAL dependency to enable S3 authentication via EKS Pod Identity and ECS container credentials endpoint.

  • Keywords: Storage, Dependencies
  • Difficulty: Easy

Issue#7544 Allow ALTER TABLE to modify the skip_wal option dynamically ​

Implement support for dynamically modifying the skip_wal table option through ALTER TABLE SET statements, allowing users to toggle WAL on or off at runtime.

  • Keywords: SQL parser, Storage, WAL
  • Difficulty: Medium

Stay in the loop

Join our community