Blog | GreptimeDB Documentation

v0.15.1

2025年7月5日 · 阅读需 1 分钟

Release date: July 05, 2025

🐛 Bug Fixes

fix: add backward compatibility for SkippingIndexOptions deserialization by @zhongzc in #6458
fix: filter empty batch in bulk insert api by @v0y4g3r in #6459

All Contributors

We would like to thank the following contributors from the GreptimeDB community:

@v0y4g3r, @zhongzc

v0.15.0

2025年7月4日 · 阅读需 17 分钟

Release date: July 04, 2025

It is recommended to upgrade to v0.15.1

👍 Highlights

Process Management: Implements complete process management system with ProcessManager, information_schema.process_list table, process killing functionality, and MySQL client Ctrl+C support for query termination (#5865, #6309, #6320).
Bulk Insert Performance: Introducing SimpleBulkMemtable for tables without primary keys to accelerate bulk write operations (#6054).
Partition Rule Checker: Introduces a robust point matrix-based partition rule checker that ensures completeness and uniqueness, eliminating false negatives and providing better error messages with specific uncovered/overlapped value ranges (#6431).
Pipeline Integration: Adds pipeline support for Prometheus remote write and Loki API (#5981, #6390).
VRL Processing: Introduces Vector Remap Language (VRL) processor for advanced data transformation within pipelines, allowing users to write VRL scripts for flexible data processing (#6205).

Breaking changes

fix!: disable append mode in trace services table by @zyy17 in #6066
feat!: revise compaction picker by @v0y4g3r in #6121
refactor(cli)!: reorganize cli subcommands by @paomian in #6265
feat!: point matrix based partition rule checker by @waynexia in #6431

🚀 Features

feat: introduce RegionStatAwareSelector trait by @WenyXu in #5990
feat: uddsketch_merge udaf by @discord9 in #5992
feat: remove own greatest fn by @killme2008 in #5994
feat: flush leader region before downgrading by @WenyXu in #5995
feat: implement batch region opening in metric engine by @WenyXu in #6017
feat: enhance maintenance mode API and handling by @WenyXu in #6022
feat: optimize region migration concurrency with fine-grained table lock by @WenyXu in #6023
feat(pipeline): auto transform by @shuiyisong in #6013
feat: cast strings to numerics automatically in mysql connections by @evenyag in #6015
feat(meta): enhance region lease handling with operating status by @WenyXu in #6027
feat: bridge bulk insert by @v0y4g3r in #5927
feat(pipeline): select processor by @shuiyisong in #6019
feat: flow add static user/pwd auth by @discord9 in #6048
feat: try cast timestamp types from number string by @waynexia in #6060
feat: scan with sst minimal sequence by @MichaelScofield in #6051
feat: update pgwire to 0.29 by @sunng87 in #6058
feat: impl bulk memtable and bridge bulk inserts by @v0y4g3r in #6054
feat: set read-preference for grpc client by @MichaelScofield in #6069
feat: mem prof can gen flamegraph directly by @discord9 in #6073
feat: add datanode workloads support by @WenyXu in #6055
feat: implement PlainBatch struct by @evenyag in #6079
feat(meta): add pusher deregister signal to mailbox receiver by @WenyXu in #6072
feat: implement commutativity rule for prom-related plans by @waynexia in #5875
feat(bulk): write to multiple time partitions by @v0y4g3r in #6086
feat: don't hide atomic write dir by @waynexia in #6109
feat: New scanner SeriesScan to scan by series for querying metrics by @evenyag in #5968
feat: export to s3 add more options by @discord9 in #6091
feat: Prometheus remote write with pipeline by @shuiyisong in #5981
feat: implement clamp_min and clamp_max by @waynexia in #6116
feat: introduce index result cache by @zhongzc in #6110
feat: accommodate default column name with pre-created table schema by @waynexia in #6126
feat: update dashboard to v0.9.1 by @ZonaHex in #6132
feat: support altering multiple logical table in one remote write request by @waynexia in #6137
feat: update dashboard to v0.9.2 by @ZonaHex in #6140
feat(flow): support prom ql(in tql) in flow by @discord9 in #6063
feat: add CLI tool to export metadata by @paomian in #6150
feat: support parsing trigger create sql by @fengys1996 in #6197
feat: supports @@session.time_zone for mysql by @killme2008 in #6210
feat(wal): support bulk wal entries by @v0y4g3r in #6178
feat(http): lossy string validation in prom remote write by @v0y4g3r in #6213
feat: update pgwire to 0.30 by @sunng87 in #6209
feat: support SQL parsing for trigger show by @fengys1996 in #6217
feat: supports select @@session.time_zone by @killme2008 in #6212
feat: bloom filter index applier support or eq chain by @zhongzc in #6227
feat: pipeline with insert options by @shuiyisong in #6192
feat: add trigger ddl manager by @fengys1996 in #6228
feat(flow): flow streaming mode in list expr support by @discord9 in #6229
feat: don't allow creating logical table with partitions by @waynexia in #6249
feat(pipeline): vrl processor by @shuiyisong in #6205
feat: add the gauge to indicate the CPU and Memory limit in the cgroups environment by @zyy17 in #6238
feat: Support export cli export to OSS by @zqr10159 in #6225
feat: add some metasrv metrics to grafana dashboard by @WenyXu in #6264
feat: disable compression for do_get API by @v0y4g3r in #6254
feat: refactor grpc options of metasrv by @fengjiachun in #6275
feat(cli): add metadata get commands by @WenyXu in #6299
feat: implement process manager and information_schema.process_list by @v0y4g3r in #5865
feat: support using expressions as literal in PromQL by @waynexia in #6297
feat: introduce file group in compaction by @v0y4g3r in #6261
feat: organize EXPLAIN ANALYZE VERBOSE's output in JSON format by @waynexia in #6308
feat: parallelism hint in grpc by @discord9 in #6306
feat: process id for session, query context and postgres by @sunng87 in #6301
feat: update dashboard to v0.9.3 by @ZonaHex in #6311
feat: support killing process by @v0y4g3r in #6309
feat: bulk support flow batch by @v0y4g3r in #6291
feat: support arbitrary constant expression in PromQL function by @waynexia in #6315
feat: support special labels parsing in prom remote write by @shuiyisong in #6302
feat: handle Ctrl-C command in MySQL client by @v0y4g3r in #6320
feat: Add DROP DEFAULT by @linyihai in #6290
feat: introduce CLI tool for repairing logical table metadata by @WenyXu in #6322
feat: support setting FORMAT in TQL ANALYZE/VERBOSE by @waynexia in #6327
feat(cli): add metadata del commands by @WenyXu in #6339
feat: support execute sql in frontend_client by @fengys1996 in #6355
feat: dist auto step aggr pushdown by @discord9 in #6268
feat(storage): Add skip_ssl_validation option for object storage HTTP client by @rgidda in #6358
feat: update dashboard to v0.10.0 by @ZonaHex in #6368
feat(pipeline): introduce pipeline doc version 2 for combine-transform by @shuiyisong in #6360
feat: supports CsvWithNames and CsvWithNamesAndTypes formats by @killme2008 in #6384
feat: introduce /v1/health for healthcheck from external by @sunng87 in #6388
feat: update dashboard to v0.10.1 by @ZonaHex in #6396
feat: add granularity and false_positive_rate options for indexes by @zhongzc in #6416
feat: override logical table's partition key indices by @fengjiachun in #6385
feat(pipeline): support Loki API by @shuiyisong in #6390
feat: Collider for playing with PartitionRule by @waynexia in #6399
feat: skip rule checker on ingestion by @waynexia in #6453

🐛 Bug Fixes

fix: check if memtable is empty by stats by @v0y4g3r in #5989
fix: prune primary key with multiple columns may use default value as statistics by @evenyag in #5996
fix: only consider the datanode that reports the failure by @WenyXu in #6004
fix: sanitize_connection_string by @fengjiachun in #6012
fix: disable recursion limit in prost by @waynexia in #6010
fix: always create mito engine by @v0y4g3r in #6018
fix: force streaming mode for instant source table by @discord9 in #6031
fix: do not add projection to cast timestamp in label_values by @evenyag in #6040
fix: improve region migration error handling and optimize leader downgrade with lease check by @WenyXu in #6026
fix: reset tags when creating an empty metric in prom call by @evenyag in #6056
fix: ensures logical and physical region have the same timestamp unit by @evenyag in #6041
fix: csv format escaping by @killme2008 in #6061
fix: alter table modify type should also modify default value by @discord9 in #6049
fix: flownode chose fe randomly&not starve lock by @discord9 in #6077
fix: typos by @omahs in #6084
fix: promql regex escape behavior by @waynexia in #6094
fix: table metadata collection by @WenyXu in #6102
fix: clean files under the atomic write dir on failure by @evenyag in #6112
fix: append noop entry when auto topic creation is disabled by @WenyXu in #6092
fix: fast path for single region bulk insert by @v0y4g3r in #6104
fix: update promql-parser for regex anchor fix by @waynexia in #6117
fix: flow update use proper update by @discord9 in #6108
fix: update dev-build image tag by @daviderli614 in #6136
fix: flaky prom gateway test by @v0y4g3r in #6146
fix: region worker stall metrics by @v0y4g3r in #6149
fix(flow): flow task run interval by @discord9 in #6100
fix: ident value in set search_path by @sunng87 in #6153
fix: require input ordering in series divide plan by @waynexia in #6148
fix: invalid table flow mapping cache by @discord9 in #6135
fix: bulk insert case sensitive by @v0y4g3r in #6165
fix: set column index can't work in physical table by @killme2008 in #6179
fix: add simple test for rds kv backend by @paomian in #6167
fix(promql): handle field column projection with correct qualifier by @WenyXu in #6183
fix: alter table update table column default by @discord9 in #6155
fix: remove poison key before retrying procedure on retryable errors by @WenyXu in #6189
fix: remove stale region failover detectors by @WenyXu in #6221
fix(mito): revert initial builder capacity for TimeSeriesMemtable by @v0y4g3r in #6231
fix: do not accommodate fields for multi-value protocol by @evenyag in #6237
fix: add missing features by @MichaelScofield in #6245
fix: add "query" options to standalone by @MichaelScofield in #6248
fix: ignore incomplete WAL entries during read by @WenyXu in #6251
fix: convert JSON type to JSON string in COPY TABLE TO statement by @WenyXu in #6255
fix: skip wal replay when opening follower regions by @WenyXu in #6234
fix(mito): use 1day as default time partition duration by @v0y4g3r in #6202
fix: export metrics settings in sample config by @killme2008 in #6170
fix(meta): enhance postgres election client with timeouts and reconnection by @WenyXu in #6276
fix: null value handling on PromQL's join by @waynexia in #6289
fix: config docs by @v0y4g3r in #6294
fix: doc links by @nicecui in #6304
fix: check for zero parallelism by @discord9 in #6310
fix: always use linux path style in windows platform unit tests by @zyy17 in #6314
fix: event api content type only check type and subtype by @paomian in #6317
fix: handle corner case in catchup where compacted entry id exceeds region last entry id by @WenyXu in #6312
fix: ignore missing columns and tables in PromQL by @evenyag in #6285
fix: override logical table's partition column with physical table's by @waynexia in #6326
fix: carry process id in query ctx by @v0y4g3r in #6335
fix: revert string builder initial capacity in TimeSeriesMemtable by @v0y4g3r in #6330
fix(metric): prevent setting memtable type for metadata region by @WenyXu in #6340
fix(jaeger-api): incorrect find_traces() logic and multiple api compatible issues by @zyy17 in #6293
fix: add path exist check in copy_table_from (#6182) by @Arshdeep54 in #6300
fix: reordered write cause incorrect kv by @v0y4g3r in #6345
fix(metric-engine): properly propagate errors during batch open operation by @WenyXu in #6325
fix(meta): enhance mysql election client with timeouts and reconnection by @WenyXu in #6341
fix: test test_tls_file_change_watch by @killme2008 in #6366
fix: complete partial index search results in cache by @zhongzc in #6403
fix: skip failing nodes when gathering process info by @v0y4g3r in #6412
fix: fix dest_keys chunks bug in TombstoneManager by @WenyXu in #6432
fix: correct MAX_EXECUTION_TIME timeout calculation by @evenyag in #6444
fix: remap column indices on overriding logical table partitions by @waynexia in #6446
fix: label_replace and label_join functions when used as sub‐expressions by @killme2008 in #6443
fix: enable max_execution time for other read only statements by @evenyag in #6454

🚜 Refactor

refactor: datanode instance builder by @MichaelScofield in #6034
refactor: remove the "mode" configuration item completely by @MichaelScofield in #6042
refactor: remove some async in ServerHandlers by @MichaelScofield in #6057
refactor: introduce row group selection by @zhongzc in #6075
refactor: add SlowQueryRecorder to record slow query in system table and refactor slow query options by @zyy17 in #6008
refactor: replace FlightMessage with arrow RecordBatch and Schema by @v0y4g3r in #6175
refactor: extract some common functions and structs in election module by @CookiePieWw in #6172
refactor(flow): limit the size of query by @discord9 in #6216
refactor: respect data_home as root data home directory by @zyy17 in #6050
refactor: support to get trace id with time range by @zyy17 in #6236
refactor: unify function registry (Part 1) by @zhongzc in #6262
refactor: remove PipelineMap and use Value instead by @shuiyisong in #6278
refactor: Extract mito codec part into a new crate by @evenyag in #6307
refactor: make flownode gRPC services able to be added dynamically by @fengys1996 in #6323
refactor: make finding leader in metasrv client dynamic by @MichaelScofield in #6343
refactor: make metadata region option opt-in by @sunng87 in #6350
refactor: make scanner creation async by @MichaelScofield in #6349
refactor(cli): simplify metadata command parameters by @WenyXu in #6364
refactor: pass pipeline name through http header and get db from query context by @zyy17 in #6405
refactor: avoid adding feature to parameter by @fengys1996 in #6391

⚡ Performance

perf: avoid some atomic operation on array slice by @waynexia in #6101
perf: optimize bulk encode decode by @v0y4g3r in #6161

⚙️ Miscellaneous Tasks

chore: bump main branch version to 0.15 by @zhongzc in #5984
ci: read next release version from toml by default by @sunng87 in #5986
chore: update rust toolchain by @shuiyisong in #5818
chore: update nix for new toolchain by @sunng87 in #5991
chore: make txn_helper pub by @fengys1996 in #6002
ci: update dev-builder image version to 2025-04-15-1a517ec8-202504280… by @daviderli614 in #6003
chore: only retry when retry-able in flow by @discord9 in #5987
ci: fix the bugs of release-dev-builder-images and add update-dev-builder-image-tag by @zyy17 in #6009
chore: rename parameter from "table" to "flow_name" by @fengys1996 in #6020
chore: upgrade hydroflow depend by @discord9 in #6011
ci: nix action update by @sunng87 in #6025
docs: refine readme by @killme2008 in #6038
chore: add logs dashboard by @zyy17 in #6028
ci: update website greptimedb version when releasing automatically by @killme2008 in #6037
chore: rm unnecessary depend for flow by @discord9 in #6047
ci: run only in the GreptimeTeam/greptimedb repository by @daviderli614 in #6064
chore: support rename syntax in field by @shuiyisong in #6065
ci: only trigger downstream when release success by @sunng87 in #6074
ci: automatically update helm-charts when release by @daviderli614 in #6071
chore: mv anyhow depend out of cfg by @discord9 in #6081
ci: update homebrew greptime version when release by @daviderli614 in #6082
chore: more cfg stuff on windows by @discord9 in #6083
chore: fix clippy error by feature-gating Query import by @WenyXu in #6085
chore: bump rskafka version by @WenyXu in #6090
ci: update nix build linker by @sunng87 in #6103
chore: modify default slow_query.threshold from 5s to 30s by @zyy17 in #6107
ci: fix release job dependencies by @sunng87 in #6125
chore: remove etcd from acknowledgement as not recommended by @waynexia in #6127
chore: Add more data format support to the pipeline dryrun api. by @paomian in #6115
ci: add pull requests permissions to semantic check job by @evenyag in #6130
chore: enable github folder typo check and fix typos by @yinheli in #6128
chore: update toolchain to 2025-05-19 by @shuiyisong in #6124
chore: reduce unnecessary txns in alter operations by @fengjiachun in #6133
chore: update flush failure metric name and update grafana dashboard by @v0y4g3r in #6138
chore: remove stale wal config entries by @waynexia in #6134
docs: change docker run mount directory by @daviderli614 in #6142
ci: add issues write permission by @daviderli614 in #6145
chore: add the missing v prefix for NEXT_RELEASE_VERSION variable by @zyy17 in #6160
ci: turn off fail fast strategy by @waynexia in #6157
chore: metasrv starting not blocking by @discord9 in #6158
chore: change info to debug for scanning physical table by @killme2008 in #6180
docs: nit from github -> GitHub by @yihong0618 in #6199
chore: correct some CAS ordering args by @fengjiachun in #6200
chore: add metrics for rds kv backend by @paomian in #6201
chore: switch nix index to 25.05 release by @sunng87 in #6181
chore: fix feature gates for pg and mysql kvbackend by @WenyXu in #6211
chore: fix rds kv backend test by @paomian in #6214
chore: example of http config in metasrv by @fengjiachun in #6218
chore: clear metadata filed after updating metadata by @fengjiachun in #6215
chore: shared pipeline under same catalog with compatibility by @shuiyisong in #6143
docs: fix bad link by @daviderli614 in #6222
chore: add some metrics to grafana dashboard by @v0y4g3r in #6169
chore: add pg mysql be default feature in cli by @paomian in #6230
ci: add option to choose whether upload artifacts to S3 in the development build by @daviderli614 in #6232
chore: test sleep longer by @discord9 in #6247
chore: allow numeric values in alter statements by @v0y4g3r in #6252
chore: pub flow info by @discord9 in #6253
ci: increase upload s3 retry times by @daviderli614 in #6263
chore: support table suffix in hint by @shuiyisong in #6223
ci: refactor bump downstream versions workflow and adds demo-scene by @killme2008 in #6171
chore: improve CI debugging and resource configuration by @WenyXu in #6274
ci: add signature information when updating downstream repository by @daviderli614 in #6282
chore: add option for arrow flight compression mode by @v0y4g3r in #6283
chore: silence clippy by @discord9 in #6298
chore: add failover cache for pipeline table by @paomian in #6284
ci: use the new meta backendStorage etcd structure by @daviderli614 in #6303
chore: add connection info to QueryContext by @v0y4g3r in #6319
ci: add pr label workflow by @daviderli614 in #6316
chore: add skip error for pipeline skip error log by @paomian in #6318
chore: clean up unused impl &standalone use mark dirty by @discord9 in #6331
chore: add metrics for active series and field builders by @v0y4g3r in #6332
chore: print series count after wal replay by @v0y4g3r in #6344
chore(deps): switch greptime-proto to official repository by @fengys1996 in #6347
chore: security updates by @sunng87 in #6351
docs: added YouTube link to documentation by @Olexandr88 in #6362
chore: prints a warning when skip_ssl_validation is true by @evenyag in #6367

New Contributors

@omahs made their first contribution in #6084
@yinheli made their first contribution in #6128
@zqr10159 made their first contribution in #6225
@Arshdeep54 made their first contribution in #6300
@rgidda made their first contribution in #6358
@Olexandr88 made their first contribution in #6362

All Contributors

We would like to thank the following contributors from the GreptimeDB community:

@Arshdeep54, @CookiePieWw, @MichaelScofield, @Olexandr88, @WenyXu, @ZonaHex, @daviderli614, @discord9, @evenyag, @fengjiachun, @fengys1996, @killme2008, @linyihai, @nicecui, @omahs, @paomian, @rgidda, @shuiyisong, @sunng87, @v0y4g3r, @waynexia, @yihong0618, @yinheli, @zhongzc, @zqr10159, @zyy17

v0.14.4

2025年6月4日 · 阅读需 1 分钟

Release date: June 04, 2025

🐛 Bug Fixes

fix: set column index can't work in physical table by @killme2008 in #6179
fix(mito): revert initial builder capacity for TimeSeriesMemtable by @v0y4g3r in #6231
fix: do not accommodate fields for multi-value protocol by @evenyag in #6237

⚙️ Miscellaneous Tasks

chore: upgrade hydroflow depend by @discord9 in #6011
chore: rm unnecessary depend for flow by @discord9 in #6047
chore: bump version to 0.14.4 by @zhongzc in #6246

All Contributors

We would like to thank the following contributors from the GreptimeDB community:

@discord9, @evenyag, @killme2008, @v0y4g3r, @zhongzc

v0.14.3

2025年5月23日 · 阅读需 2 分钟

Release date: May 23, 2025

🚀 Features

feat: don't hide atomic write dir by @waynexia in #6109
feat: accommodate default column name with pre-created table schema by @waynexia in #6126
feat: support altering multiple logical table in one remote write request by @waynexia in #6137

🐛 Bug Fixes

fix: reset tags when creating an empty metric in prom call by @evenyag in #6056
fix: flownode chose fe randomly&not starve lock by @discord9 in #6077
fix: append noop entry when auto topic creation is disabled by @WenyXu in #6092
fix(flow): flow task run interval by @discord9 in #6100
fix: flow update use proper update by @discord9 in #6108
fix: clean files under the atomic write dir on failure by @evenyag in #6112
fix: update promql-parser for regex anchor fix by @waynexia in #6117
fix: require input ordering in series divide plan by @waynexia in #6148
fix: ident value in set search_path by @sunng87 in #6153

⚙️ Miscellaneous Tasks

chore: reduce unnecessary txns in alter operations by @fengjiachun in #6133
chore: invalid table flow mapping cache by @discord9 in #6135
chore: bump version to 0.14.3 by @zhongzc in #6168

All Contributors

We would like to thank the following contributors from the GreptimeDB community:

@WenyXu, @discord9, @evenyag, @fengjiachun, @sunng87, @waynexia, @zhongzc

v0.14.2

2025年5月2日 · 阅读需 1 分钟

Release date: May 02, 2025

🐛 Bug Fixes

The following bugs have been fixed. Upgrade is recommended for v0.14 users.

fix: sanitize_connection_string by @fengjiachun in #6012
fix: disable recursion limit in prost by @waynexia in #6010
fix: always create mito engine by @v0y4g3r in #6018
fix: force streaming mode for instant source table by @discord9 in #6031

⚙️ Miscellaneous Tasks

chore: only retry when retry-able in flow by @discord9 in #5987
ci: fix the bugs of release-dev-builder-images and add update-dev-builder-image-tag by @zyy17 in #6009

All Contributors

We would like to thank the following contributors from the GreptimeDB community:

@discord9, @fengjiachun, @v0y4g3r, @waynexia, @zyy17

v0.14.1

2025年4月28日 · 阅读需 1 分钟

Release date: April 28, 2025

🚀 Features

feat: remove own greatest fn by @killme2008 in #5994

🐛 Bug Fixes

fix: check if memtable is empty by stats by @v0y4g3r in #5989
fix: prune primary key with multiple columns may use default value as statistics by @evenyag in #5996

All Contributors

We would like to thank the following contributors from the GreptimeDB community:

@evenyag, @killme2008, @v0y4g3r

v0.14.0

2025年4月25日 · 阅读需 16 分钟

Release date: April 25, 2025

👍 Highlights

Bulk Insert: Adds support for high-performance bulk data ingestion.
Otel Traces: Official releases otel traces.
Fulltext Enhancements: Improves fulltext search with new functions (e.g., matches_term, @@ operator), backend switching, and term optimizations.
Flow Engine: Introduces batching mode and dual engine capability for more flexible data processing.
Partitioning: Supports column-wise and UUID-based partition rules for better scalability.
Region Management: New tools for region sync, monitoring, leader region collection, and region failover handling.
PromQL Engine: Enhanced query performance, range manipulation speed, and stability.
SQL & API Improvements: Adds REPLACE INTO, new regex and JSON features, and various compatibility fixes.
Performance & Reliability: Optimizations for memory, storage, and parallel computation; numerous bug fixes for stability.
Observability: Per-region metrics, expanded Grafana dashboards, and better profiling tools.
Protocol & Integration: Implements Arrow Flight "DoPut" for fast data loading; improves PostgreSQL protocol support.

Plus: Many dependency upgrades, improved config and error handling, and new contributors joined!

🖥️ Dashboard

Upgrade web dashboard to v0.9, supports SQL explain visualization and editor improvements.

Breaking changes

refactor!: Remove Value::DateTime and ValueRef::DateTime. by @linyihai in #5616
refactor!: make pipeline a required parameter when ingesting trace by @sunng87 in #5828

🚀 Features

feat: add vec_dim function by @xiaoniaoyouhuajiang in #5587
feat: impl topk and bottomk by @killme2008 in #5602
feat: skip printing full config content in sqlness by @waynexia in #5618
feat(log-query): implement compound filter and alias expr by @waynexia in #5596
feat: alias for boolean by @killme2008 in #5639
feat: support some IP related functions by @waynexia in #5614
feat: rewrite json_encode_path to geo_path using compound type by @waynexia in #5640
feat: get tables by ids in catalog manager by @fengjiachun in #5645
feat: opentelemetry trace new data modeling by @sunng87 in #5622
feat: update dashboard to v0.8.0 by @ZonaHex in #5666
feat: support exact filter on time index column by @evenyag in #5671
feat: introduce roaring bitmap to optimize sparse value scenarios by @zhongzc in #5603
feat: time series distribution in scanner by @waynexia in #5675
feat(promql): supports quantile and count_values by @killme2008 in #5652
feat: also get index file&expose mito in metrics by @discord9 in #5680
feat: add description for each grafana panel by @sunng87 in #5673
feat: update promql-parser to 0.5 for duration literal by @sunng87 in #5682
feat: add hint for logical region in RegionScanner by @evenyag in #5684
feat: add a gauge for download tasks by @evenyag in #5681
feat: alter region follower by @fengjiachun in #5676
feat: support export command export data to s3 by @yihong0618 in #5585
feat: enhancement information_schema.flows by @AntiTopQuark in #5623
feat: add mysql kvbackend by @CookiePieWw in #5528
feat: add Docker image tag information to step summary in dev-build workflow by @waynexia in #5692
feat: expose virtual_host_style config for s3 storage by @evenyag in #5696
feat: make empty parent_span_id null for v1 by @sunng87 in #5690
feat: add simple extract processor by @shuiyisong in #5688
feat: move default data path from /tmp to current directory by @sunng87 in #5719
feat: add vec_subvector function by @SNC123 in #5683
feat: load manifest manually in mito engine by @discord9 in #5725
feat: disable http timeout by @sunng87 in #5721
feat: update pipeline header name to x-greptime-pipeline-name by @sunng87 in #5710
feat: add vec_kth_elem function by @Pikady in #5674
feat: remove duplicated peer definition by @Wenbin1002 in #5728
feat: add mysql election logic by @CookiePieWw in #5694
feat: introduce install_manifest_to for RegionManifestManager by @WenyXu in #5742
feat: support regex in simple filter by @waynexia in #5753
feat(flow): frontend client for handle sql by @discord9 in #5761
feat: support explain analyze verbose by @evenyag in #5763
feat: add/correct some kafka-related metrics by @waynexia in #5757
feat: utilize blob metadata properties by @zhongzc in #5767
feat(mito): allow skipping wal while creating tables by @v0y4g3r in #5740
feat: introduce RegionFollowerClient trait by @WenyXu in #5771
feat(flow): utils function for recording rule by @discord9 in #5768
feat: add AddRegionFollower and RemoveRegionFollower admin fn by @WenyXu in #5780
feat: impl show region by @WenyXu in #5782
feat: simple implementation of DictionaryVector by @waynexia in #5758
feat: expose scanner metrics to df execution metrics by @evenyag in #5699
feat(pipeline): support table name suffix templating in pipeline by @shuiyisong in #5775
feat: implement sync_region for mito engine by @WenyXu in #5765
feat(flow): time window expr by @discord9 in #5785
feat: add limit for the number of running procedures by @WenyXu in #5793
feat: introduce CustomizedRegionLeaseRenewer by @WenyXu in #5762
feat: introduce read preference by @WenyXu in #5783
feat: introduce CollectLeaderRegionHandler by @WenyXu in #5811
feat: add backend field to fulltext options by @zhongzc in #5806
feat: support REPLACE INTO statement by @evenyag in #5820
feat(remote-wal): add remote wal prune procedure by @CookiePieWw in #5714
feat: add matches_term function by @zhongzc in #5817
feat: implement sync_region for metric engine by @WenyXu in #5826
feat: introduce poison mechanism for procedure by @WenyXu in #5822
feat: add region_id to CountdownTaskHandlerExt by @WenyXu in #5834
feat(remote-wal): send flush request when pruning remote wal by @CookiePieWw in #5825
feat: add term as fulltext index request by @zhongzc in #5843
feat: shorten possible wrong query range by @waynexia in #5849
feat: make admin_fn macro usable outside common_function module by @WenyXu in #5850
feat: pushdown select distinct in some cases by @evenyag in #5847
feat(flow): batching mode engine by @discord9 in #5807
feat: add catalog_manager to ProcedureServiceHandler by @WenyXu in #5873
feat: apply terms with fulltext tantivy backend by @zhongzc in #5869
feat: apply terms with fulltext bloom backend by @zhongzc in #5884
feat: add query engine options by @waynexia in #5895
feat: support altering fulltext backend by @zhongzc in #5896
feat: report per-region metrics on region server by @waynexia in #5893
feat: optimize matches_term with constant term pre-compilation by @zhongzc in #5886
feat(flow): dual engine by @discord9 in #5881
feat: Column-wise partition rule implementation by @v0y4g3r in #5804
feat: support @@ (AtAt) operator for term matching by @waynexia in #5902
feat(mito): bulk insert request handling on datanode by @v0y4g3r in #5831
feat: Add query pipeline http api by @linyihai in #5819
feat: add json parse processor by @shuiyisong in #5910
feat: implement Arrow Flight "DoPut" in Frontend by @MichaelScofield in #5836
feat: sync region followers after altering regions by @WenyXu in #5901
feat: prevent migrating a leader region to a peer that already has a region follower by @WenyXu in #5923
feat: introduce high_watermark for remote wal logstore by @CookiePieWw in #5877
feat: enable submitting wal prune procedure periodically by @CookiePieWw in #5867
feat: update readme by @killme2008 in #5936
feat: implement otel-arrow protocol for GreptimeDB by @v0y4g3r in #5840
feat: support building metasrv with selector from plugins by @WenyXu in #5942
feat: add exclude_peer_ids to SelectorOptions by @WenyXu in #5949
feat: add format support for promql http api (not prometheus) by @sunng87 in #5939
feat: update dashboard to v0.9.0 by @ZonaHex in #5948
feat: introduce flush metadata region task for metric engine by @WenyXu in #5951
feat: node excluder by @MichaelScofield in #5964
feat(flow): use batching mode&fix sqlness by @discord9 in #5903
feat: track region failover attempts and adjust timeout by @WenyXu in #5952
feat: enhance selector with node exclusion support by @WenyXu in #5966
feat: improve observability of region migration procedure by @WenyXu in #5967
feat: remove hyper parameter from promql functions by @waynexia in #5955
feat: allow forced region failover for local WAL by @WenyXu in #5972

🐛 Bug Fixes

fix: check physical region before use by @waynexia in #5612
fix: update typos rules to fix ci by @yihong0618 in #5621
fix: speed up cargo build using sallow clone by @yihong0618 in #5620
fix: increase timeout for opening candidate region and log elapsed time by @WenyXu in #5627
fix: out of bound during bloom search by @zhongzc in #5625
fix: refactor region leader state validation by @WenyXu in #5626
fix: properly display CJK characters in table/column comments by @v0y4g3r in #5633
fix: prevent failover of regions to the same peer by @WenyXu in #5632
fix: interval rewrite rule that messes up show create flow function by @v0y4g3r in #5642
fix: unable to install software-properties-common in dev builder by @daviderli614 in #5643
fix(metric-engine): group DDL requests by @WenyXu in #5628
fix: window sort not apply when other column alias to time index name by @discord9 in #5634
fix: recover plan schema after dist analyzer by @waynexia in #5665
fix: flaky test in sqlness by fix random port by @yihong0618 in #5657
fix: skip schema check to avoid schema mismatch brought by metadata by @v0y4g3r in #5662
fix: use DateTime instead of NaiveDateTime by @shuiyisong in #5669
fix: update column requirements to use Column type instead of String by @waynexia in #5672
fix: correct stalled count by @evenyag in #5678
fix: FlowInfoValue's compatibility by @discord9 in #5695
fix: conversion from TableMeta to TableMetaBuilder by @v0y4g3r in #5693
fix: mysql prepare bool value by @discord9 in #5732
fix: mysql prepare limit&offset param by @discord9 in #5734
fix: wrap table name with `` by @CookiePieWw in #5748
fix: handle nullable default value by @discord9 in #5747
fix: properly give placeholder types by @discord9 in #5760
fix: support name matcher in label values by @evenyag in #5773
fix: typo variadic by @waynexia in #5800
fix: close issue #3902 since upstream fixed by @yihong0618 in #5801
fix: correct error status code by @WenyXu in #5802
fix: interval cast expression can't work in range query, #5805 by @killme2008 in #5813
fix: skip replacing exprs of the DistinctOn node by @evenyag in #5823
fix: throw errors instead of ignoring by @WenyXu in #5792
fix: get root cause of the procedure when converting to pb by @evenyag in #5841
fix: remove metadata region options by @v0y4g3r in #5852
fix: include follower peers in region distribution by @WenyXu in #5844
fix: gRPC connection pool leak by @fengys1996 in #5876
fix: always rejects write while downgrading region by @WenyXu in #5842
fix: flaky test on windows by @yihong0618 in #5890
fix: ensure logical regions are synced during region sync by @WenyXu in #5878
fix: memtable panic by @v0y4g3r in #5894
fix: preserve timestamp precision of irate by @waynexia in #5904
fix: support duration to interval conversion in PostgreSQL protocol by @v0y4g3r in #5913
fix: oom for sqlness test in container by @yihong0618 in #5917
fix: label values potential panic by @waynexia in #5921
fix: avoid double schema projection in file format readers by @WenyXu in #5918
fix: anchor regex string to fully match in promql by @waynexia in #5920
fix: wrong error msg in pipeline by @shuiyisong in #5937
fix: filter doesn't consider default values after schema change by @evenyag in #5912
fix: remove obsolete failover detectors after region leader change by @WenyXu in #5944
fix: parse flow expire after interval by @discord9 in #5953
fix: use max in flushed entry id and topic latest entry id by @CookiePieWw in #5946
fix: store flow query ctx on creation by @discord9 in #5963
fix: try prune one less by @discord9 in #5965
fix: upgrade sqlparse and validate align in range query by @killme2008 in #5958
fix: security update by @sunng87 in #5982
fix: conn timeout&refactor: better err msg by @discord9 in #5974

🚜 Refactor

refactor: add pipeline concept to OTLP traces and remove OTLP over gRPC by @sunng87 in #5605
refactor: simplify udf by @MichaelScofield in #5617
refactor: rename table function to admin function by @waynexia in #5636
refactor: remove or deprecated existing UDAF implementation by @waynexia in #5637
refactor: remove cluster id field by @v0y4g3r in #5610
refactor(mito): move wal sync task to background by @v0y4g3r in #5677
refactor: update jaeger api implementation for new trace modeling by @sunng87 in #5655
refactor: remove trace id from primary key in opentelemetry_traces table by @zyy17 in #5733
refactor: make frontend instance clear by @fengys1996 in #5754
refactor: move list_flow_stats to ClusterInfo trait. by @WenyXu in #5774
refactor: remove useless partition legacy code by @v0y4g3r in #5786
refactor: remove useless region follower legacy code by @WenyXu in #5787
refactor: remove useless region follower legacy code by @WenyXu in #5795
refactor: skip re-taking arrays in memtable if possible by @MichaelScofield in #5779
refactor: remove deprecated find_unique method by @waynexia in #5790
refactor: remove mode option in configuration files by @fengys1996 in #5809
refactor: allow bloom filter search to apply and conjunction by @zhongzc in #5770
refactor: remove prom store write dispatch by @shuiyisong in #5812
refactor: remove backoff config by @WenyXu in #5808
refactor: add time range for jager get operations API by @zyy17 in #5791
refactor: improve performance for Jaeger APIs by @zyy17 in #5838
refactor: check and fix super import by @waynexia in #5846
refactor(flow): make start flownode clearer by @discord9 in #5848
refactor: abstract index source from fulltext index applier by @zhongzc in #5845
refactor: improve error code handling in status code conversion by @WenyXu in #5851
refactor: simplify tls key read code and add sec1 key support by @sunng87 in #5856
refactor: avoid empty display in errors by @MichaelScofield in #5858
refactor: add partition_rules_for_uuid() by @zyy17 in #5743
refactor: unify all dashboards and use dac tool to generate intermediate dashboards by @zyy17 in #5933
refactor: run_pipeline parameters by @shuiyisong in #5954

📚 Documentation

docs: tsbs update by @discord9 in #5608
docs: update cluster dashboard to make opendal panel works by @evenyag in #5661
docs: adds news to readme by @killme2008 in #5735
docs: rfc for wal purge by @CookiePieWw in #5475
docs: update readme by @killme2008 in #5891
docs: memory profile scripts by @discord9 in #5922
docs: fix some units and adds the opendal errors panel by @evenyag in #5962

⚡ Performance

perf: rm coalesce batch when target_batch_size > fetch limit by @discord9 in #5658
perf(prom): optimize label values query by @WenyXu in #5653
perf: support in list in simple filter by @waynexia in #5709
perf: introduce simd_json for parsing ndjson by @shuiyisong in #5794
perf: evolve promql execution engine by @waynexia in #5691
perf: faster range manipulate for promql by @waynexia in #5859
perf: avoid duplicate computation in promql by @waynexia in #5863
perf: keep compiled regex in SimpleFilterEvaluator to avoid re-compiling by @evenyag in #5919
perf: optimize fulltext zh tokenizer for ascii-only text by @zhongzc in #5975

🧪 Testing

test: looser condition by @discord9 in #5816
test: add tests to ensure nested data structure for identity pipeline by @sunng87 in #5888
test: update configs to enable auto wal prune by @CookiePieWw in #5938
test: use random seed for window sort fuzz test by @discord9 in #5950

⚙️ Miscellaneous Tasks

chore: bump version to 0.13.0 by @WenyXu in #5611
chore: support specifying skipping index in pipeline by @shuiyisong in #5635
ci: remove ubuntu 20.04 runners by @sunng87 in #5545
ci: bump dev-builder image version to 2024-12-25-a71b93dd-20250305072908 by @daviderli614 in #5651
chore: improve /v1/jaeger/api/trace/{trace_id}'s resp by @shuiyisong in #5663
chore: impl ref and ref_mut for json like by @paomian in #5679
chore: make memorykv write happily by @fengjiachun in #5686
chore: check region wal provider on startup to avoid inconsistency by @v0y4g3r in #5687
chore: support application/x-ndjson for log ingest by @shuiyisong in #5697
chore: support tag in transform by @shuiyisong in #5701
chore: support inverted index in pipeline by @shuiyisong in #5700
chore: update flate2 version by @yihong0618 in #5706
chore: use Bytes instead of string in bulk ingestion by @shuiyisong in #5717
chore: bump version to 0.14.0 by @waynexia in #5711
chore: revert commit update flate2 version (#5706)" by @yihong0618 in #5715
chore: add some method for log query handler by @paomian in #5685
chore: merge error files under pipeline crate by @shuiyisong in #5738
chore: add datanode write rows to grafana dashboard by @sunng87 in #5745
chore: support custom time index selector for identity pipeline by @shuiyisong in #5750
chore: ut and some fix by @CookiePieWw in #5752
chore: remove Transformer trait by @shuiyisong in #5772
chore: upgrade some dependencies by @fengys1996 in #5777
chore: accept table options in auto create table from hints by @shuiyisong in #5776
chore: expose some methods by @fengys1996 in #5784
chore: expose modules by @WenyXu in #5810
chore: remove patch.crates-io for rustls by @fengys1996 in #5832
chore: update datafusion family by @MichaelScofield in #5814
chore: remove obsolete way of passing http configurations through env by @MichaelScofield in #5864
chore: un-allow clippy's "readonly_write_lock" by @MichaelScofield in #5862
chore: remove repl by @MichaelScofield in #5860
ci: not push latest image when schedule release by @daviderli614 in #5883
chore: upgrade opendal to 0.52 by @WenyXu in #5857
chore: add heartbeat metrics by @fengjiachun in #5929
chore: rm dev opt level 3 by @discord9 in #5932
chore: use once_cell to avoid parse everytime in pipeline exec by @shuiyisong in #5943
chore: better buckets for heartbeat stat size histogram by @fengjiachun in #5945
chore: assert plugin uniqueness by @MichaelScofield in #5947
chore: remove unused attribute by @fengys1996 in #5960
chore: update dac tools image and docs by @zyy17 in #5961
chore: remove coderabbit by @killme2008 in #5969

Build

build: use ubuntu-22.04 base image release dev-build image by @daviderli614 in #5554

New Contributors

@Wenbin1002 made their first contribution in #5728
@Pikady made their first contribution in #5674
@SNC123 made their first contribution in #5683
@xiaoniaoyouhuajiang made their first contribution in #5587

All Contributors

We would like to thank the following contributors from the GreptimeDB community:

@AntiTopQuark, @CookiePieWw, @MichaelScofield, @Pikady, @SNC123, @Wenbin1002, @WenyXu, @ZonaHex, @daviderli614, @discord9, @evenyag, @fengjiachun, @fengys1996, @killme2008, @linyihai, @paomian, @shuiyisong, @sunng87, @v0y4g3r, @waynexia, @xiaoniaoyouhuajiang, @yihong0618, @zhongzc, @zyy17

v0.13.2

2025年4月8日 · 阅读需 1 分钟

Release date: April 08, 2025

🚀 Features

feat: introduce poison mechanism for procedure by @WenyXu in #5822

🐛 Bug Fixes

fix: mysql prepare bool value by @discord9 in #5732
fix: mysql prepare limit&offset param by @discord9 in #5734
fix: wrap table name with `` by @CookiePieWw in #5748
fix: handle nullable default value by @discord9 in #5747
fix: properly give placeholder types by @discord9 in #5760
fix: support name matcher in label values by @evenyag in #5773
fix: typo variadic by @waynexia in #5800
fix: close issue #3902 since upstream fixed by @yihong0618 in #5801
fix: correct error status code by @WenyXu in #5802
fix: interval cast expression can't work in range query, #5805 by @killme2008 in #5813
fix: skip replacing exprs of the DistinctOn node by @evenyag in #5823
fix: throw errors instead of ignoring by @WenyXu in #5792

All Contributors

We would like to thank the following contributors from the GreptimeDB community:

@CookiePieWw, @MichaelScofield, @Pikady, @SNC123, @Wenbin1002, @WenyXu, @discord9, @evenyag, @fengys1996, @killme2008, @paomian, @shuiyisong, @soisyourface, @sunng87, @v0y4g3r, @waynexia, @yihong0618, @zhongzc, @zyy17

v0.13.1

2025年3月18日 · 阅读需 1 分钟

Release date: March 18, 2025

🐛 Fixes

chore: use Bytes instead of string in bulk ingestion by @shuiyisong in https://github.com/GreptimeTeam/greptimedb/pull/5710

v0.13.0

2025年3月14日 · 阅读需 5 分钟

Release date: March 14, 2025

👍 Highlights

Introduced roaring bitmap to optimize sparse value scenarios
Added support for IP-related functions
Enhanced PromQL with support for quantile and count_values functions
Added support for exporting data to S3

Breaking changes

refactor!: Remove Value::DateTime and ValueRef::DateTime. by @linyihai in https://github.com/GreptimeTeam/greptimedb/pull/5616

Build

build: use ubuntu-22.04 base image release dev-build image by @daviderli614 in https://github.com/GreptimeTeam/greptimedb/pull/5554

New Contributors

@xiaoniaoyouhuajiang made their first contribution in https://github.com/GreptimeTeam/greptimedb/pull/5587

All Contributors

We would like to thank the following contributors from the GreptimeDB community:

@AntiTopQuark, @CookiePieWw, @MichaelScofield, @WenyXu, @ZonaHex, @daviderli614, @discord9, @evenyag, @fengjiachun, @killme2008, @linyihai, @paomian, @shuiyisong, @sunng87, @v0y4g3r, @waynexia, @xiaoniaoyouhuajiang, @yihong0618, @zhongzc

Full Changelog: https://github.com/GreptimeTeam/greptimedb/compare/v0.12.0...v0.13.0

🐛 Bug Fixes​

All Contributors​

👍 Highlights​

Breaking changes​

🚀 Features​

🐛 Bug Fixes​

🚜 Refactor​

⚡ Performance​

⚙️ Miscellaneous Tasks​

New Contributors​

All Contributors​

🐛 Bug Fixes​

⚙️ Miscellaneous Tasks​

All Contributors​

🚀 Features​

🐛 Bug Fixes​

⚙️ Miscellaneous Tasks​

All Contributors​

🐛 Bug Fixes​

⚙️ Miscellaneous Tasks​

All Contributors​

🚀 Features​

🐛 Bug Fixes​

All Contributors​

👍 Highlights​

🖥️ Dashboard​

Breaking changes​

🚀 Features​

🐛 Bug Fixes​

🚜 Refactor​

📚 Documentation​

⚡ Performance​

🧪 Testing​

⚙️ Miscellaneous Tasks​

Build​

New Contributors​

All Contributors​

🚀 Features​

🐛 Bug Fixes​

All Contributors​

🐛 Fixes​

👍 Highlights​

Breaking changes​

🚀 Features​

🐛 Fixes​

🚜 Refactor​

📚 Documentation​

⚡ Performance​

⚙️ Miscellaneous Tasks​

CI​

Build​

New Contributors​

All Contributors​

🐛 Bug Fixes

All Contributors

👍 Highlights

Breaking changes

🚀 Features

🐛 Bug Fixes

🚜 Refactor

⚡ Performance

⚙️ Miscellaneous Tasks

New Contributors

All Contributors

🐛 Bug Fixes

⚙️ Miscellaneous Tasks

All Contributors

🚀 Features

🐛 Bug Fixes

⚙️ Miscellaneous Tasks

All Contributors

🐛 Bug Fixes

⚙️ Miscellaneous Tasks

All Contributors

🚀 Features

🐛 Bug Fixes

All Contributors

👍 Highlights

🖥️ Dashboard

Breaking changes

🚀 Features

🐛 Bug Fixes

🚜 Refactor

📚 Documentation

⚡ Performance

🧪 Testing

⚙️ Miscellaneous Tasks

Build

New Contributors

All Contributors

🚀 Features

🐛 Bug Fixes

All Contributors

🐛 Fixes

👍 Highlights

Breaking changes

🚀 Features

🐛 Fixes

🚜 Refactor

📚 Documentation

⚡ Performance

⚙️ Miscellaneous Tasks

CI

Build

New Contributors

All Contributors