Releases: taosdata/TDengine
Releases · taosdata/TDengine
3.3.7.5
Behavior change and compatibility
Features
- feat: taosX support importing ORC format
- feat: C WebSocket connection-level timezone
- feat: [TD-37437]: incorrect database targeting when creating streams containing virtual table queries
- feat: support ADO interface in ODBC
- feat: taosAdapter support recording sql to csv
Enhancements
- enh: set EXPLORER_SKIP_REGISTER=true to skip register in Explorer
- enh: reduce taosX binary size for nearly ~60M(plain, 15M compressed)
- enh: explorer will trim spaces in user name
- enh: C WebSocket support configuration options for auto reconnect
- enh: support for formatting time using DDD on Windows.
- enh: disable alert in dashboard on explorer oss
- enh: add verifyPeer parameter to allow users to skip certificate verification during S3 data upload.
- enh: enhance the state control mechanism for S3 data migration to improve precision and efficiency
- enh: explorer can config requret timeout in opcua
- enh: Show Create Table does not output compression information.
- enh: shared storage supports NAS
- enh: support retries in taosBenchmark via ws
- enh: improve kafka datain performance
- enh: taosX not started cause ui undefined error
Fixes
- fix: speedup influxdb 1.x querying and fix oom in taosX influxdb datasource
- fix: create data replication error in explorer with non-default password
- fix: crash caused by race conditions during memory reclamation in long-running queries
- fix: non-exist file cause unstopped failed to open file error in restore
- fix: intermittent “stream task lost” error when creating stream tasks in batches.
- fix: delete stream cause 'Database not specified' in explorer
- fix: varbinary database mapping in explorer transform
- fix: panic in case of decimal converting from oracle
- fix: trigger table tags being null causes crash
- fix: mqtt get sample data timeout if frequency too low
- fix: taosdump export by time range error in case of us/ns precision
- fix: crash issue when using CALC_NOTIFY_ONLY option in stream computing
- fix: taoskeeper audit log error with
value too long for column/tag: client_address
in taoskeeper - fix: import csv with value field in explorer cause error
- fix: explorer cascading tag table list error in case of same values in multi tag fields
- fix: taosX got unexpected null values in case of different types in single field
- fix: nginx service restart cause explorer error
What's Changed
- Feat/ts 6100 3.0 by @wangmm0220 in #32326
- merge: from main to stream by @guanshengliang in #32342
- test: verify bug4 merge case to vehicle.py by @DuanKuanJun in #32328
- feat: rename docker image by @feici02 in #32346
- test: modify recalc ci cases. by @xiao-77 in #32318
- test: update tese case of blob by @yihaoDeng in #32330
- test: modify case test_recalc_manual_with_options.py. by @xiao-77 in #32348
- fix invalide read epset by @yihaoDeng in #32344
- docs: count_window by @facetosea in #32349
- enh: update show creata table by @yihaoDeng in #32320
- test: modify case by @plum-lihui in #32290
- enh: set queryUseMemoryPool to 0 by @jiajingbin in #32351
- fix(stream): fix recalculation range by @JinqingKuang in #32332
- test: add recalc manual to ci. by @xiao-77 in #32361
- fix: split dead loop issue by @dapan1121 in #32354
- fix(stream): fix memory leak of stream notify content by @JinqingKuang in #32364
- fix: [TD-37133] Forbid use %%trows multi times in union query. by @Simon9997 in #32366
- Feat/ts 6100 3.0 ming by @wangmm0220 in #32362
- docs: update release note for 3.3.7.0 in office web by @feici02 in #32359
- test: create vtable stable from 150100 by @DuanKuanJun in #32360
- docs: update stream doc by @guanshengliang in #32374
- docs: add example cases for datatype tests in cases.task by @tomchon in #32379
- docs: update zh introduction with new name by @danielclow in #32382
- merge: from stream branch to main by @guanshengliang in #32375
- enh: grant support for data source ORC by @kailixu in #32370
- enh: grant support for data source ORC by @kailixu in #32378
- fix: wrong col_id in ins_columns by @Tony2h in #32358
- fix: modify the execution order of compatibility test cases. by @xiao-77 in #32385
- test: remove un checked case by @guanshengliang in #32388
- fix: failed to write blob data using STMT2 in inefficient mode by @yihaoDeng in #32365
- fix(parser): subquery use last_row can't found the colname by @hongzhenliu335 in #32353
- test: [TS-6100] Reopen UTs by @Simon9997 in #32363
- docs: explanation of timezone by @wangmm0220 in #32390
- feat(entrypoint): add wait for serverPort and create snode on dnode by @tomchon in #32345
- feat(stmt):add update syntax support for stmt1 by @Pengrongkun in #32367
- docs:update download link in 01-tdengine.md by @tomchon in #32373
- test: [TS-6100] Reopen stream ut by @Simon9997 in #32396
- enh(TD-36909: adjust sync timer routine log by @cadem in #32309
- enh(TD-36909: adjust sync timer routine log by @cadem in #32098
- fix: wrong table number statistics by @hzcheng in #32391
- Fix/hzcheng/3.3.6/TD-37201 by @hzcheng in #32392
- chore: trigger doc build by @feici02 in #32411
- docs: stream upgrade by @guanshengliang in #32408
- fix(gpt): support scalar function in forecast function. by @hjxilinx in #32409
- test: reproduce bug by @guanshengliang in #32414
- chore: trigger doc build by @feici02 in #32416
- docs: add blank line for better readability in product classificationsection by @tomchon in #32417
- docs: escape_character parameter in document classification error by @menshibin in #32421
- test: mute recalc manual case. by @xiao-77 in #32413
- merge: from 3.3.6 to main branch by @guanshengliang in #32389
- docs: update WebSocket connection API support status and usage restrictions by @qevolg in #32393
- fix: fix taoskeeper version by @qevolg in #32425
- fix: fix taoskeeper version by @qevolg in #32429
- fix: enhance removal logic to check for non-empty install directory before deletion by @tomchon in #32430
- fix: update dnode state from offline to online by @kailixu in #32423
- fix: update dnode state from offline to online by @kailixu in #32424
- feat: add taosmqtt support in packaging scripts and cleanup routines by @tomchon in #32431
- doc: simplify get started for docker by @feici02 in #32434
- fix: enhance removal script to handle empty service names and add directory cleanup by @tomchon in #32435
- docs(taosx): update Data-In tasks name to TDengine Subscription and T… by @acerDebugman in #32433
- merge: from 3.3.6 to main branch by @guanshengliang in #32439
- test: reproduce bugs by @guanshengliang in #32446
- fix(tmq): [TD-37063] array capacity is too large in sometimes by @wangmm0220 in #32445
- fix: [TD-37190] Disable ignore_nodata_trigger when window type is not interval/sliding or period. by @Simon9997 in #32405
- docs: add odbc connector support ado by @menshibin in #32460
- fix: Datainserter supports concurrent writing to the same group by @facetosea in #32384
- fix: wildcards pattern match bug in like clause by @Tony2h in #32404
...
3.3.7.0
Behavior change and compatibility
Features
- feat: new version of stream computing
- feat: supports BLOB data type
- feat: multi-level storage supports the adoption of shared storage
- feat: data subscription supports the MQTT protocol.
- feat: support for data mounting
- feat: support audo reconnect in rust websocket and libtaosws
- feat: go connector support blob data type
- feat: support BLOB data type in taos-ws-py
- feat: rust connector support new blob data type
- feat: Go WebSocket connections support IPv6
- feat: support IPv6 connection in C#
- feat: support version compatible check
- feat: libtaosws support adapterList for failover
- feat: table name in transform support expression calc
- feat: taosAdapter support new BLOB data type
- feat: C WebSocket connector support BLOB data type
- feat: taosX all data sources support decimal now
- feat: C# connector support decimal type
- feat: C websocket connector auto-reconnect and failover
- feat: subscribe from TDengine to MQTT in taosX
- feat: support MQTT sparkplug B datain in taosX
- feat: support OpenMetrics collection endpoints
- feat: new go connector benchmark tool
- feat: refactor artifact of taosBenchmark with better perf and functionality: tsgen
- feat: support writing query results to super tables.
- feat: generate unique timestamp using now in taosX
- feat: new plugin for ontop system
- feat: C websocket connector support multi-address failover
- feat: allow specify columns in count window
Enhancements
- enh: added grant items such as storage capacity and number of vnodes.
- enh: taosBenchmark support reading tbname/tags in csv
- enh: taosX support more datetime format in between_time_range
- enh: STMT2 supports setting fixed values for specified columns
- enh: websocket poll enhancement
- enh: Python WebSocket connections support automatic reconnection.
- enh: support multiple target frameworks in C#
- enh: downgrade gcc to 7.x for Hisoon database adapter
- enh: OPC CSV points config can add tags values with template
- enh: signed taosExplorer cannot start on mac
- enh: c websocket ws/wss protocol detection
- enh: support sml to get affected rows in rust connector
- enh: reduce info logs
- enh: support more write performance monitoring metrics
- enh: support encrypting user passwords using the SM4 algorithm
- enh: enables automatic detection and repair of WAL file corruption during startup
- enh: STMT2 supports duplicate table name binding
- enh: support varbinary data type in taosX
- enh: taosBenchmark output perf metrics into json file
- enh: raise exception in case of data convertion error
- enh: taosX transform plugin included in release
- enh: taosX restore from local dir support 'watch' parameter for watching file changes
- enh: disable external usage of :6060/rest/sql in Explorer
Fixes
- fix: memory leak occurs when subscribing to time-series data without metadata in Database topic
- fix: taosd fails to start after modifying a single mount point in multi-level storage
- fix: smallint type could not return query results when using the in ('1') condition for filtering.
- fix: incorrect authentication cause taosAdapter mem leak
- fix: single mount point failure in a multi-replica database cannot be recovered
- fix: vrtual table write requests did not report errors
- fix: support show tags on virtual table
- fix: taosBenchmark REST never support vgroup bindings
- fix: set timezone as same as JVM default does not work in websocket connection
- fix: csv to decimal cause taosX panic
- fix: fix decimal to double error when replicating with tmq
- fix: fix opcua error in cli mode of taosX
- fix: fix fetch_rows_a error in libtaows
- fix: superset name typo in english of explorer tools docs
- fix: OSS Explorer drop database error
- fix: taosX consume messages with formatted json cause error
- fix: ipv6 with zone info cause taosAdapter error on windows
- fix: agent sometimes panic on ipc ack reader
- fix: crash may occur when executing the show db.disk_info command
- fix: taos -h reports an error when entering an IPv6 address.
- fix: explorer sql query error should be visible
- fix: TDB file corruption caused by concurrent data subscription scenarios.
- fix: fFailed to query virtual tables in BI mode
- fix: nchar tag index is not taking effect
- fix: fix JDK caused panic on Kylin customized JDK for InfluxDB
- fix: transform invalid column name error
- fix: sorting fields of type double may cause the program to crash.
- fix: configuration parameter update failure during system upgrade
- fix: taosX tmq to td too many 'show subscriptions' queries cause taosd stuck
- fix: datain page disappear in explorer
- fix: taosX kafka datain will drop and logging non-utf8 input
- fix: explorer table display error
- fix: taosX support self-signed cert to adapter
- fix: kafka udt support nested array like
[{"data":[{"k":"v"}]}]
- fix: sysinfo 0.33.1 cause slab mem increament on Kylin V10 os
- fix: taosBenchmark connection number increases when check sql not set
- fix: explorer slowsql query condition of timerange
- fix: provide tool to manually rebuild the last cache quietly
- fix: S3 upload failure caused by an abnormal compact operation.
- fix: SQL error detail should display in Explorer logs
- fix: drop topic will affect other consumers' subscriptions
- fix: error occurs when the parameter string length of forecast exceeds 512
- fix: resolved the time precision issue in the timediff function.
- fix: incorrect results when using to_char function in a nanosecond-precision database
- fix: error when reading composite primary key data from memory and STT, causing duplicate IDs.#31509
- fix: client crashes when use STMT2 to the newly added column
- fix: extremely rare race-condition crash when printing logs.#31688
What's Changed
- feat: [TS-6100] Support ast create for create stream. by @Simon9997 in #30815
- fix: [TS-6100] Fix compile on mac and add toJson/jsonTo func. by @Simon9997 in #30872
- Feat/new stream cache sink by @facetosea in #30868
- fix: [TS-6100] Remove useless code and fix bugs by @Simon9997 in #30883
- feat: [TS-6100] Fix compile error. by @Simon9997 in #30902
- feat: [TS-6100] Process SCMCreateStreamReq by @Simon9997 in #30918
- feat: [TS-6100] Process SCMCreateStreamReq by @Simon9997 in #30924
- feat: [TS-6100] Process SCMCreateStreamReq ver-3 by @Simon9997 in #30930
- feat(stream): add logic of stream reader by @wangmm0220 in #30932
- Feat/ts 6100 3.0 by @wangmm0220 in #30936
- feat: [TS-6100] Process SCMCreateStreamReq by @Simon9997 in #30940
- Feat/ts 6100 3.0 by @wangmm0220 in #30945
- Feat/ts 6100 marks new by @wangmm0220 in #30946
- feat(stream): add thread worker for stream reader by @wangmm0220 in #30954
- feat: [TS-6100] Process SCMCreateStreamReq ver-5 by @Simon9997 in #30964
- feat: [TS-6100] Process SCMCreateStreamReq ver-6 by @Simon9997 in #30982
- feat: [TS-6100] Process SCMCreateStreamReq : Add unit test and fix bugs. by @Simon9997 in #30986
- feat: [TS-6100] Process SCMCreateStreamReq : Fix subplan to string. by @Simon9997 in #30990
- feat: [TS-6100] Parse create stream sql: Fix syntax error when using … by @Simon9997 in #31001
- feat: [TS-6100] Parse create stream sql: Add out stb sversion. by @Simon9997 in #31014
- feat: [TS-6100] Parse create stream sql: change out stb version's dat… by @Simon9997 in #31017
- feat: [TS-6100] Parse create stream sql: Fix bugs and add create check. by @Simon9997 in #31030
- feat: [TS-6100] Parse create stream sql: Fix wrong readFromCache value by @Simon9997 in #31035
- feat: [TS-6100] Parse create stream sql: Collect placeholder function… by @Simon9997 in #31038
- feat: [TS-6100] Parse create stream sql: Fix out table wrong column n… by @Simon9997 in #31040
- feat: [TS-6100] Parse create stream sql: Fix out table wrong column n… by @Simon9997 in #31043
- feat: [TS-6100] Parse create stream sql: Add Unit Test. by @Simon9997 in #31047
- feat: [TS-6100] Fix mac cmake error. by @Simon9997 in #31057
- feat: [TS-6100] Parse create stream sql: Add unit test. by @Simon9997 in #31063
- feat: [TS-6100] Parse create stream sql: Fix partition by tbname error. by @Simon9997 in #31066
- feat: [TS-6100] Parse create stream sql: Fix wrong subplan num...
3.3.6.13
Behavior change and compatibility
Features
- feat: taoskeeper support IPv6 listen and connect
- feat: database engine supports IPv6.
- feat: support IPv6 in taosX/explorer
- feat: taosadaupter support IPv6
- feat: connectors support ipv6
- feat: taosX support log level change in runtime
- feat: python websocket support ipv6
- feat: support ipv6 for rust
- feat: support IPv6 connection in node.js websocket connection
- feat: taoskeeper support IPv6 listen and connect
- feat: add metrics for skiped messages
- feat: new Node-RED pluginf for query/write/subscribe
- feat: taosX add telmetry report
Enhancements
- enh: go WebSocket connector poll data integrity enhancement
- enh: speedup TDengine Build CI
- enh: improve the performance of node recovery and replica changes.
- enh: enable monitor each vnode's actual memory usage and allocation
- enh: support importing CSV files containing newline characters.
- enh: improve performance for small batches of dataset in JDBC ws connector
- enh: support backfill from interrrupted checkpointed in query datain
- enh: support gen:order on tags in taosBenchmark
- enh: allow user login to explorer without sysinfo
Fixes
- fix: schemaless write mode cannot modify string length in dual-active mode
- fix: when maxRetryWaitTime is set too high, the client will perform unlimited retries when connecting to the server.
- fix: the error message is not clear when the super table and sub table have the same name during auto-creation of tables.
- fix: replicaiton support convertion from double/float to decimal in taosX
- fix: when there are offline dnodes, "show dnode * variables" does not return any output.
- fix: the REPLICA parameter supports plural forms when used to create and alter a database
- fix: fix unknown error 65534 when connecting to cloud
- fix: taosc does not retry when encountering the "Out of memory in queue" error during write failure
- fix: tables with composite primary keys cannot use the forcast function.
- fix: fix read file error when replicatting by a net guard
- fix: influxdb datain cause "Unknown named curve" under Kylin V10
- fix: nchar tag index is not taking effect
- fix: allow non-select query result set export as csv
- fix: inner join queries failing to retrieve data in a nanosecond-precision database.
What's Changed
- test:add coverage workflow by @happyguoxy in #30407
- merge: from main to 3.0 branch by @guanshengliang in #30430
- build(python): update python connector version to 2.7.23 by @YamingPei in #30419
- enh: TD-34203-keeping-restoring by @cadem in #30423
- feat(taosBenchmark): supports decimal data type by @YamingPei in #30456
- feat: cluster monitor page in explorer by @pigzhou in #30496
- fix: taosBenchmark firstEp not work in taos.cfg (3.0) by @DuanKuanJun in #30491
- merge: from main to 3.0 branch by @guanshengliang in #30492
- fix(tdb): disable page recycling by @stephenkgu in #30529
- test: add workflow add-pr-labels [ci skip] by @jiacy-jcy in #30575
- ci: update doc-build workflow to add option to check build chinese or… by @flyingangel2013 in #30550
- merge: from main to 3.0 branch by @guanshengliang in #30591
- add pull_request_target for label-pr-by-team.yml by @jiacy-jcy in #30628
- merge: from main to 3.0 branch by @guanshengliang in #30626
- fix(stream): remove continuous query test cases by @wangjiaming0909 in #30543
- merge: from main to 3.0 branch by @guanshengliang in #30643
- merge: from main to 3.0 branch by @guanshengliang in #30644
- merge: from main to 3.0 branch by @tomchon in #30653
- enh: test coverage for tlog.c by @kailixu in #30631
- merge: from main to 3.0 branch by @guanshengliang in #30665
- merge: from main to 3.0 branch by @guanshengliang in #30679
- fix test: fix fill2 test case by @wangjiaming0909 in #30669
- enh: wait checkpoint ready before pause stream by @jiajingbin in #30666
- fix: add tag data type check when create child table by @hzcheng in #30695
- fix: clear cache when meta abort by @hzcheng in #30674
- fix: [TD-34274] add-monitor-case by @cadem in #30677
- fix: fix possible test case failure by @hzcheng in #30714
- merge: from main to 3.0 branch by @guanshengliang in #30728
- fix: [TD-34459] add-waiting-leader by @cadem in #30707
- Fix: [td 34460] add more log output by @cadem in #30702
- merge: from main to 3.0 branch by @guanshengliang in #30742
- fix: the REPLICA parameter supports plural forms when used to create and alter a database by @guanshengliang in #30732
- fxi: docker run privileged by @facetosea in #30704
- Fix/ts 6244/show dnodes3.0 by @facetosea in #30667
- merge: from main to 3.0 branch by @guanshengliang in #30758
- docs(mqtt): add documetation for cached data configuration by @bitcapybara in #30047
- fix(dataformat): fix single column row copying by @stephenkgu in #30788
- remove tmq attribute enable.heartbeat.background by @DuanKuanJun in #30778
- taosBenchmark restore RESTFUL (3.0) by @DuanKuanJun in #30699
- enh(stream): add groupId in stream notification by @JinqingKuang in #30801
- merge: from main to 3.0 branch by @guanshengliang in #30808
- feat: added base64 SQL function by @aestriplex in #30625
- fix/TD-34460-create-tb-in-thread by @cadem in #30804
- docs(opc): add perssit data support by @bitcapybara in #30783
- merge: from main to 3.0 branch by @guanshengliang in #30834
- ci: modify branch in tdengine-test.yml by @tomchon in #30848
- fix(taosws-rs): modify the git tag of taosws-rs [TD-34624] by @qevolg in #30849
- docs(datain): add missing health status types by @bitcapybara in #30828
- fix: TS-6371-improve-snapshot-log by @cadem in #30857
- fix(tdb/flush): malloc from os when no pages flushed by @stephenkgu in #30866
- docs: jdbc tmq supports database subscription. [TS-6222] by @sheyanjie-qq in #30819
- docs: add description of the special characters supported by password in ODBC connector by @YamingPei in #30842
- merge: from main to 3.0 branch by @guanshengliang in #30916
- fix: mnode-status-case by @cadem in #30871
- enh: improve code coverage of taos-tools by @menshibin in #30915
- merge: from main to 3.0 branch by @guanshengliang in #30943
- fix: taosd cmd args by @facetosea in #30938
- modify workflow,change, pull_request to pull_request_target by @jiacy-jcy in #31013
- merge: from main to 3.0 branch by @guanshengliang in #31025
- enh: update database fetch functions to include status in JSON output by @cadem in #31005
- merge: from main to 3.0 branch by @guanshengliang in #31053
- merge: from main to 3.0 branch by @guanshengliang in #31060
- fix: double close wal meta file. by @xiao-77 in #31059
- update test doc format by @minhuinie in #31074
- merge: from main to 3.0 branch by @guanshengliang in #31115
- docs(datain): add topic meta options docs in tmq by @bitcapybara in #31147
- merge: from main to 3.0 branch by @guanshengliang in #31161
- Update new-framework-test.yml by @SallyHuo-TAOS in #31162
- fix doc format by @minhuinie in #31185
- test: migr...
3.3.6.9
Behavior change and compatibility
Features
- feat: support persisent cache in agent of opc
- feat: support Spark retrieving data from TDengine
- feat: add support for SSRS (SQL Server Reporting Services)
Enhancements
- enh: optimize the update logic for data subscription offsets.
- enh: update the method for generating driver version numbers
- enh: Explorer support \n in JSON payload
- enh: Kafka/MQTT support keep original payload/value
- enh: kafka group and client_id should be editable after imported
- enh: optimize the config parameter's persistence behavior
- enh: Explorer support normal table and virutal tables
- enh: support for cancelling compact tasks in progress.
- enh: optimize the processing of backtick (`) character in database table names
Fixes
- fix: fix tmq data loss via rust websocket connector
- fix: fix doc link target
- fix: memory leak in taos client when querying heartbeats fails.
- fix: memory leak during stmt2's high-efficiency writing while auto-creating tables.
- fix: some config are not displayed when using the taosd -C command
- fix: do not reset metrics after task stopped to view in explorer
- fix: subscription fails when the consumer group name contains colon
- fix: fix oom when restore with many files
- fix: the error message and error code for stmt2 are inconsistent.
- fix: fix explorer sql limit detection in backend
- fix: using stmt2 in non-insert and non-select statements causes crash
- fix: massive writes of duplicate data may cause taosd to restart.
- fix: taosX persist queue not work for read in windows
- fix: aarch64 taos shell input chinese chars error
- fix: time range parsing error in the compact command caused the corresponding data file groups to fail to reorganize.
- fix: when enabling the whitelist, drop dnode operations may fail.
What's Changed
- fix: delete the default database creation parameter vgroup by @menshibin in #31064
- docs: submit spark doc by @DuanKuanJun in #30927
- doc: update a figure. by @hjxilinx in #31072
- fix(stream): extends the node update check interval. by @hjxilinx in #31048
- feat: persist local configs' stypes. by @xiao-77 in #30925
- test: add more versions while exec compatibility.py. by @xiao-77 in #30856
- fix: concurrent execution compatibility test cases. by @xiao-77 in #31087
- fix: double close wal meta file. by @xiao-77 in #31083
- docs: update release note for 3.3.6.6 in office web by @feici02 in #31091
- fix(ipWhiteList): Refresh user IP white list when drop-dnode finished by @yihaoDeng in #31089
- opti(tmq): save tmq offset in vnode commit time & change log level by @wangmm0220 in #30993
- fix(parser):core by @Pengrongkun in #31080
- fix: table schema is too old while upgrade taosd version from 3358 to 3360. by @xiao-77 in #31036
- doc: add description of configuration parameters that can only be mod… by @xiao-77 in #31093
- refactor(stream): print some logs. by @hjxilinx in #31095
- reorganized catalog by @minhuinie in #31099
- enh: update the method for generating driver version numbers by @guanshengliang in #31098
- test: support caselist and env clean by @SallyHuo-TAOS in #31067
- fix: update symbolic links for libtaosws to support versioned files by @tomchon in #31107
- test: migrate cases by @guanshengliang in #31037
- chinese characters cannot be entered in the aarch64 version of taos by @menshibin in #31103
- fix: update symbolic links for libtaosws to support versioned files by @tomchon in #31111
- test: add batch test description in README by @SallyHuo-TAOS in #31112
- test: rename tdsql functions by @guanshengliang in #31065
- Cd/fix/libtaos version by @tomchon in #31118
- fix: update library file paths in makepkg.sh for consistency across platforms by @tomchon in #31122
- fix: update APR version to 1.7.6 and adjust URL_HASH by @tomchon in #31121
- fix: update library file paths in makepkg.sh for consistency by @tomchon in #31124
- fix: null rpc handler issue by @dapan1121 in #31104
- fix(stmt2):memleak insert into stb by @Pengrongkun in #31127
- fix: update library file paths in makeclient.sh to remove version suffixes for consistency by @tomchon in #31128
- docs: jdbc release 3.6.3 version by @sheyanjie-qq in #31132
- docs: superset with Other item to config by @DuanKuanJun in #31100
- fix: invalid time parse in compact database command by @hzcheng in #31135
- doc: Update index.md by @hjxilinx in #31144
- docs: add timezone handling information for query results in Go documentation by @huskar-t in #31146
- update flink connector version by @menshibin in #31148
- ci: change the exec frequency of the release build by @feici02 in #31153
- fix: ci compatibility test while alter tag size. by @xiao-77 in #31154
- fix(gpt): limite the covariate input for moirai. by @hjxilinx in #31119
- fix(stream): reset the sched status if sched failed. by @hjxilinx in #31163
- fix: some variables lost while excute taosd -C. by @xiao-77 in #31160
- fix: 修正变量DATA_DIR的大小写使用问题。 by @cockroach888 in #31157
- fix: 修正LD_LIBRARY_PATH定义时存在空路径问题。 by @cockroach888 in #31156
- chore: remove grafana gui installation by @sheyanjie-qq in #31168
- docs: add support for SSRS (SQL Server Reporting Services) by @DuanKuanJun in #31152
- enh(stmt2):add stmt2 log by @Pengrongkun in #31171
- enh: add error code for alter minReservedMemorySize. by @xiao-77 in #31125
- refactor(stream): check for write queue size for sink tasks. by @hjxilinx in #31172
- fix doc format by @minhuinie in #31186
- test: fix ci test compatibility. by @xiao-77 in #31181
- Update 01-taosd.md 修改错别字“checkponit”为“checkpoint” by @JuLongZhiLu in #31197
- fix(stmt2):errcode not match by @Pengrongkun in #31196
- append case link by @minhuinie in #31210
- add python stmt2 websocket docs by @menshibin in #31193
- fix: naming rule with quotation char by @kailixu in #31180
- Test/td 35047 by @SallyHuo-TAOS in #31218
- TD-35056 keep env alive by @minhuinie in #31229
- fix: add duplicate tolerance by @hzcheng in #31217
- fix(stmt): wrong sql type core by @Pengrongkun in #31226
- fix(stmt2):async exec reprepare by @Pengrongkun in #31242
- fix: avoid using : in consumer group by @wangmm0220 in #31225
- fix(stmt2): null sql core by @Pengrongkun in #31243
- doc: Update index.md by @hjxilinx in #31247
- add grafana windows installation by @sheyanjie-qq in #31249
New Contributors
- @JuLongZhiLu made their first contribution in #31197
Full Changelog: ver-3.3.6.6...ver-3.3.6.9
3.3.6.6
Behavior change and compatibility
Features
- feat: taosAdapter add process/connection-pools metrics etc.
- feat: support initialization scripts in docker image
- feat: subscribe database/stable in jdbc
- feat: TDgpt support covariate forecasting
- feat: add mqtt received bytes metric
Enhancements
- enh: connectors support special chars in password
- enh: increasing backup support interval < 60s
- enh: use consist error style in c websocket connection
- enh: adjust the authorization strategy for dual-node, dual-replica scenarios
- enh: upgrade JDBC connection in DBeaver
- enh: refine the timeout parameter in taosX backup
- enh: improve taosX backup performance
- enh: config parameter minReservedMemorySize supports hot updates.
- enh: taosX rename 2.x to TDengine Query, 3.x to Data Subscription
- enh: adjust the alter logic of the KEEP property for the super table
- enh: improve initialization performance in taosBenchmark
Fixes
- fix: when data contains a mix of null, none, and value entries, synchronizing data via TMQ may cause taosAdapter to crash
- fix: creating streams on virtual sub-tables with a NOTIFY statement produces no data in the super table
- fix: deadlock when websocket writes data using stmt2.
- fix: when using STMT write mode, failed SQL parsing can lead to memory leaks.
- fix: memory leaks when writing with STMT2 in multi-threaded mode
- fix: support chinese chars in taos shell with ws connection
- fix: timezone in taos.cfg not work in taosc websocket connection
- fix: multiple prepare operations on the same STMT statement can cause the program to crash.
- fix: multiple prepare operations on an STMT statement may report error.
- fix: allow spaces between \G and ;
- fix: taosBenchmark -s parameer parse error in
- fix: ensure uid/pwd are passed during ws_connect in ODBC
- fix: taosBenchmark create table with tag values cause core dump
- fix: when the time unit of timetruncate is set to y, it causes taosd to crash.
- fix: the reference to the zlib repository had the CVE-2023-45853 vulnerability
- fix: fix CVE-2024-56337 in JDBC example code
- fix: when querying a virtual table, an error "Table Schema is old" occurs if the query column order doesn't match the physical table's column order.
- fix: fix possible panic in exec of rust connector
- fix: support double-quote in opcua node id
- fix: stuck on stopping status when stop after connection failed
- fix: fix data lost in case of taosAdapter interrupted under sparse mode
- fix: when synchronizing data snapshots between multiple replicas, network failures that cause duplicate data transmission can lead to query errors
- fix: when user privlilege are updated, restarting taosd may cause client subscriptions to occasionally fail.
- fix: taosBenchmark json cfgdir not work
- fix: fix authentication failure in case of speciall chars in Explorer
- fix: when a DB contain a virtual table, setting snapshot=true in the subscription parameters causes taosd to coredump during subscription.
- fix: show create table and desc table statements return composite key instead of primary key
- fix: incorrect measurement point calculation when using virtual tables
- fix: stream compute on virtual tables was not triggered correctly.
- fix: taosX mem leak with native connection
- fix: fix copy-and-paste error in case of sql containing spaces in explorer
- fix: schema is old when origin table's column has same prefix during virtual supertable query
- fix: virtual tables can not detecting table schema changes
- fix: dedup timestamp in transformer now generator
- fix: stream computing result table not being fully created in certain situations
- fix: taosd fails to start after upgrading from 3.3.6.2 to 3.3.6.3.
- fix: taosd fails to start after modifying the timezone configuration parameter.
- fix: When subscribing, if the consumer's held WAL version has been deleted due to WAL file rolling, the subscription will fail.
- fix: Driver was not loaded error when using native connection on Mac platform
- fix: the number of windows in an Interval query is incorrect in the nanosecond database.
- fix: tables with decimal types may crash when filtering with tag conditions.
- fix: when the forecast function is provided with exactly the same data, some algorithms will report an error.
- fix: error when executing "DROP VTABLE IF EXISTS" on a non-existent virtual table.
- fix: error alert in explorer
- fix: migration cause error when rename table and schema mismatch
What's Changed
- fix: TD-34514-log-level by @cadem in #30756
- fix(stmt2):refactor stmt2 prepare cache reset by @Pengrongkun in #30769
- fix: add ThrottleInterval key(600s) to plist for taosd in macOS by @tomchon in #30771
- cmake.define /MT -> /MD windows by @DuanKuanJun in #30773
- fix: add conditional execution for ReviewDog reporting in CI workflow by @tomchon in #30776
- taoskeeper support new adapter metrics: connection pool and status by @sheyanjie-qq in #30760
- update doc for taosinstall tool by @zk66214 in #30777
- update dosc of inspect tools by @zk66214 in #30781
- feat: [TS-6333] Fix decimal attempting free on address which was not malloc()-ed. by @Simon9997 in #30764
- feat: change taosadapter log dir and log level by @SallyHuo-TAOS in #30763
- enh: add default log dir when examples case failed by @tomchon in #30795
- fix(tmq): update privilege for tmq if privilege change by @wangmm0220 in #30782
- fix(dataformat): fix single column row copying by @stephenkgu in #30787
- fix: TS-6336-get-epset by @cadem in #30770
- fix: memcpy with snprintf to fix build error by @DuanKuanJun in #30790
- fix(stmt2):non-interlace multi-prepare problem by @Pengrongkun in #30793
- docs: [TS-6094] Modify docs of virtual table. by @Simon9997 in #30799
- fix: make duplicate version acceptable by @hzcheng in #30794
- enh: reduce the amount of logs printed when the apply queue is full. by @xiao-77 in #30796
- fix fill range check for natural units by @wangjiaming0909 in #30789
- fix: json configuration not effective by @menshibin in #30785
- docs: update release note for 3.3.6.3 in office web by @feici02 in #30775
- docs: jdbc release 3.6.1, and update some comments by @sheyanjie-qq in #30809
- merge: taos-tools and case 3.0 to main branch by @DuanKuanJun in #30802
- enh(cfg): modify config behavior. by @xiao-77 in #30812
- fix(stmt2):fixed tag multi-prepare core by @Pengrongkun in #30813
- enh: disable the 'show scores' command by @guanshengliang in #30759
- add support of data types for composite primary key columns by @zk66214 in #30816
- feat(gpt): support covariate forecasting by @hjxilinx in #30806
- modify the taosBenchmark parameter issue in the Mac environment by @menshibin in #30818
- fix: set lcn = 0 while lastcompact = lastcommit. by @xiao-77 in #30774
- doc: update user manual. by @hjxilinx in #30825
- docs: update window pic by @guanshengliang in #30823
- fix(stream): parName is null by @wangmm0220 in #30592
- doc:pdate en pics by @guanshengliang in #30829
- fix: wrapper load so from /usr/local/lib/ on mac by @DuanKuanJun in #30822
- fix: [TS-6383] Fix drop vtable error. by @Simon9997 in #30820
- fix: show create table and desc table statements return composite key… by @guanshengliang in #30830
- doc: add description of DURATION. by @xiao-77 in #30833
- Freemine.cmake.3.0 by @freemine in #30663
- feat(gpt): add tdtsfm server by @hjxilinx in #30831
- fix: (TS-6376)jump virtual table if snapshot is true in tmq by @wangmm0220 in #30835
- ci: modify branch in tdengine-test.yml by @tomchon in #30847
- fix(taosws-rs): modify the git tag of taosws-rs [TD-34624] by @qevolg in #30845
- doc: Update 04-machine-learning.md by @hjxilinx in #30852
- doc: Update index.md by @hjxilinx in #30836
- test: migrate datatype cases by @guanshengliang in https://github.com/taosdata/...
3.3.6.3
Behavior change and compatibility
Features
- feat: taosBenchmark should suppport decimal datatype
- feat: add dnode information and components status
- feat: support auto commit in websocket subscription
- feat: add suggestions in case of large-throughput queries
Enhancements
- enh: taosBenchmark ctrl-c fast exit
- enh: reduce taosX db size
- enh: allow users without sysinfo privileges to execute the show anodes command.
- enh: stream computing supports the cols function.
- enh: support '/' in python taosrest connector
- enh: changed the keyword for composite primary keys from "primary key" to "composite key"
- enh: taosdump restore backups in case of cols del/add
Fixes
- fix: explorer support signup email with dot
.
- fix: user registration page not exist in oss explorer3
- fix: writing out-of-order data via stm2 may fail
- fix: when performing interval fill(prev) and sorting by _wstart, if there are null values encountered, the results may be incorrect.
- fix: the follower vnode sometimes remains in the restore=false state for a long time after restart
- fix: firstEp setting in taos.cfg not work in taosBenchmark
- fix: in STMT2 high-efficiency write mode, the write operation will fail when the value of the geometry field is NULL.
- fix: the createdb option does not work when creating user
- fix: support migration with sysinfo=0 in taosX
- fix: the deadlock issue caused by the failure of regex release during the taosd exit process
- fix: frequent creation and deletion of TOPIC causes TDB's disk space usage to keep growing.
- fix: windows compile error
- fix: call stmt_set_tags again after stmt_set_tbname_tags may cause memory leak.
- fix: taosX allow deleting tasks in "created" status
- fix: fix data lost in case of taosAdapter interrupted under sparse mode
- fix: leader election failure in a two-replica database under high throughput.
- fix: false alarm when update the database parameter s3_compact
- fix: SQL statements do not return when deleting a database with offline vnodes
- fix: explorer database name now case-sensitive
- fix: when rolling back a failed change from a single replica to three replicas, data cleanup errors during the rollback process can lead to the failure of the change.
- fix: when the length of the condition field in the system table information_schema.ins_user_privileges exceeds 32 characters, the displayed content is incomplete.
- fix: allow regular users to execute the show disk_info command
- fix: tables error in case of taosBenchmark input with csv
- fix: explorer max password length should be 255
- fix: excel odbc loading data error via websocket
- fix: stream computing result table not being fully created in certain situations
- fix: when the transaction to create a database fails, repeatedly sending messages can cause high CPU usage.
- fix: the number of file groups displayed by the “show compacts” command does not match the actual number.
- fix: stream task fails to start after the rolling upgrade.
- fix: the checkpointBackupDir being too large in the stream task.
- fix: when using Websocket parameter binding to batch write data, Chinese characters in subtable names will cause garbled text#29998
- fix: TDgpt may yield abnormal results when running on the ARM64 platform.
- fix: ftmt binding failure followed by re-binding causes a crash.
What's Changed
- test case checking workflow by @minhuinie in #30274
- refactor: test dir by @feici02 in #30280
- update jdbc highvolume example and efficient wiring docs by @sheyanjie-qq in #30422
- docs: en doc for tdgpt by @danielclow in #30397
- merge: from 3.0 to main branch by @guanshengliang in #30427
- docs: update installation instructions for Anode by @tjuzyp in #30425
- fix:remove stmt2_get_fields binfo cache by @Pengrongkun in #30420
- doc: update title by @hjxilinx in #30424
- test:add coverage workflow by @happyguoxy in #30435
- doc: update gpt doc. by @hjxilinx in #30428
- fix: coverage scripts by @guanshengliang in #30438
- docs: [TS-4897] Use markdown table instead of pics. by @Simon9997 in #30436
- enh: [TD-34190] remove-wrong-log by @cadem in #30408
- fix(gpt): add host into script by @hjxilinx in #30440
- docs: adjust tdgpt img size by @danielclow in #30439
- Update 01-introduction.md by @leemingjun in #30441
- feat: change package tar file name by @SallyHuo-TAOS in #30442
- fix(gpt): configure the host address by @hjxilinx in #30443
- ci: fix build error on macOS [skip ci] by @feici02 in #30445
- chore: update taos.cfg by @feici02 in #30448
- fix(gpt): update the host port by default. by @hjxilinx in #30447
- doc: update doc by @hjxilinx in #30449
- ci: add two more triggers by @feici02 in #30451
- fix: update product names in release script for TDgpt by @tomchon in #30452
- doc: update doc. by @hjxilinx in #30453
- doc: update the doc. by @hjxilinx in #30455
- docs: update release note for 3.3.6.0 in office web by @feici02 in #30454
- Update 3.3.6.0.md by @tomchon in #30458
- docs: Update 02-tutorial.md by @jiajingbin in #30460
- enh: add Dockerfile for TDgpt and modify dockerbuild.sh for cloud-tdgpt by @jiajingbin in #30446
- enh: allow ordinary users to execute the “show anodes” command. by @guanshengliang in #30464
- docs:fix install.sh with a non-root user and add denpendencies in 02-tutorial.md by @tomchon in #30459
- fix: rollback error release note by @guanshengliang in #30465
- fix(gpt): add training script. by @hjxilinx in #30466
- enh: allow users to see all fields in "show anodes" by @guanshengliang in #30467
- docs: Update 02-tutorial.md for tdengine-tdgpt-full by @jiajingbin in #30471
- doc: update docs. by @hjxilinx in #30468
- fix: show anodes by @guanshengliang in #30474
- docs: revise the document directory structure by @guanshengliang in #30472
- doc: update doc. by @hjxilinx in #30475
- docs: update tdgpt installation steps by @jtao1735 in #30478
- doc: update doc for timegpt by @hjxilinx in #30477
- docs/ optimize the description regarding taosAdapter by @yu285 in #30481
- docs/ correct the "variable" to "variables" by @yu285 in #30482
- docs: minor changes by @guanshengliang in #30484
- fix: the follower vnode sometimes remains in the restore=false state for a long time after restart by @guanshengliang in #30490
- doc: Update 02-tutorial.md by @hjxilinx in #30486
- Update 30-python.md for taospy official name by @DuanKuanJun in #30487
- Update 04-machine-learning.md by @hjxilinx in #30497
- docs: jdbc 3.6.0 and fix grafana compose cfg issue by @sheyanjie-qq in #30499
- fix(csv): fix lost some ctbs while create table using csv file. by @xiao-77 in #30483
- improve highvolume pic by @sheyanjie-qq in #30505
- ci: add cloud docs to tdengine-doc-build.yml by @tomchon in #30502
- docs: add installation doc for TDengine Enterprise by @zitsen in #30509
- doc: update docs. by @hjxilinx in #30510
- TDengine case docs by @minhuinie in #30495
- feat(taosBenchmark): supports decimal data type on main branch by @YamingPei in #30504
- docs: remove the relevant content of Flink Source CDC from the offici… by @menshibin in #30462
- docs: correct pip by @feici02 in #30517
- Update 01-introduction.md by @tomchon in #30511
- docs: fix link to taosd reference manual in node configuration sect...
3.3.6.0
Behavior change and compatibility
Features
- feat: supports Decimal data type
- feat: improve compatibility of taosc
- feat: support retrieving the values of other columns in the row returned by the single-row selection function through the cols keyword.
- feat: integrate with haixun database api
- feat: support constant as join primary key
- feat: change the max value of minFreeDiskSize to 2TB
- feat: supports control the retention period of time-series data in the supertable via the KEEP parameter.
- feat: support backup to s3 storage in taosX
- feat: effient data writing in JDBC
- feat: improve error handling of taosX
- feat: support persistent cache to guarantee data completement
- feat: interate with perspective BI library
- feat: support taos_validate_sql in websocket
- feat: integrate Tableau with ODBC driver
- feat: supports virtual table
- feat: taosbechmark can generate csv files
- feat: TDengine now integrate with FineBI
- feat: supports the use of virtual tables in stream computing
- feat: stream computing supports the continue_window_close trigger mode.
- feat: stream computing supports window event notification
- feat: stream computing support setting a minimum duration limit for event window and state window.
- feat: support for greatest and least Functions
- feat: provide an alias regexp for the operator match.
- feat: experimental decimal data types support in explorer
- feat: support decimal types in rust connector
- feat: taosX/agent support https connection
- feat: explorer add support for sql formatter
- feat: taosX support export/import data-in tasks
- feat: support request ts as primary key in opc-da
Enhancements
- enh: when the topic enables the "only meta" option, the data subscription interface will no longer transmit time-series data.
- enh: support compact TDB files.
- enh: execute stream creation asynchronously to reduce response time.
- enh: improve kafka performance in taosX
- enh: support index creation for tag fields of nchar and varchar types.
- enh: significantly enhance the data synchronization performance between clusters
- enh: optimize the distribution of data files across multiple disks within the same tier in multi-level storage
- enh: connectors support new subscription params
- enh: improve the write performance of automatic table creation
- enh: taosX should raise error when WAL retention period is 0
- enh: improve error messages in explorer
- enh: improve performance of mqtt fetching messages
- enh: c# connector add async receiver for websocket connection
- enh: filter timestamp by configuration for hebei power transform
- enh: suppport stmt via websocket in taosBenchmark
- enh: increase the error troubleshooting information for dual-replica databases
- enh: improve consumer polling strategy in ws(taosAdapter)
- enh: Interp function supports interpolation over a time range.
- enh: support for monitoring vnode recovery progress through SQL
- enh: tracking new database with replica cli
- enh: support the use of conditional expressions in the CAST function
- enh: supports using the LIKE keyword in the SHOW VARIABLES series commands to enable pattern matching for variable names.
- enh: root can view/edit all tasks in explorer
- enh: OPCDA datasource table template can use {/tagname}{id}{_id} extractor
- enh: introduce the "assign leader" command for dual-replica clusters to address the issue of cluster recovery when a dnode with a higher WAL version fails to start.
- enh: optimize the service recovery time of a dual-replica cluster after a single-node failure
- enh: refactor the STMT code to significantly enhance query and write performance.
- enh: improve benchmark writing robotics
- enh: extend the maximum password length to 255 characters.
- enh: when subscribe data, consumers can set the minimum rows and maximum waittime.
- enh: respect to log.* settings in configuration for opc logs
- enh: C taosws support session.timeout.ms
- enh: support long passwords with special characters in all components
- enh: support additional subscription parameters in JDBC
- enh: Python consumer can subscribe topic using newly added parameters
- enh: allow newly added subscription params without updating connectors
- enh: MQTT fallback to ssl when tcp failed
- enh: add a percentage sign (%) after the compression ratio value in the results displayed by show disk_info.
- enh: includes inspection tools in the Enterprise Edition.
- enh: stream computing supports sliding window in the force_window_close mode
- enh: supports silent uninstallation of the tar package using the -e parameter.
- enh: improve the efficiency of downsampling and group by tag queries
- enh: taosX does not allow start repeatedly
- enh: add DST(Daylight Saving Time) guideline
- enh: improve cpu/mem performance in OPC data-in
- enh: use fixed seconds format in explorer table view
- enh: support deletion of topics with active consumers.
Fixes
- fix: OOM may occur when dropping a super table containing a large number of child-tables.
- fix: taosX util to read archived data
- fix: explorer should raise error when password is not valid
- fix: In stmt2 interlace mode, asynchronous execution returns incorrect affectrow count.
- fix: explorer display error reason for backup tasks
- fix: vnode may go offline when dnode is overloaded
- fix: stream computing experiences a significant backlog of transactions during vgroup leader switch, resulting in computational delays.
- fix: fix explorer oss --version error
- fix: support special characters of password in Node.js
- fix: random value out of range in taosBenchmark
- fix: fix os error 10053 on windows for OPCUA
- fix: taosX panic when adapter/nginx restarted in some cases
- fix: the results of the show disk_info command are incorrect when configuring multi-level storage.
- fix: typo in the execution result of show .disk_info
- fix: when querying super table, using ORDER BY and LIMIT together may return an unexpected record.
- fix: allow health params in 2.x data-in
- fix: backup next execution time does allow past time
- fix: fix compatibility of backup task upgrading to latest
- fix: query error when performing a UNION operation on multiple nested queries.
- fix: in state window queries, if the same expression exists in both the PARTITION BY and SELECT clauses, it will cause taosd to crash.
- fix: when the subquery does not return any results but contains the LIMIT 1 clause, it may cause the result of the parent query to be abnormal or inaccurate.
- fix: taosc crash when table names contain
*
- fix: on windows, closing a JDBC PreparedStatement while writing data may cause the JVM to crash.#30106
- fix: when using Websocket parameter binding to batch write data, Chinese characters in subtable names will cause garbled text #29998
What's Changed
- Revert "Revert "Enh:[td 29974]improve trans"" by @guanshengliang in #29378
- enh: add more cases by @hzcheng in #29369
- merge: from main to 3.0 branch by @guanshengliang in #29389
- Revert "Revert "Revert "Enh:[td 29974]improve trans""" by @guanshengliang in #29392
- Revert "Revert "Revert "Revert "Enh:[td 29974]improve trans"""" by @guanshengliang in #29393
- test: add test case for auto compact by @kailixu in #29374
- Enh/stmt2-testcase by @Pengrongkun in #29363
- test case by @facetosea in #29398
- merge: from main to 3.0 branch by @guanshengliang in #29397
- enh/TD-29974-improve-trans-add-case by @cadem in #29371
- [TD-33393] fix(keeper): add gitinfo by @qevolg in #29414
- merge: from main to 3.0 branch by @guanshengliang in #29423
- test: add test cases and fix related bugs. by @hjxilinx in #29381
- fix(docs/s3): make OBS explicitly by @stephenkgu in #29428
- Enh(coverage):config&wal by @xiao-77 in #29417
- fix:[TD-33396]add log for tmq by @wangmm0220 in #29427
- Enh/hz-testcase by @hzcheng in #29352
- Fix(cover):fix some review errors in pr 29417. by @xiao-77 in #29434
- fix drop view caused crash by @wangjiaming0909 in #29432
- fix:[TS-5651]skip-sync-heartbeat by @cadem in #29450
- merge: from main to 3.0 branch by @guanshengliang in #29454
- fix(test/blob): not run UT of blob by @stephenkgu in #29459
- fix:[TD-32471]set error code to terrno if tmq_consumer_poll return NULL by @wangmm0220 in #29436
- fix: snapshot.py failed by @hzcheng in #29468
- fix: set parent sort error by @facetosea in #29482
- Freemine.lemon.warning.as.error.with.jointest by @freemine...
3.3.5.8
Behavior change and compatibility
Features
- feat: suppport tmq subscription with ONLY META in JDBC
- feat: support multiple-line SQL editor in Grafana
- feat: add support for VARBINARY/GEOMETRY in ODBC
- feat: support TDengine with ODBC dirver in Excel
- feat: taosX agent use specific port range in local connection
Enhancements
- enh: websocket handle consumer error when tmq polled nothing
- enh: JDBC add support for unsigned integers
- enh: expose global.written_concurrent configuration for kafka/mqtt/csv in Explorer
- enh: support integration with TDgpt in community version
- enh: support BinaryRowData type in flink
- enh: in stmt2 SQL statements, the LIMIT clause supports the use of ? as a parameter placeholder
- enh: enable compression via websocket in taosX backup
- enh: ODBC support SQL_ROWSET_SIZE in SQLSetStmtAttr
- enh: expose num.of.consumers/writters configurations in Explorer
- enh: Add connector files to the macOS installation package.
- enh: handle errors when poll result is null in rust connector
- enh: tsbs support csv output format
- enh: add Classified Connections Counts table in TDinsight
- enh: use consist float precision in explorer and tao shell
- enh: flink table support update/delete
- enh: taosX agent will resume connection when taosX server disconnected for long time
Fixes
- fix: explorer support signup email with dot
.
- fix: flock syscall error on aws cloud storage in taosAdapter
- fix: modify boolean tag values in sub-tables results in erroneous metadata from data subscriptions.
- fix: allow spaces in columns of csv in explorer datain
- fix: resolved the issue of high CPU usage by the stmtbind thread when the system is in an idle state
- fix: health state tick to idle when no data consumed
- fix: fix security issues in JDBC sample code
- fix: fix upgrade compaibility issue of taosX
- fix: ODBC core when set SQL_ATTR_TXN_ISOLATION with SQLSetConnectAttr
- fix: received/processed_messages should be reset when task rerun
- fix: when restoring data using taosX, it may crash if the database is not specified
- fix: when creating a database, the keep_time_offset options supports suffixes h (hours) and d (days) for time values
- fix: potential deadlocks while drop stream
- fix: failed to write data in a dual-replica database when a single dnode is disconnected from the network
- fix: when querying the information_schema.ins_tables table, a "Sync leader is unreachable" error may be triggered if the Leader of the mnode changes.
- fix: the time-filtering query results involving composite primary keys were incorrect after data compact
- fix: when the join condition of the primary key column is not a simple equality condition, it may lead to incorrect JOIN results
- fix: error caused by cursor.fetchmany with custom length in python taosws
- fix: the issue where the "show grants" command returned an incorrect number of columns
- fix: unexpected backup points before schedule executing
- fix: taosX task does not restart after interrupted
- fix: jdbc select server_version() caused mem high-usage
- fix: when using the WHERE tbname IN () statement, executing LAST query may cause taosd crash if the subtables filtered out do not belong to the same super table
- fix: after taosd exits abnormally and is restarted, if the WAL that has not been written to the data file is too large, it may cause an OOM error during startup
- fix: when using interp interpolation, if the select list contains string constants or string tags, the returned string content may be incomplete.#29353
- fix: when performing a JOIN query on a super table, using a subquery as the right table may lead to missing results
- fix: syntax error while use DISTINCT and ORDER BY together.#29263
- fix: when using the CAST function to convert a floating-point number to a binary and then performing a comparison, the result may be inaccurate due to loss of precision#29382
- fix: after upgrading from version 3.3.4 to 3.3.5, the taosd service fails to start properly if the configured charset does not exist in the system
- fix: websocket api timing field should not be negtive
- fix: duplicates backup points in taosX
- fix: configuration item s3BucketName was incorrectly set as a global variable, leading to failures while file uploads to S3.
What's Changed
- readme refactor by @feici02 in #29529
- update readme by @feici02 in #29547
- Merge latest codes from main branch by @flyingangel2013 in #29563
- docs: update the structure for testing readme by @feici02 in #29580
- docs: add note for tsbs test by @tomchon in #29581
- doc: fix error in doc. by @hjxilinx in #29583
- doc: add Chaos Test to README and update some functions by @jiajingbin in #29587
- enh: remove stt_trigger limitation of community version. by @hzcheng in #29582
- ci:modify test readme by @tomchon in #29588
- fix(query)[TS-5907]: skip some decompressTest sub-cases on machines without AVX2 support by @JinqingKuang in #29586
- Docs/chr1 readme by @tomchon in #29589
- ci:modify test readme by @tomchon in #29590
- ci:modify test readme by @tomchon in #29591
- jdbc update to 3.5.2 by @sheyanjie-qq in #29592
- docs/optimize the description in "BALANCE VGROUP LEADER".md by @yu285 in #29577
- update README structure for support linux/win/mac platforms by charles by @tomchon in #29469
- fix/insert-when-2-replicas by @cadem in #29595
- enh: merge contrib test by @guanshengliang in #29593
- conditionally bypass some specific unit tests by @freemine in #29443
- fix(stream): adjust the free stream meta position and check the close flag by @hjxilinx in #29598
- enh: elapsed sma by @facetosea in #29578
- Update release note for 3.3.5.2 in office web by @feici02 in #29606
- docs(flink): modify source name by @menshibin in #29607
- enh:[TD-32588]refactor stmt-async-bind loop usleep to Producer Consumer Model by @Pengrongkun in #29611
- doc:update flink connector version by @menshibin in #29619
- fix(rpc):use tsApplyMemoryAllowed to control memory alloc while apply msg. by @xiao-77 in #29618
- fix:[TD-33570]return same error code by @Pengrongkun in #29610
- Fix:[td-33582] stmt get dont add errcode by @Pengrongkun in #29614
- Update 01-taosd.md by @liuyq-617 in #29604
- Update 01-arch.md by @WhiteFirry in #29605
- Update 04-maintenance.md by @WhiteFirry in #29620
- docs: add Tableau usage documentation by @menshibin in #29624
- Fix merge errors from pr 29618. by @xiao-77 in #29627
- docs: modify ODBC data source configuration jump by @menshibin in #29628
- fix:[TD-33556] tmq close elegantly to avoid invalid read in TD-32585 by @wangmm0220 in #29613
- Update 09-backup.md by @JackDong66 in #29630
- test:alter branch build by @happyguoxy in #29631
- fix:[TS-5941] fix interpolate varchar/nchar data error by @Simon9997 in #29634
- test: check default expire time by @kailixu in #29621
- fix: invalid subtable in tbname list by @dapan1121 in #29626
- enh: support ? in limit clause by @dapan1121 in #29633
- jdbc add unsigned data types support by @sheyanjie-qq in #29636
- fix(stream): check the checkpoint-report transId and checkpointId by @hjxilinx in #29615
- add chinese README by charles by @flyingangel2013 in #29647
- enh: refactor telemetry scripts by @jiajingbin in #29617
- fix:[TD-33600] windows error if taos exist without connection by @wangmm0220 in #29646
- enh: accelerate tsdb snapshot when data are all in stt file by @hzcheng in #29645
- fix: add table meta validation error and debug log by @dapan1121 in #29651
- enh(analysis): enable community edition to support anodes. by @hjxilinx in https://github.com/taosdata/TDengine/pul...
3.3.5.2
Behavior change and compatibility
Features
- feat: taosX now support multiple stables with template for MQTT
Enhancements
- enh: improve taosX error message if database is invalid
- enh: use poetry group depencencies and reduce dep when install taosdata/taos-connector-python#251
- enh: improve backup restore using taosX
- enh: during the multi-level storage data migration, if the migration time is too long, it may cause the Vnode to switch leader
- enh: adjust the systemctl strategy for managing the taosd process, if three consecutive restarts fail within 60 seconds, the next restart will be delayed until 900 seconds later
Fixes
- fix: the maxRetryWaitTime parameter is used to control the maximum reconnection timeout time for the client when the cluster is unable to provide services, but it does not take effect when encountering a Sync timeout error
- fix: supports immediate subscription to the new tag value after modifying the tag value of the sub-table
- fix: the tmq_consumer_poll function for data subscription does not return an error code when the call fails
- fix: taosd may crash when more than 100 views are created and the show views command is executed
- fix: when using stmt2 to insert data, if not all data columns are bound, the insertion operation will fail
- fix: when using stmt2 to insert data, if the database name or table name is enclosed in backticks, the insertion operation will fail
- fix: when closing a vnode, if there are ongoing file merge tasks, taosd may crash
- fix: frequent execution of the “drop table with tb_uid” statement may lead to a deadlock in taosd
- fix: the potential deadlock during the switching of log files
- fix: prohibit the creation of databases with the same names as system databases (information_schema, performance_schema)
- fix: when the inner query of a nested query come from a super table, the sorting information cannot be pushed up
- fix: incorrect error reporting when attempting to write Geometry data types that do not conform to topological specifications through the STMT interface
- fix: when using the percentile function and session window in a query statement, if an error occurs, taosd may crash
- fix: the issue of being unable to dynamically modify system parameters
- fix: random error of tranlict transaction in replication
- fix: the same consumer executes the unsubscribe operation and immediately attempts to subscribe to other different topics, the subscription API will return an error
- fix: fix CVE-2022-28948 security issue in go connector
- fix: when a subquery in a view contains an ORDER BY clause with an alias, and the query function itself also has an alias, querying the view will result in an error
- fix: when changing the database from a single replica to a mulit replica, if there are some metadata generated by earlier versions that are no longer used in the new version, the modification operation will fail
- fix: column names were not correctly copied when using SELECT * FROM subqueries
- fix: when performing max/min function on string type data, the results are inaccurate and taosd will crash
- fix: stream computing does not support the use of the HAVING clause, but no error is reported during creation
- fix: the version information displayed by taos shell for the server is inaccurate, such as being unable to correctly distinguish between the community edition and the enterprise edition
- fix: in certain specific query scenarios, when JOIN and CAST are used together, taosd may crash
What's Changed
- fix(docs/s3): make OBS explicitly by @stephenkgu in #29429
- feat: add source msg to cleanup function when exit by @jiajingbin in #29421
- fix(stream): replace functions with safty ones. by @hjxilinx in #29404
- docs : add subscription for debugFlag by @wangmm0220 in #29430
- fix:[TD-33396]add log for tmq by @wangmm0220 in #29415
- add flink doc by @menshibin in #29425
- chore: adjust badges by @feici02 in #29440
- chore: correct typo in taoskeeper workflow by @feici02 in #29441
- modify flink connector docs param note by @menshibin in #29444
- docs: add 33~35 FAQ problem by @DuanKuanJun in #29445
- update jdbc version to 3.5.1 by @sheyanjie-qq in #29431
- fix(stream): fix dead-lock caused by invalid repeatly unlock. by @hjxilinx in #29447
- Update release note for 3.3.5.0 in office web by @feici02 in #29452
- Test/main/3.3.5.0 by @SallyHuo-TAOS in #29453
- Fix/m/td 33390 by @wangjiaming0909 in #29451
- Update setup_env.sh for TDinternal by @tomchon in #29438
- fix:update compiling explorer from taosx repo by @tomchon in #29442
- fix(test/blob): not run UT of blob by @stephenkgu in #29461
- add detail err msg by @yihaoDeng in #29456
- chore: fix broken career link by @feici02 in #29463
- modify version note by @menshibin in #29446
- docs:remove useless docs by @wangmm0220 in #29466
- fix:[td-33417&td-33419]fix bug and add unit test by @Pengrongkun in #29457
- fix: possible snapshot.py fail by @hzcheng in #29470
- fix(keeper): add enterprise and community edition info by @qevolg in #29458
- fix: eliminate duplicated read locks in one thread by @kailixu in #29478
- fix:[TS-5651]skip-sync-heartbeat by @cadem in #29449
- Create CODEOWNERS by @feici02 in #29485
- fix: eliminate the risk of deadlock when switching log file by @kailixu in #29480
- docs: update taosKeeper doc by @qevolg in #29483
- fix invalid lock by @yihaoDeng in #29472
- enh/stmt-unit-test by @Pengrongkun in #29486
- fix: set parent sort error by @facetosea in #29484
- fix ps/grep/kill flaws found in test.script by @freemine in #29372
- docs/add a tip in Update 07-explorer.md by @yu285 in #29496
- Update 02-concept.md by @children1987 in #29479
- improve tsma doc by @wangjiaming0909 in #29464
- Update 20-keywords.md by @KianWang069 in #29473
- docs/add port number in 01-dbeaver.md by @yu285 in #29474
- docs/ optimize the description in Update 03-table.md by @yu285 in #29475
- docs: fix taosAdapter and rest-api docs by @huskar-t in #29487
- docs(grafana): integrate in explorer by @pigzhou in #29305
- fix(stream):stream unsupported having clause by @54liuyao in #29490
- [sync] change hash table func by @yihaoDeng in #29498
- fix: union clause description error by @dapan1121 in #29501
- docs: csharp connector release 3.1.5 by @huskar-t in #29506
- docs: format and typo processing by @kailixu in #29509
- fix: alias not keep in view issue by @dapan1121 in #29494
- fix: incorrect prompt when log on taos without sysinfo privilege by @kailixu in #29503
- fix: meta entry snapshot problem for old version by @hzcheng in #29499
- fix(query)[TS-5878]: correct column name for SELECT * FROM subquery by @JinqingKuang in #29507
- add sync-timeout retry by @yihaoDeng in #29481
- fix:[TD-33473] Fix cleanup percentile failed. by @Simon9997 in #29500
- docs: fix broken links in main by @danielclow in #29513
- Fix(cfg): resolve dynamic configuration update failure after rolling … by @xiao-77 in #29502
- enh: expand StartLimitInterval to avoid infinite reboot by @kailixu in #29523
- fix(stream): check the stream task last ready timestamp before start the checkpoint procedure. by @hjxilinx in #29517
- fix: correct error message when CREATE TABLE under system databases by @haolinw in #29492
- enh: expand StartLimitInterval to avoid infinite reboot by @kailixu in #29526
- fix:TD-33470 remove ge...
3.3.5.0
Behavior change and compatibility
Features
- feat: refactor MQTT to improve stability and performance
- feat: refactor taosX incremental backup-restore
- feat: add stmt2 apis in JDBC via websocket connection
- feat: add stmt2 api in Rust connector
- feat: adding error codes in error prompts in taos-CLI
- feat: superSet can connect TDengine with python connector
- feat: configurable grafana dashboards in explorer management
- feat: add taosX-agent in-memory cache queu capacity option
Enhancements
- enh: adjust the reporting mechanism of telemetry.
- enh: support for SQL-based statistics of disk space for a specified DB.
- enh: add memory management for SQL queries on the server side
- enh: INTERVAL clause allows the use of the AUTO keyword to specify the window offset.
- enh: reduce the impact on data write performance during data migration across multi-level storage
- enh: migrate from angular to react for grafana 11.3+
- enh: refactor taosAdapter websocket api for a slightly better perf
- enh: add health state in taosX task status
- enh: taosX add configurations to handle exceptions
- enh: support setting options for client connections, including time zone, character set, user IP, and user name.
- enh: taosdump support retry after connection timeout or broken
- enh: allow creating index for tags that already subscribed
- enh: taosX now support literal special chars in password
- enh: improve data write performance when Last Cache is activated.
- enh: COMPACT command supports automatic execution, concurrency setting, and progress observation.
- enh: support update global configuration parameters through SQL statements and persisting them.
- enh: update the default compression method for all data types to improve the compression ratio in most scenarios.
- enh: taosBenchmark --nodrop fix for mac/window
- enh: prohibit the simultaneous execution of DB compaction and replica change operations (Enterpris).
- enh: taosdump support primary key tables
- enh: display user IP and name in the results of the SHOW QUERIES and SHOW CONNECTIONS statements.
- enh: (JDBC)support batch insertion into multiple tables
- enh: support for dynamically modifying the dataDir parameter for multi-level storage.
- enh: prefer db file under data_dir
- enh: enforce users to set strong passwords, which must be 8 to 16 characters in length and include at least three types of characters from the following: uppercase letters, lowercase letters, numbers, and special characters.
- enh: improve the speed at which clients acquire the new Leader.
- enh: support negative regex pattern in opc point selector
Fixes
- fix: the potential for deadlocks when updating checkpoints in stream computing under high-load scenarios.
- fix: write tmq data into target error when terrno already set
- fix: taosd cannot start when there is data corruption in a block within the WAL
- fix: taosBenchmark fails when taosd disconnected in replica 2/3
- fix: log files being lost when they are switched frequently.
- fix: the stream computing stops due to the data update within the window.
- fix: libtaosws.so sets an incorrect error code when the connection is terminated while fetch data.
- fix: taosX opc error in case of @-prefixed name
- fix: fix permission denied with show vgroups sql in cloud
- fix: fix sql syntax error when migrating from large stables with compress options
- fix: incorrect memory estimation for vnode usage
- fix: failed to perform UNION ALL query on constant strings of the varchar type.
- fix: leader transfer during the execution of transaction may cause deadlock.
- fix: rust connector invliad pointer addr in ws_stmt_get_tag_fields
- fix: UNION statement fails when executing with subqueries containing multiple NULLs.
- fix: the pause operation of stream computing might fail.
- fix: when writing data into a sub-table with a table name length of 192 characters using an SQL statement, errors may occur if the table name is enclosed in backticks (`).
- fix: when performing a join query on super tables across different databases, if each database contains only one vnode, the query will return an error.
- fix: no enough disk space cause taosX panic
- fix: when write data to a super table, using both bound and unbound simultaneously will trigger an exception.
- fix: metrics non-exist cause panic when connect with agent
- fix: when creating indexes for tag with a large character length, taosd may crash.
- fix: when the input parameters for the functions first, last, last_row, and char exceed 127, the taosd may crash. #29241
- fix: when the number of rows in the result set of the LIMIT statement exceeds the size of a single data block, the returned count does not match the expectation.
- fix: when synchronizing data between clusters, if the target task is deleted, the source cluster may run out of memory
- fix: metadata read-write lock misconfiguration leads to a very small chance of blocking writes.
- fix: when importing CSV files using the INSERT INTO statement on the Windows platform, the absence of a newline character at the end of the file may lead to an issue of infinite loop reading.
- fix: after the tags of the table are updated, the stream computing fails to recognize and apply the ne values.
- fix: fix kafka timeout issue and improve performance and stability
- fix: in SQL queries, when both 'is null' and invalid 'in' filter conditions are included simultaneously, the query results are incorrect. #29067
- fix: SQL queries containing both 'IN' and 'BETWEEN' filter conditions result in incorrect query results. #28989
- fix: when performing multiplication or division operations between timestamp and numeric types, the results are incorrect. #28339
- fix: data type conversion error in the IN statement leads to incorrect query results. #29047 #28902
- fix: the error in filtering results when constant conditions are combined with OR operators. #28904
- fix: when performing subtraction operation on timestamp type, the negative value is not considered. #28906
- fix: tag values may display incorrectly when using GROUP BY tag synatix
- fix: gcc < 10 bug cause taosX compile error
What's Changed
- 3.0 by @cadem in #28591
- 3.0 by @cadem in #28654
- merge: from main to 3.0 by @guanshengliang in #28695
- Td31284 by @flyingangel2013 in #27106
- fix:[TD-32563] remove config variable slowLogThresholdTest by @wangmm0220 in #28400
- fix TD-32519 drop child table with tsma caused crash by @wangjiaming0909 in #28647
- update spring version, improve demo code by @sheyanjie-qq in #28705
- doc: update the documents for analysis framework. by @hjxilinx in #28704
- doc: fix error. by @hjxilinx in #28710
- merge: from main to 3.0 branch by @guanshengliang in #28709
- enh: add test case for grant by @kailixu in #28708
- Update 02-database.md by @boxiaobj in #28713
- doc: Update index.md by @hjxilinx in #28726
- test: add smoke test scripts by @tomchon in #28685
- doc: refactor docs. by @hjxilinx in #28730
- docs(datain:csv): rewrite the csv documentation after optimization by @tjuzyp in #28668
- doc: refactor analysis docs. by @hjxilinx in #28733
- doc: update docs. by @hjxilinx in #28737
- doc: update figs. by @hjxilinx in #28738
- doc: update docs. by @hjxilinx in #28740
- test:add docs ci in jenkinsfile2 by @tomchon in #28748
- doc: update analytics docs. by @hjxilinx in #28754
- docs(mqtt): add new advance options in mqtt datain by @bitcapybara in #28725
- doc: update analytics docs. by @hjxilinx in #28760
- docs(debug):Add debugging tool installation suggestions. by @xiao-77 in #28732
- merge: from main to 3.0 branch by @guanshengliang in #28762
- doc: update analytics documents. by @hjxilinx in #28768
- refactor: return the error code and do some refactor. by @hjxilinx in #28758
- docs(database): add arch diagram for property keep by @pigzhou in #28775
- doc(arch/last): new section for last/last_row cache by @stephenkgu in #28764
- doc: Update 02-anomaly-detection.md by @hjxilinx in #2...