Skip to content

Release v0.10.3-redis-connect
Compare
Choose a tag to compare
@viragtripathi viragtripathi released this 19 Aug 03:13
· 31 commits to main since this release
v0.10.3-redis-connect-5
6ad33da

🚀 Changelog

🧰 Enhancements

  • Enhanced SAVE checkpoint process to handle checkpoints that do not contain the 'connect:name' attribute by creating a new temporary checkpoint key with a {manual-skip} suffix when checkpointTransactionsEnabled=true
  • Enhanced metrics by splitting total latency between lag and pipeline latency so both can be visualized by default via the grafana dashboard
  • Enhanced validations related to credentials directory paths for SAVE job configuration and START job processes
  • Added support for "CUSTOM" JobSourceTableColumnDTO type so built-in data type transformations are bypassed allowing them to be handled manually in a custom stage
  • Added support for stop-node ("stop") and redis-connect-version ("-v") commands via Java ARGS in the start-up script
  • Added debezium-related filters to the default logback.xml for DEBUG and TRACE log levels
  • Replaced use of 'passThroughEnabled' for MongoDB to pass through non-configured columns with a new JobSource.Table attribute 'dynamicSchemaEnabled'
  • (Not backward compatible) Changed jobmanager.properties attribute name from 'cluster.leader.heartbeat.lease.renewal.interval to 'cluster.leader.heartbeat.lease.renewal.ttl'
  • (Not backward compatible) Changed jobmanager.properties attribute name from 'job.claim.heartbeat.lease.renewal.interval' to 'job.claim.heartbeat.lease.renewal.ttl'
  • (Not backward compatible) Changed jobmanager.properties attribute name from 'credentials.file.path' to 'credentials.dir.path'
  • (Not backward compatible) Changed Database custom configuration attribute name from 'truststore' to 'truststore.file.path'
  • (Not backward compatible) Changed Database custom configuration attribute name from 'keystore' to 'keystore.file.path'
  • (Not backward compatible) Changed JobSource.Table attribute name from 'passThroughEnabled' to 'autoConfigColumnsEnabled'
  • (Not backward compatible) Changed JobSource.Table attribute name from 'prependTableNameToKeysEnabled' to 'prefixTableNameToTargetKeyEnabled'
  • (Not backward compatible) Changed JobSource.Table attribute name from 'deleteOnKeyUpdateEnabled' to 'deleteOnPrimaryKeyUpdateEnabled'
  • (Not backward compatible) Changed JobSource.Table attribute name from 'publishChangedColumnsOnlyEnabled' to 'changedColumnsOnlyEnabled'
  • (Not backward compatible) Changed JobSource.Table attribute name from 'rowIndexUsedAsPrimaryKeyEnabled' to 'rowIndexUsedAsTargetKeyEnabled'
  • (Not backward compatible) Changed JobSourceTableColumn attribute name from 'primaryKey' to 'targetKey'
  • (Not backward compatible) Changed JobSourceTableColumn attribute name from 'publishChangedColumnsOnlyEnabled' to 'changedColumnOnlyEnabled'
  • (Not backward compatible) Removed 'publishBeforeEnabled' attribute from JobSource.Table and JobSourceTableColumn
  • (Not backward compatible) Removed 'ignoreInsertsEnabled' attribute from JobSource.Table and added 'ignore.stream.change.events.enabled' to be supported through custom configurations
  • (Not backward compatible) Removed 'ignoreReadsEnabled' attribute from JobSource.Table and added 'ignore.snapshot.read.events.enabled' to be supported through custom configurations
  • (Not backward compatible) Removed 'ignoreUpdatesEnabled' attribute from JobSource.Table
  • (Not backward compatible) Removed 'ignoreDeletesEnabled' attribute from JobSource.Table
  • (Not backward compatible) Removed 'keyColumns' attribute from JobSource.Table

Tested Versions

Java 11+
Redis Connect 0.10.x
DB2 (Initial Loader) Database: 11.5.x
JDBC Driver: 11.5.6.0
Files (Initial Loader) CSV, TSV, PSV, JSON, XML
Gemfire (CDC and Initial Loader) Database: 1.15.1
Driver: 1.15.1
MongoDB (CDC and Initial Loader) Database: 4.4+
Driver: 4.7.1
MySQL (CDC and Initial Loader) Database: 8.0.x
JDBC Driver: 8.0.32
Oracle (CDC and Initial Loader) Database: 11g, 12c, 19c, 21c
JDBC Driver: 12.2.0.1, 19.8.0.0, 21.1.0.0, 21.3.0.0, 21.4.0.0, 21.5.0.0, 21.6.0.0
Adapter: logminer
PostgreSQL (CDC and Initial Loader) Database: 10, 11, 12, 13, 14, 15
JDBC Driver: 42.5.1
Plug-ins: pgoutput
Splunk (CDC) 8.1.2
SQL Server (CDC and Initial Loader) Database: 2017, 2019
JDBC Driver: 10.2.1.jre8
Vertica (Initial Loader) Database: 11.1.0-0
JDBC Driver: 11.1.0-0
Assets 6
Loading