All posts

9.6.11: CDC that resumes, and a real host CLI

Interrupted CDC snapshots resume where they stopped, the offset editor gained backup and restore, and the host CLI reached Windows parity.

An operations release. Three items matter.

Resumable CDC snapshots. An interrupted initial snapshot no longer starts over. Completed tables are recorded in a progress file beside the offset, and on restart the connector skips them and resumes streaming from the log position captured at the original snapshot's start, so you get neither a gap nor a replay. Failed ad-hoc snapshots replay only their incomplete part. Supported on MySQL, PostgreSQL, SQL Server, Oracle, DB2, AS/400, and MongoDB. The detail.

The CDC offset editor became a recovery tool. It writes a zip backup of offset, history, and snapshot sidecar files before every mutating action, restores from those and from automatic backups, and adds a guarded Reset CDC State. Every mutation is blocked while the flow is running.

A full host CLI on Linux and Windows. etlworks-cli.sh and etlworks-cli.ps1 reached parity: service control, full backup and restore of PostgreSQL, Redis, and app.data, and persistent flow-execution suspend and resume that works while Tomcat is stopped. Downloads.

Also in this release: declarative CDC extra-column functions composite_key() and cdc_string_transform(), resumable HTTP pagination with a cursor stop condition, an Inspect Flow button that runs in the background and colors to the worst severity found, and 16 new CDC inspector heuristics.

Full release notes for 9.6.11

Try it on your own data.

14 days, no card. Point Etlworks at a real source and see what it does.