https://etlworks.com/blog/ AI and data integration, best practices, lessons from real deployments, and engineering notes — from the team building Etlworks. en-us Mon, 27 Jul 2026 22:21:55 +0000 https://etlworks.com/blog/nobody-cares-that-you-have-ai.html https://etlworks.com/blog/nobody-cares-that-you-have-ai.html Mon, 27 Jul 2026 00:00:00 +0000 Maksym Sherbinin ai Every data tool shipped an AI feature in the last eighteen months. Most are demos. Here is the test that separates them. https://etlworks.com/blog/everyone-raised-prices-we-didnt.html https://etlworks.com/blog/everyone-raised-prices-we-didnt.html Mon, 27 Jul 2026 00:00:00 +0000 Maksym Sherbinin pricing Vendors raised prices in 2025, raised them again in 2026, and will raise them in 2027. We kept ours where they were and doubled the product instead. https://etlworks.com/blog/eight-layers-one-decision.html https://etlworks.com/blog/eight-layers-one-decision.html Mon, 27 Jul 2026 00:00:00 +0000 Artem Avdonin security ai Roles, groups, permissions, tag views, and AI policy resolve into a single answer for every request, whether it arrives from the UI, REST, the CLI, or an AI agent. https://etlworks.com/blog/three-ways-to-merge-into-delta.html https://etlworks.com/blog/three-ways-to-merge-into-delta.html Sun, 26 Jul 2026 00:00:00 +0000 Artem Avdonin warehouses Native Databricks flow types ship with three MERGE strategies, TEXT-only staging for schema drift, and an override for when the generated SQL is wrong. https://etlworks.com/blog/the-biggest-cdc-rewrite-weve-shipped.html https://etlworks.com/blog/the-biggest-cdc-rewrite-weve-shipped.html Sun, 26 Jul 2026 00:00:00 +0000 Artem Avdonin cdc Resumable snapshots, an offset editor with backup and restore, chunked parallel snapshots, and AS400 work that has no equivalent in stock Debezium. https://etlworks.com/blog/etlworks-9-7-11.html https://etlworks.com/blog/etlworks-9-7-11.html Sun, 26 Jul 2026 00:00:00 +0000 Olena Sherbinin releases A layered permission model enforced on every channel, an agent that creates any artifact, and parallel extraction for large tables. https://etlworks.com/blog/autocomplete-that-doesnt-guess.html https://etlworks.com/blog/autocomplete-that-doesnt-guess.html Sun, 26 Jul 2026 00:00:00 +0000 Olena Sherbinin developer A language model will confidently offer you a column that does not exist. The completion in our code editors reads your actual schema instead. https://etlworks.com/blog/ditch-airflow.html https://etlworks.com/blog/ditch-airflow.html Wed, 22 Jul 2026 00:00:00 +0000 Artem Avdonin orchestration Most teams running Airflow maintain a Python framework in order to accomplish 'run this every morning'. There is a shorter path. https://etlworks.com/blog/a-cli-with-sql-built-in.html https://etlworks.com/blog/a-cli-with-sql-built-in.html Wed, 15 Jul 2026 00:00:00 +0000 Artem Avdonin developer The in-app CLI runs SQL over the JSON that commands return, scripts with loops and captured variables, and doubles as the tool the agent uses to operate the platform. https://etlworks.com/blog/update-the-tooling-keep-your-license.html https://etlworks.com/blog/update-the-tooling-keep-your-license.html Mon, 13 Jul 2026 00:00:00 +0000 Olena Sherbinin ops No-license downloads for Linux and Windows, a Windows CLI to match the Linux one, and no form to fill in. For teams refreshing their tooling. https://etlworks.com/blog/etlworks-9-6-11.html https://etlworks.com/blog/etlworks-9-6-11.html Tue, 07 Jul 2026 00:00:00 +0000 Olena Sherbinin releases Interrupted CDC snapshots resume where they stopped, the offset editor gained backup and restore, and the host CLI reached Windows parity. https://etlworks.com/blog/map-nested-json-and-xml-by-dragging.html https://etlworks.com/blog/map-nested-json-and-xml-by-dragging.html Tue, 30 Jun 2026 00:00:00 +0000 Olena Sherbinin mapping Building an order document with line items used to mean writing a loop. Two kinds of lookup replace the JavaScript. https://etlworks.com/blog/a-green-run-tells-you-almost-nothing.html https://etlworks.com/blog/a-green-run-tells-you-almost-nothing.html Thu, 25 Jun 2026 00:00:00 +0000 Maksym Sherbinin ops Run history says what happened. It does not say whether your schedules collide, which flow is eating the box, or what breaks next. That is what Insights is for. https://etlworks.com/blog/the-whole-x12-stack.html https://etlworks.com/blog/the-whole-x12-stack.html Tue, 23 Jun 2026 00:00:00 +0000 Olena Sherbinin edi A translator, an AS2 gateway, and a mapper are usually three products and three invoices. Version 9.6.4 put all three on the engine that already runs your pipelines. https://etlworks.com/blog/etlworks-9-6-4.html https://etlworks.com/blog/etlworks-9-6-4.html Fri, 19 Jun 2026 00:00:00 +0000 Olena Sherbinin releases Native Databricks flow types, full AS2 support for EDI, a schema-driven X12 editor, and Etlworks itself became an MCP server. https://etlworks.com/blog/how-we-use-ai-in-2026.html https://etlworks.com/blog/how-we-use-ai-in-2026.html Thu, 18 Jun 2026 00:00:00 +0000 Maksym Sherbinin engineering ai Every engineer gets unlimited access to frontier models from both OpenAI and Anthropic. Nobody counts tokens, and nobody counts how much code the models wrote. https://etlworks.com/blog/you-cant-fire-an-agent.html https://etlworks.com/blog/you-cant-fire-an-agent.html Thu, 11 Jun 2026 00:00:00 +0000 Maksym Sherbinin ai opinion Half the founders I talk to are building agent meshes. We run three agents in total. The reason is accountability, and you cannot fire an agent. https://etlworks.com/blog/what-were-building-next.html https://etlworks.com/blog/what-were-building-next.html Tue, 26 May 2026 00:00:00 +0000 Maksym Sherbinin roadmap A new runtime stack, CPython replacing Jython, built-in SSO, official Kubernetes support, and dbt. Nothing here has shipped yet. https://etlworks.com/blog/etlworks-9-5-8.html https://etlworks.com/blog/etlworks-9-5-8.html Thu, 14 May 2026 00:00:00 +0000 Olena Sherbinin releases The AI agent and the canvas-based flow builder both landed in this release, along with a rebuilt mapping editor. https://etlworks.com/blog/five-kinds-of-api-pagination.html https://etlworks.com/blog/five-kinds-of-api-pagination.html Wed, 28 Jan 2026 00:00:00 +0000 Artem Avdonin developer Page, offset, cursor, nextLink, and time. The HTTP connector handles all five as connection settings, so paging an API stops being a scripting exercise.