Jollyes
Jollyes Scales Complex Retail Data Workflows with Etlworks
Introduction
Jollyes, one of the largest pet retailers in the UK, relies on Etlworks to manage end-to-end data integration across a diverse set of internal and external systems. With a growing number of stores, suppliers, and digital channels, Jollyes needed a scalable ETL solution to streamline analytics and support data-driven operations.
By using Etlworks, Jollyes integrates and transforms data from APIs, file drops, and relational databases into Snowflake — enabling centralized reporting and real-time decision-making.
The Challenge
Jollyes faced growing data complexity and scale:
-
Multiple Source Systems: Data originated from a mix of APIs, FTP-based files, and transactional databases.
-
Inconsistent Formats: Variations in file structures, API payloads, and schemas created a need for powerful data normalization and transformation.
-
Scheduling and Dependencies: Pipelines needed to run in the correct order and handle downstream dependencies with retries and failure recovery.
-
Scalability: Increasing data volume and velocity required an ETL platform that could scale without a complete re-architecture.
Why Etlworks
Jollyes selected Etlworks based on its flexibility, reliability, and ability to unify multiple integration patterns in one platform:
-
Multi-Source Integration: Handles ingestion from REST APIs, SFTP, flat files (CSV, Excel), and SQL databases.
-
Cloud Data Warehouse Support: Direct integration with Snowflake for scalable, high-performance analytics.
-
Advanced Orchestration: Supports flow chaining, retries, conditional logic, and error handling.
-
Transformations at Scale: Built-in data transformation and enrichment tools with full support for complex workflows.
-
No-Code UI: Enables rapid pipeline development without needing to write custom scripts.
The Solution
Jollyes implemented a robust integration framework with Etlworks:
-
Multi-Source ETL Pipelines: Flows ingest data from suppliers, internal systems, and 3rd-party APIs.
-
Centralized Snowflake Warehouse: All data is transformed and loaded into Snowflake for BI, inventory, and financial analytics.
-
Automated File Handling: Wildcard processing and scheduling manage hundreds of files dropped daily via SFTP.
-
Error Monitoring and Recovery: Built-in monitoring and alerting ensure reliability and quick resolution of issues.
Results
-
End-to-End Automation: Entire data workflows — from ingestion to transformation and loading — are fully automated.
-
Faster Analytics: With centralized data in Snowflake, stakeholders can access real-time insights across sales, inventory, and operations.
-
Operational Efficiency: Reduced manual data prep and error handling, allowing the team to focus on strategic initiatives.
-
Scalable Architecture: Easily handles growing data sources and transaction volume without additional complexity.
Key Takeaways
-
Unified Retail Data Stack: Etlworks integrates APIs, files, and databases into a single Snowflake destination.
-
Scalable Orchestration: Handles complex workflows with interdependencies and conditional branching.
-
Automation & Monitoring: Automated flows with built-in error handling reduce manual overhead.
-
Rapid Time to Value: No-code tools allowed the Jollyes team to deploy pipelines quickly without deep technical resources.
Ready to tackle your most complex data challenges? Discover how Etlworks can transform your data integration workflows. Start your free trial today or request a demo.