Skip to main content
DPD Schweiz

Open source data warehouse for near-realtime BI at DPD Switzerland

For DPD Switzerland, CONSENSO supported the build of a new data warehouse programme to replace an existing Microsoft BI solution. The new platform is based on an open source stack with a custom-built ETL system, ClickHouse as the BI database, Postgres-based master data management and reusable data models for various reporting tools.

At a glance

Starting point

  • Replacing an existing legacy Microsoft BI solution
  • High operational data volumes in the parcel and logistics business
  • Many data sources, integrations and stakeholders
  • Difficulty translating business requirements into technical specifications
  • A need for a clear roadmap, MVP structure and prioritised use cases
  • Centralisation and enrichment of master data for BI purposes

Solution

  • Setting up and structuring the data warehouse programme
  • Technical requirement engineering for BI, ETL and data modelling
  • Prototyping of SQL queries, data models and ETL transformations
  • Custom-built ETL system for data pipelines
  • ClickHouse as a high-performance BI database for large transaction data volumes
  • Postgres-based master data management with dedicated master data screens
  • eMondrian / ROLAP layer for reusable cubes and data models
  • Use of various analysis and dashboarding tools on the same data foundation

Result

  • Near-realtime access to operational data
  • A more consistent reporting and analytics foundation
  • Better financial and operational transparency
  • Less manual data maintenance thanks to central MDM
  • Reusable data models for different BI tools
  • A cost-efficient platform through targeted use of open source technologies
  • A foundation for future advanced analytics use cases

In its parcel business, DPD Switzerland processes large volumes of operational data every day from various systems, interfaces and business areas. To put reporting, operational steering and data analysis on a future-proof footing, the existing Microsoft-based BI solution was to be replaced by a modern, flexible and cost-efficient data warehouse platform.

CONSENSO supported DPD Switzerland in setting up and structuring the data warehouse programme. Alongside technical requirement engineering and prototyping for SQL queries, data models and ETL transformations, CONSENSO also helped structure the programme organisationally and establish clear priorities for delivering a first MVP.

The solution is based on an open source stack with a custom-built ETL system, ClickHouse as a high-performance database for large transaction data volumes, a Postgres-based MDM component for central master data, and eMondrian as a ROLAP layer for reusable cubes and data models. Data models can therefore be used across various dashboarding and analysis tools, including Apache Superset, QlikSense, Metabase, Excel and other BI front ends.