The layers
Bronze
Raw data from data sources:- Tables created by the Peliqan ELT pipelines
- Raw tables from connected databases
Silver
Cleaned & structured data:- Schema enforcement (e.g. column selection)
- Data normalization (e.g. unified VAT numbers for customer records from a CRM)
- Deduplication
- Basic joins and transformations
Gold
Business ready data:- Aggregated tables
- KPIs and metrics
- Dimensional models (e.g. star schema)
- Data optimized for BI tools like Power BI and Metabase
How to implement a Medallion architecture in Peliqan
Data transformations are implemented in Peliqan using a combination of SQL queries and low-code Python scripts. Both can be implemented with the support of Peliqan’s AI Data Engineer. The bronze layer consists the raw tables from e.g. ELT pipelines (SaaS connections). The silver layer and golden layer is implemented using SQL queries, and optionally Python scripts (Data apps). SQL queries are typically grouped in a schema called “Silver” and “Gold”. Example using schema’s, the ELT target schemas are the bronze layer:


