ποΈ π Surrogate Keys
Surrogate Keys are specially generated identifiers used instead of natural business keys (like SSN, tax numbers, or other business identifiers).
ποΈ ποΈ Minor Entities
Minor Entities are reference tables used in data transformation and classification (such as customer types π§βπ€βπ§, status codes π·οΈ, or product categories π¦).
ποΈ π Reference Tables
Reference Tables map various identifiers and data types (like π region, π·οΈ brand, π status, πͺ dealer) and are essential for correct data integration, attribute mapping, and meaningful reporting throughout your data platform.
ποΈ π Core Layer
The Core Layer is the main integration and transformation layer β where data from multiple sources is deduplicated, enriched, and prepared for reporting and analytics.
ποΈ π§© Semantic Layer
The Semantic Layer ποΈ is the reporting and presentation layer where data is aggregated π and transformed π οΈ for analytics and reporting.
ποΈ π End-to-End Testing
End-to-End (E2E) tests treat the entire ETL pipeline as a βblack boxβ, verifying that from source to final output, the data behaves exactly as the business expects.