📄️ 🔑 Surrogate Keys
Surrogate Keys are specially generated identifiers used instead of natural business keys (like SSN, tax numbers, or other business identifiers).
📄️ 🗂️ Minor Entities
Minor Entities are reference tables used in data transformation and classification (such as customer types 🧑🤝🧑, status codes 🏷️, or product categories 📦).
📄️ 📚 Reference Tables
Reference Tables map various identifiers and data types (like 🌍 region, 🏷️ brand, 📊 status, 🏪 dealer) and are essential for correct data integration, attribute mapping, and meaningful reporting throughout your data platform.
📄️ 🏗 Core Layer
The Core Layer is the main integration and transformation layer — where data from multiple sources is deduplicated, enriched, and prepared for reporting and analytics.
📄️ 🧩 Semantic Layer
The Semantic Layer 🗂️ is the reporting and presentation layer where data is aggregated 📊 and transformed 🛠️ for analytics and reporting.
📄️ 🔄 End-to-End Testing
End-to-End (E2E) tests treat the entire ETL pipeline as a “black box”, verifying that from source to final output, the data behaves exactly as the business expects.