Welcome to the Data Warehouse and Analytics Project repository! π
This project demonstrates a comprehensive data warehousing and analytics solution, from building a data warehouse to generating actionable insights. Designed as a portfolio project highlights industry best practices in data engineering and analytics.
The data architecture for this project follows Medallion Architecture Bronze, Silver, and Gold layers:
- Bronze Layer: Stores raw data as-is from the source systems. Data is ingested from CSV files into SQL Sever Database.
- Silver Layer: This layer includes data cleansing, standardization, and normalization processes to prepare data for analysis.
- Gold Layer: Houses business-ready data modeled into a star schema required for reporting and analytics.
This project involves:
- Data Architecture: Designing a Modern Data Warehouse Using Medallion Architecture Bronze, Silver, and Gold layers.
- ETL Pipelines: Extracting, transforming, and loading data from source systems into our warehouse.
- Data Modeling: Developing fact and dimension tables optimized for analytical queries.
- Analytics & Reporting: Creating SQL-based reports and dashboards for actionable insights.
π― In this project, the following skills are practiced:
- SQL Development
- Data Architecture
- Data Engineering
- ETL Pipline Development
- Data Modeling
- BI: Analytics & Reporting (Data Analytics)
Develop a modern data warehouse using SQL Server to consolidate sales data, enabling analytical reporting and informed decision-making.
- Data Sources: Import data from two source systems (ERP and CRM) provided as CSV files.
- Data Quality: Cleanse and resolve data quality issues prior to analysis.
- IntΓ©gration: Combine both sources into a single, user-friendly data model designed for analyticals queries.
- Scope: Focus on the dataset only; historization of data is not required.
- Documentation: Provide clear documentation of the data model to support both business stackeholders and analytics teams.
Develop SQL-based analytics to deliver datailed insights into :
- Customer Behavior
- Product Performance
- Sales Trends
These insights empower stackeholders with key business metrics, enabling strategic decision-making
This project is licensed under the MIT Licence. You are free to use, modify, and share this project with poper attribution.
Hi there! I'm Akanji TimothΓ©e Olanyi OlatundΓ©, also know as ATOO. I'm an Data Professional, Analytics Developer & Data Engineer | BI | Python & SQL Expert, ETL, Cloud | Certified DataCamp | Health Tech Enthusiast on a mission to share my knowledge of Data subjects and use them as a lever to help improve the healthcare sector in Africa and around the world.
Let's stay in touch! Feel free to connect with me on the following platforms:
