## Overview Migrate CI-related analytics dashboards from Snowflake to Grafana using ClickHouse as the data source. This epic encompasses the migration of three primary dashboard categories that provide critical insights into GitLab's CI/CD pipeline performance and reliability. ## Scope This epic covers the migration of the following dashboard categories: ### 1. Pipeline Related Dashboards Dashboards that track pipeline execution metrics, including: - Pipeline success/failure rates - Pipeline duration and performance trends - Pipeline tier classification (Tier 1, 2, 3) - Pipeline status distribution across projects - Pipeline throughput and capacity metrics ### 2. Job Related Dashboards Dashboards focused on individual job execution data: - Job success/failure rates and trends - Job duration and performance analysis - Job resource utilization - Job retry patterns and failure analysis - Job queue times and execution efficiency ### 3. E2E Test Related Dashboards Dedicated dashboards for end-to-end testing CI metrics: - E2E test job execution results and trends - E2E test job failure analysis and patterns - E2E test job runtime and performance metrics - E2E test job reliability and retry patterns ## Objectives - Migrate all existing Snowflake-based CI analytics dashboards to Grafana - Ensure data accuracy and consistency between Snowflake and ClickHouse sources - Maintain or improve dashboard performance and query efficiency - Provide seamless access to CI analytics through the new Grafana interface ## Related Work - Parent Epic: [Migrate existing Devex Dashboards to new Data Path](#29) ## Closing statement We have successfully completed the migration of all CI-related Development Analytics dashboards from Snowflake to ClickHouse/Grafana. This effort included migrating pipeline metrics, job-related dashboards, and E2E test dashboards, with all 5 child issues now closed. #### Key Benefits * **Democratized Access**: Any engineer with a GitLab email can now view these dashboards without submitting additional access requests for Snowflake. This removes friction and enables broader visibility into CI/CD performance across the organization. * **Real-Time Data**: All dashboards now display real-time metrics powered by ClickHouse, eliminating the need for manual data refreshes. Teams can make faster, data-driven decisions with up-to-the-minute insights. * **Improved Accessibility**: The new Grafana dashboards are available at dashboards.devex.gitlab.net, providing a unified and familiar interface for monitoring CI pipeline health, job performance, and E2E test reliability. This migration reduces operational overhead, improves data freshness, and makes CI analytics accessible to everyone who needs them. <!-- STATUS NOTE START --> ## Status 2026-01-14 :clock1: **total hours spent this week by all contributors**: 16 :tada: **achievements**: - Created general CI overview dashboard: https://dashboards.devex.gitlab.net/goto/cfa5xgkx774zkb?orgId=1 - Created pipeline specific metrics dashboard: https://dashboards.devex.gitlab.net/goto/efa5xjsaadlhcb?orgId=1 - Created E2E specific metrics dashboard: https://dashboards.devex.gitlab.net/goto/bfa5xnawtkqgwa?orgId=1 :arrow_forward: **next**: - Migrate dashboards with job specific metrics, like job runtimes, failure rates etc: https://gitlab.com/gitlab-org/quality/analytics/team/-/work_items/407+ _Copied from https://gitlab.com/groups/gitlab-org/quality/analytics/-/epics/31#note_3005892491_ <!-- STATUS NOTE END -->