Cutting Data Pipeline Compute Time from Two Days to Two Hours – Healthcare Organization

Solution:

Empowering Stakeholders and Supporting Business Growth Through Analytics

Data Clymer, a Spaulding Ridge company, implemented an overhaul of the organization’s data infrastructure with a modern data stack. We created a new, more efficient data pipeline architecture for business, converting their old ETL process using custom R functions to a modern ELT solution using Fivetran, dbt, and BigQuery.

We then constructed robust data pipelines, streamlined internal reporting, offered expert analytics support, and standardized processes for future endeavors. We migrated their library of outdated dashboards from Tableau to Looker, while creating new dashboards tailored for various departments.

To establish a unified source of truth of genetics reporting for their stakeholders, we made seven new dbt models and over a dozen new Looker dashboards. We crafted six KPI dashboards for operations executives in addition, eliminating slow, manual processes and providing valuable insights for better decision-making.

By implementing dbt and modernizing the pipeline structure, we empowered the business’ data analysts without R knowledge to create new data models. This shift freed up time for engineers to focus on higher-priority projects and not falling behind.

Lastly, we helped curate optimization strategies and best practices for both internal and external stakeholders, offering ongoing analytics support for complex genetics data issues within their internal BI team.