Senior Data Engineer

Mass General Brigham Medical Group, Inc.
United States, Massachusetts, Somerville
399 Revolution Drive (Show on map)
Feb 19, 2025
This Senior Data Engineer position is for development and support activities on EAM team for building Subject Area marts using cloud engineering technologies like Snowflake, DBT & Tidal. Develop, implement and DBT ETL models on Snowflake. Senior Data Engineer will also work on ingestion pipelines designed on Azure Data Lake and will develop & implement applications on Profisee. Perform EDW ETL/ELT ingestions and integrations to ensure support data and analytic needs Build and enhance standard solution that provides efficient and scalable ETL/ELT solutions from multiple data sources Ensure the quality of data assets and robustness of data engineering processes Experience with change control, release management and other ITIL processes Participate in building out EDW on Snowflake, expanding and optimizing the data ecosystem, as well as optimizing data engineering processes Support BI Developers, Data Architects, Data Analysts and Data Scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects Conduct ETL solution, code, and pre-prod review to ensure optimal data delivery architecture is consistent throughout ongoing projects Collaborate with Platform Architect on ETL/ELT new features and train peers Perform troubleshooting on ETLs and related components Identify application bottlenecks and opportunities to optimize performance Qualifications 7+ plus years of experience designing and building data ingestions and data integration solution for Enterprise Data and Analytics Solutions 2+ years of experience with developing models in DBT Experience with Azure DevOps, Azure Git and CI/CD data pipeline integrations. Demonstrates good knowledge of cloud computing platforms such as AWS, GCP, and Azure Experience of support and enhance existing Enterprise Data Warehouse or Data Lake Ensure designed systems are highly reliable, self-recovering, and require little or no supporting manpower Familiar with change control, release management, and other ITIL methodology Deep experience in traditional Data Warehousing & Cloud data warehousing Mastery of SQL, especially within cloud-based data warehouses like Snowflake Professional knowledge of Azure Experience developing data pipelines using Snowflake features (Snow pipe, SnowSQL, Data Streams, Snow Sight) Ability to clearly and concisely communicate complex technical concepts to both technical and non-technical audiences Proven verbal, communication, and presentation skills Proven ability to work independently Skills/Abilities/Competencies Thorough knowledge of Snowflake, DBT, Azure Microsoft SQL Server, SSIS, and related ETL tools Strong SQL skills and workload management on Snowflake Ability to troubleshoot system bottleneck and conduct performance tuning in large data warehouse or data lake Experience with logical and physical data modeling Experience with real time data processing and analytics products is a plus 5+ plus years of experience with building larger data warehouse in SQL Server, SnowSQL is a must 2+ years of experience with developing models in DBT Familiarity with data engineering, data governance and data quality principles Healthcare experience, most notably in Clinical data, Epic, Payer data and reference data is a plus but not mandatory Supervisory Responsibilities No direct reports; may provide guidance to less seasoned and new staff Fiscal Responsibility Demonstrates fiscal responsibility by effectively using Mass General Brigham resources Working Conditions The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. This position requires occasional local travel to MGB sites, vendors, and/or conferences Hospital work environment working conditions include possible exposure to diseases or infections and may require safety gear (PPE) such as gloves and mask. Normal office working conditions. The noise level in the work environment is quiet to moderate. While performing the duties of this job, the employee is frequently required to sit; talk; or hear; use hands to finger; handle; or feel; reach with hands and arms. The employee is occasionally required to stand; walk; and stoop; kneel; or crouch. The employee must frequently lift and/or move up to 5 pounds and occasionally lift and/or move up to 20 pounds. Specific vision abilities required by this job include close vision, distance vision and depth perception. Mass General Brigham Medical Group, Inc. is an Equal Opportunity Employer. By embracing diverse skills, perspectives and ideas, we choose to lead. All qualified applicants will receive consideration for employment without regard to race, color, religious creed, national origin, sex, age, gender identity, disability, sexual orientation, military service, genetic information, and/or other status protected under law. We will ensure that all individuals with a disability are provided a reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment.