Azure Databricks Architect

Practice - AIA - Artificial Intelligence and Analytics

About AI & Analytics: Artificial intelligence (AI) and the data it collects and analyzes will soon sit at the core of all intelligent, human-centric businesses. By decoding customer needs, preferences, and behaviors, our clients can understand exactly what services, products, and experiences their consumers need. Within AI & Analytics, we work to design the future-a future in which trial-and-error business decisions have been replaced by informed choices and data-supported strategies.

By applying AI and data science, we help leading companies to prototype, refine, validate, and scale their AI and analytics products and delivery models. Cognizant's AIA practice takes insights that are buried in data and provides businesses a clear way to transform how they source, interpret and consume their information. Our clients need flexible data structures and a streamlined data architecture that quickly turns data resources into informative, meaningful intelligence.

Responsibilities

1. Architecting Big Data Solutions

* Design and maintain a Quality Data Repository in Azure Data Lake for HEDIS data submissions to state and federal agencies, ensuring compliance with NCQA and other regulatory requirements.

* Knowledge on HEDIS Engines such as ClaimSphere and Inovalon

* Knowledge on QNXT, EDIFECS, Operational Data Store, Pharmacy data and supplemental data

* Design scalable data pipelines using Databricks, Spark, and Delta Lake.

* Optimize ETL/ELT workflows for performance and cost efficiency.

* Implement batch and real-time streaming data processing.

2. Cloud & Data Integration

* Implement data governance, security, and compliance using Azure policies.

* Connect Databricks with third-party BI tools such as Power BI.

3. Performance Optimization

* Optimize Spark jobs for cost and efficiency (e.g., caching, partitioning).

* Manage clusters and auto-scaling to balance cost and speed.

* Implement data modeling best practices

4. Collaboration & Leadership

* Work with Data Engineers, Data Scientists, and DevOps teams.

* Establish best practices for CI/CD in Databricks.

* Train teams on Databricks features and MLflow.

#LI-EF1

#CB

#Ind123

Applications will be accepted until 28 Feb 2025.

Salary and Other Compensation:

The annual salary for this position is between $[117,000 - 135,500] depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant's discretionary annual incentive program and stock options, based on performance and subject to the terms of Cognizant's applicable plans.

Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

* Medical/Dental/Vision/Life Insurance

* Paid holidays plus Paid Time Off

* 401(k) plan and contributions

* Long-term/Short-term Disability

* Paid Parental Leave

* Employee Stock Purchase Plan