Job Details
- Company: UnitedHealth Group (Optum)
- Job Position: Data Engineer – ETL, SQL, Databricks
- Job Location: Hyderabad, India
- Job ID: 2394801
- Job Category: Technology
- Qualification: Bachelor’s degree (B.E./B.Tech) in Engineering or a related discipline
- Experience: Not specified in the provided job description
- Job Type: Full-time
- Travel: Not required
- Salary: Estimated ₹8 LPA – ₹18 LPA, depending on experience, technical skills, and the final compensation package. This is an estimate, not an officially disclosed salary.
Job Overview
UnitedHealth Group, through its Optum business, is looking for a Data Engineer to develop and maintain cloud-based data pipelines using Azure, Databricks, Python, PySpark, and SQL. The role involves building large-scale ETL processes, improving data processing performance, and migrating traditional data systems to modern cloud platforms. The selected candidate will work with different teams to ensure data accuracy, reliability, security, and scalability. This opportunity is suitable for engineering graduates with data engineering experience and knowledge of cloud platforms, data warehousing, and ETL development.
Key Responsibilities
- Design, develop, and maintain cloud-based data pipelines using Azure and Databricks.
- Build and optimise ETL frameworks using Apache Spark.
- Develop batch and incremental data processing solutions.
- Implement complex data transformations using Python, PySpark, and Spark SQL.
- Improve the performance and efficiency of data processing workflows.
- Migrate traditional on-premises ETL workloads to cloud platforms.
- Work with Databricks and Snowflake to modernise data infrastructure.
- Build scalable and reliable data warehouse solutions.
- Implement data validation and monitoring processes.
- Ensure data accuracy, consistency, and integrity.
- Collaborate with cross-functional teams to understand data requirements.
- Develop technical documentation for data engineering systems and processes.
- Follow company policies, data governance standards, and engineering practices.
- Identify and resolve data pipeline performance and reliability issues.
- Contribute to the continuous improvement of cloud-based data solutions.
Eligibility Criteria
- A bachelor’s degree in Engineering or a related discipline is required.
- Hands-on experience with Databricks and cloud-based data platforms.
- Experience with Azure is preferred.
- Knowledge of ETL tools such as DataStage.
- Experience building data pipelines using Python, PySpark, and Spark SQL.
- Understanding of data warehousing concepts and dimensional modelling.
- Knowledge of data quality checks, reconciliation, and performance tuning.
- Familiarity with Azure, AWS, or Google Cloud Platform.
- Understanding of workflow orchestration tools such as Apache Airflow.
- Ability to work with relational and distributed database systems.
- Strong analytical and problem-solving skills.
- Ability to collaborate effectively with different teams. Leadership or mentoring experience is an advantage.
Required Skills
- Python programming.
- PySpark and Apache Spark.
- Spark SQL and advanced SQL queries.
- ETL pipeline development and optimisation.
- Databricks platform.
- Microsoft Azure cloud services.
- Data warehousing and dimensional modelling.
- DataStage or similar ETL tools.
- Snowflake and cloud migration concepts.
- Data validation, reconciliation, and quality monitoring.
- Relational and distributed databases.
- Apache Airflow or similar workflow orchestration tools.
- Data pipeline troubleshooting and performance tuning.
- Technical documentation and data governance.
- Communication, teamwork, and problem-solving skills.
Why Join UnitedHealth Group (Optum)?
- Work with a global organisation focused on healthcare and technology.
- Gain experience with modern cloud data engineering platforms.
- Develop expertise in Databricks, Spark, Python, and Azure.
- Work on large-scale data processing and cloud migration projects.
- Collaborate with experienced professionals across technical teams.
- Access employee benefits and wellbeing resources.
- Explore career development and learning opportunities.
- Contribute to technology solutions that support healthcare services and data-driven decisions.
Important Links
Apply Link: Click here