Epicareer Might not Working Properly
Learn More

Senior Data Engineer

Salary undisclosed

Apply on


Original
Simplified

Job Purpose

As a Senior Data Engineer at Sunway Healthcare Group, your role will be integral to our data analytics transformation in healthcare. You will be responsible for developing, optimizing, and maintaining our data infrastructure on cloud and big data platforms. Your work will empower data analysts and other stakeholders by delivering robust data models, datasets, and efficient data pipelines. By ensuring that high-quality, scalable data solutions are in place, you will play a key part in enabling data-driven decisions to enhance healthcare services and patient outcomes.

Job Responsibilities

  1. Cloud-Based Data Management:
  • Develop and maintain scalable data pipelines on cloud platforms e.g. Microsoft Azure and Huawei Cloud.
  • Design and implement cloud-native solutions for data ingestion, processing, and analytics.
  • Ensure optimal integration of big data services with existing systems.
  • Maintain security and compliance of data solutions in a healthcare context.

2. Data Processing, Transformation, and Optimization:

  • Lead the optimization of data systems and pipelines in a cloud environment.
  • Implement data validation, cleansing, transformation, and storage solutions in cloud and data lake environments.
  • Build ETL/ELT processes to prepare datasets that empower data analysts and other users.
  • Implement data engineering best practices, including SCD, CDC, and Medallion architecture to ensure efficient data flow.
  • Oversee the scalability, security, and performance of data pipelines.

3. Data Modeling and Enablement:

  • Design and build data models and datasets that empower data analysts and business teams to perform their own analysis and reporting.
  • Collaborate with stakeholders to understand data requirements and ensure data models are aligned with business needs.
  • Ensure data availability, quality, and consistency across the organization, supporting self-service analytics.

4. Leadership and Team Collaboration:

  • Provide technical guidance and mentorship in cloud-based data engineering.
  • Collaborate with different teams to translate business needs into effective cloud data solutions.
  • Drive cloud data initiatives and foster innovation within the team.

5. Innovation and Problem-Solving:

  • Explore and implement new technologies and methodologies in cloud big data services.
  • Lead troubleshooting and problem resolution for data processes in cloud environments.
  • Stay current with emerging trends and technologies in cloud data management.

Job Qualifications

Expertise in Cloud Big Data Platforms:

  • Proficient in cloud-based big data services e.g. Microsoft Azure and Huawei Cloud.
  • Experience in building and managing data solutions in a cloud environment.
  • Understanding of cloud architecture, data security, and compliance in a healthcare context.

Data Engineering and Analytical Skills:

  • Strong background in Python, SQL, and big data tools like Hadoop, Spark, PySpark, and Delta Lake.
  • Solid skills in data modeling and analytics in a cloud setting.
  • Ability to derive insights and solutions from complex data sets.

Communication and Collaboration:

  • Effective communication skills with both technical and non-technical teams.
  • Strong collaboration abilities, working effectively in a team setting.

Problem-Solving and Innovation:

  • Skilled in identifying and solving data-related challenges in cloud environments.
  • Adept at staying ahead of the curve in cloud data technologies and practices.

Technical Proficiency:

  • Deep understanding of technical concepts in data engineering and cloud computing.
  • Experience with quality assurance and testing of cloud-based data products.