Data Engineering Team Lead

Full Time, onsite
TG Human Resource Services Sdn. Bhd.
Kuala Lumpur, Malaysia

RM 16,000 - RM 20,000 / month

Apply on

Indeed MY

Availability Status

This job is expected to be in high demand and may close soon. We’ll remove this job ad once it's closed.

Original

Simplified

Location : Cyberjaya

Position Summary:

Your Role

As the Data Engineer Team Lead, you will play a pivotal role in leading the design, development, and optimization of our data pipelines. Your work will ensure smooth data integration and availability across all systems, supporting crucial business decisions and operations. You will guide a team of skilled data engineers, driving the execution of key data strategies. A core responsibility will be developing and managing a unified data pipeline that seamlessly serves internal systems and external applications, ensuring secure, real-time data flow across all platforms.

Key Responsibilities

Team Leadership: Lead, mentor, and guide a team of data engineers to design, build, and optimize scalable data pipelines for analytics, reporting, and operational needs.
Unified Data Pipeline: Architect and manage a unified data pipeline that integrates multiple data sources, ensuring efficient data access for both internal systems and third-party, client-facing platforms.
Low-Code/No-Code Integration: Leverage low-code/no-code tools like Fivetran or RudderStack to streamline data workflows and enhance integration efficiency.
Cross-Functional Collaboration: Partner with different teams to identify data needs and ensure high availability, smooth data flows, and effective system integration.
Data Governance & Quality: Implement and maintain data governance standards to ensure data quality, consistency, and reliability across the organization.
Real-Time & Batch Data Architecture: Design and implement both real-time and batch data pipelines using tools like Kafka or Pub/Sub to enable low-latency, high-performance data processing.
Technical Guidance: Provide technical expertise and troubleshooting support, optimizing performance and cost-effectiveness while maintaining best practices.
Continuous Improvement: Stay updated on the latest data engineering technologies and best practices, especially in real-time processing and low-code/no-code solutions, to continually enhance our infrastructure.
Stakeholder Management: Collaborate with stakeholders to ensure timely delivery of data solutions that meet business requirements.

Requirements

Education: Bachelor’s degree in Computer Science, Data Engineering, or a related field.
Experience:
10+ years in data engineering, with at least 3 years in a leadership role.
Strong expertise in designing, building, and maintaining data pipelines and data warehouses.
Technical Skills:
Strong knowledge of cloud platforms (Google Cloud, AWS) and tools like BigQuery, PostgreSQL, and Airflow.
Proficient in Python and experienced in ETL/ELT processes.
Hands-on experience with low-code/no-code integration tools.
Deep understanding of real-time data processing and streaming technologies like Kafka or Pub/Sub.
Experience with unified data pipelines that ensure secure and consistent data flows for both real-time and batch processing systems.
Strong knowledge of data governance, security, and compliance best practices.
Communication: Excellent communication skills with the ability to explain complex technical concepts to non-technical audiences and mentor junior team members.

Why Join Us

We embrace a culture of innovation and continuous improvement. As the Data Engineer Team Lead, you will have the opportunity to lead impactful projects, collaborate with top global talent, and shape the future of our data infrastructure. If you’re passionate about data engineering and looking for a dynamic, supportive environment to grow and lead, we’d love to hear from you!

Benefits