ETL Engineer - IBM DataStage

Job Title: ETL Engineer

Duration: 12 months contract

Location: Kuala Lumpur, Selangor, Malaysia (On-site)

Job Description:

KNOWLEDGE & TECHNICAL SKILLS

• Familiar with ETL/ELT framework, data warehousing concepts, data management framework and data lifecycle processes.
• Preferably with 2+ years work experience in insurance or finance industry
• Experienced in handling and processing different types of data (structured, semi-structured and unstructured).
• Strong knowledge in various database technologies (RDBMS, NoSQL and columnar).
• Strong understanding of programming languages like Python
• Experienced working in insurance industry will be an added advantage.
• Ability to communicate and present technical information in a clear and unambiguous manner.
• Strong ability to work independently and cooperate with diverse teams in a multiple stakeholder’s environment.
• Strong sense of work ownership, high affinity with anything data and a desire for constant improvements.

PURPOSE:

• Manage Extract, Transform, and Load (ETL) process on data pipelines.
• Develop ETL job pipeline using ETL tools.
• Maintain ETL job scheduling and housekeeping for optimal load.
• Identify gaps in ETL job pipeline.
• Perform data normalization to smoothen data processing pipeline.
• Wide exposure to various database technologies and automation.

KEY ACCOUNTABILITIES:

• Design, develop, document and implement end-to-end data pipelines and data integration processes, both batch and real-time. This include data analysis, data profiling, data cleansing, data lineage, data mapping, data transformation, developing ETL / ELT jobs and workflows, and deployment of data solutions.
• Monitor, recommend, develop and implement ways to improve data quality including reliability, efficiency and cleanliness, and to optimize and fine-tune ETL / ELT processes.
• Recommend, execute and deliver best practices in data management and data lifecycle processes, including modular development of ETL / ELT processes, coding and configuration standards, error handling and notification standards, auditing standards, and data archival standards.
• Prepare test data, assist to create and execute test plans, test cases and test scripts.
• Collaborate with Data Architect, Data Modeler, IT team members, SMEs, vendors and internal business stakeholders, to understand data needs, gather requirements and implement data solutions to deliver business goals.
• BAU support for any data issues and change requests, document all investigations, findings, recommendations and resolutions.

KEY PERFORMANCE INDICATORS:

Business Indicators:

• Completed ETL job runs without failure.
• High data integrity from ETL processing.
• Customer satisfaction rate.

Technical Indicators:

• Number of project deliverables per year.
• Close data gaps between users, developers, and QA teams.
• Ensure deliverables fulfill requirements before passing to QA team.

EXTERNAL & INTERNAL CONTACTS:

Internal Contacts:

• IT teams (Infra, Information Security, Solution Delivery, Project, QA teams).
• Business owners (Operations, Distribution, Platform, Finance teams).

External Contacts:

• IT external vendors.

DECISION MAKING:

• Perform research and interviews to determine IT business requirements.
• Translate business requirements into technical specifications for projects.

QUALIFICATIONS / EXPERIENCE:

• 2+ years of work experience in insurance or finance industry preferred.
• Knowledge of IBM DataStage or relevant ETL software is preferred.
• Strong communication, problem-solving, and relationship-building skills.
• Proven time management and organizational skills.

KNOWLEDGE & TECHNICAL SKILLS:

• Familiar with ETL/ELT framework, data warehousing concepts, data management framework and data lifecycle processes.
• Experienced in handling and processing different types of data (structured, semi-structured and unstructured).
• Strong knowledge in various database technologies (RDBMS, NoSQL and columnar).
• Strong understanding of programming languages like Python
• Experienced working in insurance industry will be an added advantage.
• Ability to communicate and present technical information in a clear and unambiguous manner.
• Strong ability to work independently and cooperate with diverse teams in a multiple stakeholder’s environment.
• Strong sense of work ownership, high affinity with anything data and a desire for constant improvements.