Kafka Data Engineer

POSITION: Kafka Data Engineer

JOB PURPOSE:-

• Create & maintain technology in data engineering experience including Kafka on premise to create a comprehensive digital solution that meets the customer’s business.

KEY ACCOUNTABILITIES & OUTCOMES:-

Accountability:

• Design(efficient, adaptable, and scalable), develop, and manage Kafka-based data pipelines
• Develop an expert-level understanding of data migration and CDC as it relates to Kafka using Kafka Connect and Debezium.
• Understand and apply event-driven architecture patterns and Kafka best practices. Enable development teams to do the same.
• Assist developers in choosing correct patterns, event modeling, and ensuring data integrity.
• Continuous learning to be a Confluent/Kafka subject matter expert.
• Work with Kafka and Confluent API's (e.g. metadata, metrics, admin) to provide pro-active insights and automation.
• Prepare documentations – data mapping and data dictionary.
• Design monitoring solutions and baseline statistics reporting to support the implementation
• Level 2 & 3 support BAU and optimize existing Kafka setup.

EDUCATION: -

• Bachelor Degree in Computer Science, related field or equivalent work experience.

EXPERIENCE: -

• 3 – 10 years. Preferred to have any data programming certifications.

CERTIFICATIONS / REGULATORY CERTIFICATIONS: -

• ITIL.

JOB SPECIFIC SKILLS & COMPETENCIES REQUIRED: -

Requirements:

• Bachelor Degree in Computer Science, related field or equivalent work experience
• 3+ years of experience in data engineering experience, including Kafka on premise.
• Strong knowledge of Kafka, database and other big data technologies
• Strong knowledge of SQL (tuning) and database fundamentals
• Good understanding of distributed systems
• Good communication and interpersonal skills.

Good to have:

• Experience in Data Warehousing and Big Data.
• Experience in Operational Data Store and Change data capture.
• Expert or Strong knowledge of Debezium.

Job Type: Full-time

Pay: RM8,000.00 - RM10,000.00 per month

Experience:

• Debezium.: 1 year (Preferred)
• data programming certifications.: 3 years (Required)
• Kafka on premise: 2 years (Required)
• Data Engineer: 2 years (Required)
• SQL (tuning) and database fundamentals: 3 years (Preferred)
• Data Warehousing and Big Data: 3 years (Preferred)
• Operational Data Store and Change data capture: 3 years (Preferred)