A
Kafka Data Engineer
RM 8,500 - RM 9,000 / month
Checking job availability...
Original
Simplified
Responsibilities
- You need to design (efficient, adaptable, and scalable), develop, and manage Kafka-based data pipelines
- You are responsible to develop an expert-level understanding of data migration and CDC as it relates to Kafka using Kafka Connect and Debezium.
- You are responsible to prepare documentations – data mapping and data dictionary.
- You need to design monitoring solutions and baseline statistics reporting to support the implementation
- You need to work with Kafka and Confluent API's (e.g. metadata, metrics, admin) to provide pro-active insights and automation.
Job Requirements
- Bachelor Degree in Computer Science, related field or equivalent work experience
- 3+ years of experience in data engineering experience, including Kafka on premise.
- Strong knowledge of Kafka, database and other big data technologies
- Strong knowledge of SQL (tuning) and database fundamentals
- Experience in Data Warehousing and Big Data.
- Experience in Operational Data Store and Change data capture.
Job Type: Full-time
Pay: RM8,500.00 - RM9,000.00 per month
Schedule:
- Monday to Friday