Epicareer Might not Working Properly
Learn More

Data Engineer

Salary undisclosed

Apply on


Original
Simplified

Company Description

Skill Quotient Technologies is a CMMI level 3 & ISO 27001:2013 certified IT company specializing in Cyber Security, Robotic Process Automation, Data Analytics, SAP, Software Development, and Software Testing. With offices in the USA, UAE, Malaysia, Singapore, and India, we have a dedicated team of 1200+ employees driving innovation.

12 Month Contract with SQ

location: KL

Deliverables

  • Assess existing data dictionaries and build up the data catalogue for various consumption
  • Design and implement data pipelines to support the company's data initiatives, while ensuring data security and compliance
  • Work with a variety of data sources such as MS SQL, MySQL, Oracle, and PostgreSQL
  • Leverage AWS Glue for ETL and Data Lake, Data Warehouse for data storage and subsequent consumption
  • Use and manage Apache Kafka/AWS MSK for data streaming and stream processing
  • Work with ETL functions to transform the data for consumption to support multiple use cases
  • Support ML model training and prediction using appropriate models to solve problems
  • Collaborate with cross-functional teams to ensure data quality and accuracy
  • Monitor data pipeline performance and make optimizations as needed
  • Ensure data security and compliance by implementing appropriate measures, such as access controls, encryption or anonymization
  • Stay up-to-date with the latest technologies and industry trends related to data engineering and data security and compliance

Minimum Qualifications

  • Bachelor’s degree in computer science, Information Systems Technology, or Software Engineering
  • At least 5-7 years of relevant experience in Information Technology, especially in the field of Data Engineering and/or Data Science
  • Relevant work experience in the Financial Services and/or Technology sectors would be an added advantage
  • Excellent in both English and Bahasa Malaysia