Data Engineer

DataMicron is a multi-award Big Data and AI company, with patented technologies in USA and China. We have extensive experience in developing products and full-scale solutions in the field of business intelligence, machine learning & AI, data engineering and front-end development. We have covered and implemented end-to-end Big Data Analytics solutions in eight countries across major public and private sector organizations, and are currently going through a large expansion in our business portfolio.

To fuel our global expansion, we are looking for committed and dedicated Data Engineer to be part of our exciting global growth strategy.

Responsibilities:

• Designing, developing, and maintaining robust ETL pipelines that ensure the smooth extraction, transformation, and loading of data from various sources into our data warehouse.
• Develop and maintain detailed and accurate Entity-Relationship Diagrams (ERD) to model database structures.
• Liaise with customers to understand data and data transformation requirements.
• Develop and maintain comprehensive documentation for data models, database designs, and data pipelines.
• Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and translate them into technical solutions.
• Perform data cleansing and transformation to ensure data quality and integrity.
• Where necessary, create python scripts and RESTful APIs to perform advanced data processing
• Troubleshoot and resolve database performance issues and data-related problems.

Requirements:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer or in a similar role.
• Strong proficiency in SQL and experience with database design and optimization, with knowledge of database management systems such as MySQL, PostgreSQL, SQL Server, or similar.
• Familiarity with data modeling concepts and tools, including ERD.
• Experience with ETL processes and tools.
• Strong communication skills and the ability to work collaboratively in a team environment.
• Willingness to document processes, designs, and solutions meticulously.
• Understanding of data warehousing concepts and technologies.
• Excellent problem-solving skills and attention to detail.

Preferred Qualifications:

• Experience with drag-and-drop ETL tools like Alteryx, Talend, KNIME etc.
• Experience with cloud-based data services (e.g., AWS, Google Cloud, Azure).
• Familiarity with big data technologies such as Hadoop, Spark, or similar.
• Knowledge of programming languages such as Python or Java.
• Experience with data governance and data security best practices.