Data Engineer/Analyst
Apply on
Job Description
We are looking for a skilled Data Engineer with expertise in data modelling and data pipeline development. As a Data Engineer/Analyst. You will work with the big data team, adopting best practices to develop and optimize data pipelines, reporting and dashboarding to meet business requirements. Proficiency in serverless cloud services like AWS Glue, Aurora, Lambda, RDS and Redshift. Handle Management Information Systems (MIS) to generate reports and develop dashboards using business intelligence tools.
Requirements:
3 years of hands-on experience of data integration and analytics in a corporate or consulting setting
Design, develop and maintain efficient data pipelines to support data processing, transformation and integrations needs.
Collaborate with cross-functional teams to understand data requirements and implement solutions that are needed for business needs.
Work with various data sources and formats, ensuring data quality and consistency.
Monitor and troubleshoot data pipelines to ensure consistency of data flow.
Handle Management Information Systems (MIS) including data collection, analysis and reporting for decision-making purpose.
Able to build report by tools (SAP, PowerBI or any reputable BI tools)
Hands on experience in AWS services (AWS Redshift, AWS Glue, AWS S3, AWS Lambda, AWS RDS, AWS AuroraDB, AWS API Gateway)
Coding language: Python, PySpark, SQL, Linux
Other skills: ETL/ELT skills, Architecture modelling, Data Modelling, Dashboarding, Story Telling, Documentation