Data Engineer (particular in ETL, with knowledge in Spark/Hive)
Company Description
Beyondsoft, founded in 1995, is a leading global provider of IT solutions and consulting services with over 40 trusted delivery centers worldwide. Beyondsoft aims to be the world’s leading provider of IT solutions by integrating world-class business solutions for global clients. The Malaysia branch, Beyondsoft Malaysia Sdn. Bhd., established in 2019, offers IT consulting and solution services for various industries, focusing on creating sustainable value for stakeholders and improving performance.
Role Description
- Perform ETL tasks on large and complex transaction datasets for business users
- Develop data processing pipelines for modelling and analysis
Qualifications
1、Degree in Computer Science or related technical field
2、2+ years of working experience in data engineer or data analysis
3、Good understanding of various types of databases, including relational databases and distributed databases
4、Good understanding of Python/Java, SQL, HiveQL/SparkSQL and the relevant best practices/ techniques for perf tuning
5、Good analytical and technical skills in building batch/streaming data pipelines for big data,with experience using big-data processing engine like spark/flink/hive