Senior AWS Data Engineer

Enables find, access, processing ,publication and sharing of biomedical data to generate insight for secondary use. It also contains EDIS end to end engine for secondary use and primary exploration and integration with externally generated data (RWD) from both clinical and non-clinical sources.

Responsibilities for the position:
AWS developer, Data Warehouse enhancements,ETL,

Required technologies and skills:
Senior data engineer with excellent hands-on and developed experience of ETL, Datamodel,SQL, AWS Components e.g,S3, Redshift spectrum, Athena, Redshift, DocumentDB and DynamoDB.

1. 4+ years of working with programming language focused on data pipelines,eg. Python or R
2. 4+ years of experience working with SQL
3. 3+ years of experience in data pipelines maintenance
4. 3+ years of experience with different types of storage (filesystem, relation, MPP, NoSQL) and working with
various kinds of data (structured, unstructured, metrics, logs, etc.)
5. 3+ years of experience in working in data architecture concepts (in any of following areas data modeling,
metadata mng., workflow management, ETL/ELT, real-time streaming, data quality, distributed systems)
6. 3+ years of cloud technologies with emphasis on data pipelines (Airflow, Glue, Dataflow - but also other
smart solutions of handling data in the cloud - elastic, redshift, bigquery, lambda, s3, EBS etc.)
7. 4+ years of experience working with SQL
8. 1+ years of experience in Java and/or Scala
9. Very good knowledge of relational databases (optional)
10. Very good knowledge of data serialization languages such as JSON, XML, YAML
11. Excellent knowledge of Git, Gitflow and DevOps tools (e.g. Docker, Bamboo, Jenkins, Terraform
12. Capability to conduct performance analysis, troubleshooting and remediation (optional)
13. Excellent knowledge of Unix
14. Pharma data formats is a big plus (SDTM)

Job Type: Contract

Pay: RM10,000.00 - RM15,000.00 per month

Benefits:

• Health insurance

Schedule:

• Monday to Friday