Lead Data Engineer
Apply on
Availability Status
This job is expected to be in high demand and may close soon. We’ll remove this job ad once it's closed.
Description
Lead Data Engineer
Important Information
Location: Kuala Lumpur Malaysia
Experience: 8-10 years
Job Mode: Full-time Contract
Work Mode: On-Site
Responsibilities and Duties
Data pipeline development and operationalization
- Design data pipelines to ingest data from multiple sources and implement quality processes
- Design processes to create data insight, data features and operationalize analytics models
- Develop and implement those data pipelines
- Operationalize data pipelines for automated and semi-automated execution
- Implement reporting of data universe, data quality across the organization
Data platform innovation
- Own the Data Platform, suggest, specify, and implement enhancements to the platform
- Suggest and implement technology components relevant to the data platform
- Support key initiatives including migration of CTOS data services to the cloud
Qualifications and Skills
- Hands on working experience on Data Strong knowledge of data platforms, data pipelines, data related development including platforms such as Hadoop, Spark, Jupyter, cloud native services
- Hands on experience on cloud services and knowledge of data related cloud native services (AWS)
- tools and programming languages required to implement data pipelines: SQL, Python / Pandas
- tools required to implement automation and monitoring: Shell scripts, scheduling tools such as AirFlow
- ETL tools such as Talend and/or cloud native services
- Experience implementing reporting using a data platform or reporting software
About Encora
Encora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.
At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.
* Required field**Encora has my consent to collect, store, and process my data for the purpose of considering me for employment, and for up to 5 years thereafter. Please keep my application on file for consideration in connection with other positions at Encora and its affiliates\",\"required\":false},{\"communicationTypeId\":9691089,\"label\":\"I have read and agree to the Encora Terms of Use.\",\"required\":true}],\"legitimateInterestLegalBasis\":\"LEGITIMATE_INTEREST_PQL\",\"communicationConsentText\":\"* Required field\",\"processingConsentType\":\"REQUIRED_CHECKBOX\",\"processingConsentCheckboxLabel\":\"I have read and agree to the Encora Privacy Policy.\",\"processingConsentFooterText\":\"If you decide that you wish to apply for a job with us, you may submit your contact information and your resume through Encora Sites. We will collect the information you choose to provide on your resume, such as your education and employment experience. We may use information provided by you in connection with your application for employment to assess your qualifications and we may share this information with clients and affiliates of Encora solely in connection with our efforts to evaluate you for a position at Encora or for assignment to one or more Encora Clients. \",\"privacyPolicyText\":\"**Encora has my consent to collect, store, and process my data for the purpose of considering me for employment, and for up to 5 years thereafter.\",\"isLegitimateInterest\":false}","embed
Type":"REGULAR","disableCookieSubmission":"true","renderRawHtml":"true","user
Agent":"Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/102.0.0.0 Safari/537.36 JobBot/2.0 (+http://www.jora.com/bot)","page
Title":"Encora Jobs","page
Url":"https://careers.encora.com/application?4515357007&gh_jid=4515357007","page
Id":"54643943513","url
Params":{"gh_jid":"4515357007"},"isHubSpotCmsGeneratedPage":true,"canonical
Url":"https://careers.encora.com/application","content
Type":"standard-page","hutk":"a017bc2fc195da5c76b8fc76961c903d","__hsfp":2104123436,"__hssc":"119895511.198.1726729295632","__hstc":"119895511.a017bc2fc195da5c76b8fc76961c903d.1726729295631.1726729295631.1726729295631.1","form
Target":"#internal-form","boolCheckBoxFields":"LEGAL_CONSENT.subscription_type_70802668,LEGAL_CONSENT.subscription_type_9691089,LEGAL_CONSENT.processing","rumScriptExecuteTime":799.6999999880791,"rumTotalRequestTime":1043.6000000238419,"rumTotalRenderTime":1147,"rumServiceResponseTime":244,"rumFormRenderTime":103.39999997615814,"connection
Type":"4g","firstContentfulPaint":0,"largestContentfulPaint":0,"locale":"en","timestamp":1726730276092,"originalEmbedContext":{"portal
Id":"7958737","form
Id":"d278aac2-6b59-4e39-8856-8fc90c066bc6","region":"na1","target":"#internal-form","is
Builder":false,"isTestPage":false,"is
Preview":false,"isMobileResponsive":true},"correlation
Id":"5f36ccfb-73c6-4b76-ac57-c55edf3cbfe9","renderedFieldsIds":["private_first_name","private_last_name","email","private_country_selector","mobilephone","private_linkedin","private_document","availability_to_start_working","candidate_gh_job_id","candidate_source_id","city","state","LEGAL_CONSENT.subscription_type_70802668","LEGAL_CONSENT.subscription_type_9691089","LEGAL_CONSENT.processing"],"captcha
Status":"LOADED","emailResubscribeStatus":"NOT_APPLICABLE","isInsideCrossOriginFrame":false,"source":"forms-embed-1.5999","source
Name":"forms-embed","source
Version":"1.5999","sourceVersionMajor":"1","sourceVersionMinor":"5999","allPageIds":{"analyticsPageId":"54643943513","contentPageId":54643943513,"contentAnalyticsPageId":"54643943513"},"_debug_embedLogLines":[{"client
Timestamp":1726730274420,"level":"INFO","message":"Retrieved customer callbacks used on embed context: [\"onFormReady\"]"},{"client
Timestamp":1726730274421,"level":"INFO","message":"Retrieved page
Context values which may be overriden by the embed context: {\"page
Title\":\"Encora Jobs\",\"page
Url\":\"https://careers.encora.com/application?4515357007&gh_jid=4515357007\",\"user
Agent\":\"Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/102.0.0.0 Safari/537.36 JobBot/2.0 (+http://www.jora.com/bot)\",\"url
Params\":{\"gh_jid\":\"4515357007\"},\"page
Id\":\"54643943513\",\"contentAnalyticsPageId\":\"54643943513\",\"contentPageId\":54643943513,\"isHubSpotCmsGeneratedPage\":true}"},{"client
Timestamp":1726730274425,"level":"INFO","message":"Retrieved country
Code property from normalized embed definition response: \"US\""},{"client
Timestamp":1726730275953,"level":"INFO","message":"Retrieved analytics values from API response which may be overriden by the embed context: {\"hutk\":\"a017bc2fc195da5c76b8fc76961c903d\",\"canonical
Url\":\"https://careers.encora.com/application\",\"content
Type\":\"standard-page\",\"page
Id\":\"54643943513\"}"}]}">
