APACHE SPARK DEVELOPER

Job Description: 1. To setup and develop massive parallel processing using Apache SPARK platform 2. To design parallel processing algorithm for millions of data using Apache SPARK platform 3. To troubleshoot Apache SPARK platform running at least 20 nodes 4. To setup Artificial Intelligence running on Apache Spark with Large Language Model functionality for Bahasa Indonesia Requirements: 1. Must have comprehensive experience in develop and setup Apache SPARK based parallel processing for at least 10 nodes with real massive business data 2. Must have experience in managing million of transactions using parallel processing, including designing the data structure 3. Having strong knowledge and ability ini paralel programming using JAVA/SCALA/PYSPARK running on Apache Spark platform 4. Having experience in designing Large Language Model for Generative Artificial Intelligence, deployed in real application and projects, involving million size of data set in Bahasa Indonesia 5. Able to setup at least 10 nodes Apache Spark platform for paralel processing. 6. Having strong Machine Learning programming skill using Large Language Model, for Bahasa Indonesia 7. Willing to demonstrate the skills required through live technical testing : paralel programming using Apache Spark plaform, Large Language Model programming, Machine Learning model development based on Unstructured Data Set and Problem Statement given 8. . Please describe the professional experiences above in the CV