Data Migration Engineer
Spark:
· Develop and optimize Spark-based data processing for large-scale ETL and analytics.
· Implement Spark SQL, Data Frames, RDDs, and Streaming for efficient data transformations.
SQL:
· Write and optimize complex SQL queries for dataextraction, transformation, and aggregation.
· Work on query performance tuning, indexing, and partitioning for optimized execution.
Java (Preferred with Scala knowledge):
· Java is essential as Scala runs on the JVM, making JVM tuning critical for Spark-based workloads.
· Develop data processing applications using Scala (running on JVM) and Java-based backend services.
· Optimize JVM performance, memory management, and garbage collection to enhance Spark job execution.
Job Types: Full-time, Permanent
Pay: Up to RM12,000.00 per month
Experience:
- Data Migration: 4 years (Required)
Work Location: In person