Data Platform Development Engineer

1.Build and maintain Hadoop, Spark, and other clusters, and perform necessary troubleshooting to ensure system stability. 2.Improve the efficiency and stability of the clusters, and implement reasonable system separation, monitoring systems, visualization systems, scheduling systems, and ensure cluster and data security. 3.Handle data integration for various business systems, build data warehouse consistency, and perform data governance. 4.Support, research, and develop data service platforms, data computation needs, and data architecture design. 5.Construct and optimize multi-dimensional data analysis platforms and tracking systems. Job Requirements: 1.Bachelor’s degree or higher in Computer Science or a related field, with at least three years of relevant work experience. 2.Proficient in shell/python scripting on Linux platforms, and familiar with at least one programming language (Java/Scala). 3.In-depth knowledge and practical experience with Hadoop ecosystem components such as HDFS, Hive, Spark, Flink, Kafka, etc. 4.Familiar with common real-time data ingestion and processing methods and workflows. 5.Experience with Spring Cloud and microservices development is preferred, as well as experience in big data platform architecture design and optimization. 6.Strong sense of responsibility and excellent learning ability.