Epicareer Might not Working Properly
Learn More

Python Software Engineer

  • Full Time, onsite
  • Private Advertiser
  • Kuala Lumpur Developers/Programmers (Information & Communication Technology) Full time RM 6, Malaysia
Salary undisclosed

Apply on


Original
Simplified

Job Responsibilities:

  • Independently responsible for dynamic web page data crawling, and classify, parse, analyze, clean, and store the crawled data, as well as output the corresponding documentation.
  • Responsible for building the crawler framework and developing high-performance crawling programs.
  • Able to actively communicate with project-related colleagues on requirement issues and technical issues.
  • Responsible for crawler core technology research and crawler strategy optimization, and responsible for data quality.
  • Tackle technical difficulties and solve various problems encountered in the actual development process.
  • Job Requirements:

  • Have more than 3 years of Python development experience, with a bachelor's degree or above.
  • Familiar with web crawling principles and technologies, familiar with regular expressions, httpClient, jSoup, Xpath, CSS and other web information extraction techniques, and familiar with the use of common crawler technology frameworks.
  • Have strong analysis and problem-solving abilities, master common crawler and anti-crawler technologies, dynamic web page crawling, browser simulation crawling, and App crawling.
  • Priority will be given to those with experience in natural language processing, grammar analysis, syntactic analysis, text classification/clustering, machine learning, deep learning, image recognition, etc.
  • Priority will be given to those with experience in the design, construction, and development of Hadoop, Spark, HBase, Storm, Hive and other big data processing frameworks.
  • Familiar with the application of MySQL database, and have relevant experience in the design, optimization and security protection of MySQL.
  • Familiar with the application of Redis database.
  • Familiar with the deployment and configuration of Nginx and Apache application servers.
  • Good coding habits, and can write corresponding development documents.
  • Have a strong sense of responsibility, enterprising spirit and teamwork spirit, and have certain communication and understanding abilities.
  • Those familiar with website front-end languages such as JS, HTML, CSS will be preferred.
  • Those familiar with Docker and have Docker, Kubernetes operation and maintenance experience will be preferred.
  • Those familiar with the Java language will be preferred
  • Required language(s): Bahasa Malaysia, MANDARIN, English. Prefer Mandarin-speaking candidates (SPEAK,READ, and WRITE in MANDARIN) to liaise with China colleagues & customers.
  • Able to start work immediately.