Data Engineer
Salary undisclosed
Apply on
Original
Simplified
As a Data Delivery Engineer, you will be a crucial part of our engineering team, responsible for designing, developing, and maintaining robust web crawlers and scrapers. This role involves collaboration with project managers, understanding client requirements, and staying updated on the latest web scraping technologies.
Responsibilities:
- Collect and monitor various types of websites and APPs;
- Ensure that the crawler system continues to work normally every day;
- Write crawler code for new projects;
- Clean the data
Requirements:
- College degree or above; Computer Science equivalent preferred
- 1 to 3 years of hands-on experience in software development; crawler-related engineering experience is preferred
- Familiar with Python or Java programming language; familiar with HTML, JavaScript, regular expressions, and XML; familiar with HTTP/HTTPS protocol, understanding shell
- Familiar with pandas is preferred
- Chinese as a working language
Similar Jobs