Senior Data Engineer
Salary undisclosed
Apply on
Original
Simplified
Job Descriptions:
- Proficiency in Python and SQL
- Experience with Data warehouse (e.g., Snowflake, Redshift, Google BigQuery,
MySQL) - Experience managing semi-structured data sources (JSON, CSV)
- Experience in creating and managing data architectures and pipelines
- Familiarity with AWS particularly services S3, Lambda, EMR, EC2
- Knowledge of Apache Spark, Hadoop, Kafka
- Experience building CDC ingestion and streaming pipelines e.g. Kafka
- Belief in CI/CD, modular coding, and documentation of code
- Excellent teamwork and communication skills
- Experience with Agile methodologies
Requirements:
- 5+ years of experience as a Data Engineer
- Experience with Mage.ai, Airflow…
- Experience with languages (SAS, R, Scala, C++, etc.)
- A passion for data and information analysis.
- Experience working within an Agile environment
- Interest with Machine learning or Data Science
- Has numerical and analytical skills.
- Preferred Qualifications
- A degree in STEM or Computer Science.
Similar Jobs