As a Data Engineer, you will design, develop, and maintain our data infrastructure, ensuring efficient data processing and analysis. You will work closely with data scientists and software engineers to deliver high-quality data solutions that drive business decisions.
Responsibilities:
-
Design, build, and maintain scalable data pipelines using Python, Spark, and AWS services.
-
Develop and implement data quality checks and monitoring systems.
-
Collaborate with data scientists to understand data requirements and optimize data delivery.
-
Work in an Agile environment and contribute to the continuous improvement of our data infrastructure.
Ideal Profile:
-
3+ years of experience as a Data Engineer or in a similar role.
-
Strong programming skills in Python and experience with Spark.
-
Hands-on experience with AWS services like S3, EC2, EMR, and Redshift.
-
Proficiency in SQL and data modeling techniques.
-
Excellent communication and collaboration skills.