8 November 2023
We are looking for a Senior Data Engineer who will be in charge of planning, implementing, and managing data infrastructure and systems.
Mandatory Skill(s)
- Bachelor's degree (BE/B.Tech) in engineering or a similar profession.
- The candidate must have 7-9 years of Data Engineer experience.
- Cloud computing experiences, such as AWS, GCP, Azure, and others.
- 5+ years of expertise in creating batch and streaming pipelines using distributed technology tools such as SQL, Spark, Python, Airflow, and Scala.
- The candidate must have 5+ years of Airflow experience.
- Cloud computing experience, such as AWS, GCP, Azure, and others. Cloud computing experience, such as AWS, GCP, Azure, and others.
Desirable Skill(s)
- Previous experience with the Agile and Scrum development processes.
- Knowledge of EMR/EC2, Databricks, and other similar technologies.
- Working knowledge of data warehousing tools such as SQL database, Presto, and Snowflake.
- Knowledge of Microservices Architecture
Responsibilities
- Designing and constructing scalable reusable components, frameworks, and libraries to support analytics solutions.
- Collaborating with business and technology stakeholders to design and deploy product features.
- Anticipating, detecting, and resolving data management challenges to increase data quality.
- Overseeing the implementation of new data management initiatives as well as the reorganization of the present data architecture.
- Using workflow scheduling tools, implement complicated automated workflows and routines.
- Creating frameworks for continuous integration, test-driven development, and production deployment.
- Driving collaborative evaluations of other data engineers' design, code, test plans, and dataset implementation in order to maintain data engineering standards.
- Analyzing and profiling the data in order to build scalable solutions.
- Experience creating/configuring Jenkins pipelines for Managed Spark jobs, building Docker images, and so on
If you are interested in this role, click on the “Apply to this job” button below or you could also write in with your CV to Moinuddin Khaja R. at moinuddin.k@sciente.com quoting the job title.
