17 March 2023

Are you a Senior Data Engineer who likes to stay ahead of the curve? We are looking for experienced Senior Data Engineers to join our team and help us tackle Big Data challenges.

Mandatory Skill(s)

  • Over all 8+ years of experience and relevant 4+ years of experience in Data Engineer.
  • Experience in distributed technology tools, viz. SQL, Spark, Python 5+ years, Scala 2+ years
  • Experience in Cloud Computing, e.g., AWS, GCP, Azure 3+ years
  • Airflow workflow scheduling tool, Airflow 3+ years
  • GitHub source control tool & experience with creating/ configuring Jenkins pipeline 3+ years

Desirable Skill(s)

  • Good to have experience in EMR/ EC2, Databricks etc.
  • DWH tools incl. SQL database, Presto, and Snowflake
  • Streaming, Serverless Architecture
  • Microservices Architecture
  • Data structures and algorithms.

Responsibilities

  • Designing and building reusable components, frameworks and libraries at scale to support analytics products.
  • Designing and implementing product features in collaboration with business and Technology stakeholders.
  • Anticipating, identifying and solving issues concerning data management to improve data quality.
  • Cleaning, preparing and optimizing data at scale for ingestion and consumption.
  • Driving the implementation of new data management projects and re-structuring of the current data architecture.
  • Implementing the complex automated workflows and routines using the workflow scheduling tools.
  • Building continuous integration, test-driven development and production deployment frameworks.
  • Driving collaborative reviews of design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards.
  • Evaluating the profile data for the purpose of designing scalable solutions.
  • Troubleshooting complex data issues and performing root cause analysis to proactively resolve product and operational issues.

If you are interested in this role, click on the “Apply to this job” button below or you could also write in with your CV to Vivek S at vivek.s@sciente.com quoting the job title.

Vivek S
Technology Recruitment Specialist
Apply to this Job