Senior Data Engineer

Reppls

India

8-10 Years

This job is no longer accepting applications

Posted 2 months ago

Job Description

*instinctoolsis a software development company that provides custom software solutions for businesses of all sizes. Our team works closely with clients to understand their specific needs and provide personalized solutions that meet their business requirements.

*instinctoolsis looking for aSeniorData Engineerfor one of our clients.

Our Clientis one of theTOP-5global management consulting firms considered to be among the most prestigious ones in the world. Hundreds of customers fromFortune-500, including the largest global financial institutions, the world's top media companies, technology companies and federal government agencies rely on our Client's proven platform and services.

Projectis a dynamic solution empowering companies to optimize promotional activities for maximum impact. It collects and validates data, analyzes promotion effectiveness, plans calendars, and integrates seamlessly with existing systems. The tool enhances vendor collaboration, negotiates better deals, and employs machine learning to optimize promotional plans, enabling companies to make informed decisions and maximize return on investment.

Stack on the project:Databricks, SQL, and Spark, AWS, Python.

Project duration:12 months (with possible extension)

Tasks:

Build and optimize data pipelines using Databricks, SQL, and Apache Spark.
Design and implement scalable data processing systems.
Manage and optimize data pipelines.
Ensure the quality and efficiency of data flows.

Our expectations of the ideal candidate:

8+ years of experience as a Data Engineer.
Deep expertise in big data technologies, particularly Databricks, SQL, and Spark.
Very strong SQL skills.
Experience in data modeling and ETL processes.
Experience with analytics engineering is a plus.
Experience with DBT, AWS, Python.

Soft Skills: