SR DE (Data Engineers)vibhu

We are seeking a highly skilled and motivated Senior Data Engineer to join our growing team. The ideal candidate will be a strong problem-solver with excellent Python and SQL literacy, capable of transforming high-level business problems into practical, production-ready data solutions. This role offers an exciting opportunity to work with cutting-edge data technologies and contribute to our data-driven initiatives.

Responsibilities:

• Design, develop, and maintain robust and scalable data pipelines to ingest, transform, and load data from various sources.
• Translate complex business problems described at a high level into actionable data engineering requirements and solutions.
• Independently research, design, and implement practical data solutions, from conceptualization to production deployment.
• Ensure data quality, integrity, and reliability across all data pipelines and systems.
• Collaborate effectively with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data needs and deliver impactful solutions.
• Optimize data processing workflows for performance and efficiency.
• Contribute to the continuous improvement of data engineering processes, tools, and best practices.
• Potentially engage in exploratory data analysis to uncover insights and inform data model design (if applicable).

Required Skills and Experience:

• Mandatory Skills: Strong proficiency in Python for data manipulation, scripting, and building data pipelines.
• Expertise in SQL, including advanced querying, database design, and optimization.
• Problem-Solving: Proven ability to start from a high-level problem description, practically understand it, independently devise a solution, and successfully implement it in production.
• Desired/Secondary Skills (Plus Points):Familiarity and hands-on experience with Azure cloud services (e.g., Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics).
• Experience with Databricks for big data processing and analytics (e.g., PySpark).
• Some experience with exploratory data analysis (EDA) is welcome.