Senior Data Engineer

About DataNimbus:

At DataNimbus, we are on a mission to redefine how organizations leverage Data and AI to drive growth, innovation, and efficiency. Our pioneering products, such as DataNimbus Designer (a cloud-native ETL designer), datanimbus.io (a comprehensive data and integration platform), FinHub.ai (payment modernization platform) empower businesses to simplify complex workflows, adopt cutting-edge technology, and achieve sustainable scalability.

With headquarters in the U.S. and offices in India and Canada, DataNimbus operates globally, fostering a culture of responsible innovation, adaptability, and customer-centricity. We pride ourselves on being a trusted partner for customers navigating the complexities of Data+AI and payment modernization.

Why Join DataNimbus

At DataNimbus, we believe in shaping a sustainable, AI-driven future while offering an environment that prioritizes learning, innovation, and growth. Our core values—Customer-Centricity, Simplicity, Curiosity, Responsibility, and Adaptability—are the foundation of our workplace, ensuring every team member can make a meaningful impact. Joining DataNimbus means being part of a dynamic team where you can:

• Work with cutting-edge technologies and revolutionize workflows in Data+AI solutions.
• Contribute to solutions that are trusted by global businesses for their scalability, security, and efficiency.
• Grow personally and professionally in a culture that values curiosity and continuous learning.

If you are passionate about innovation, ready to solve complex challenges with simplicity, and eager to make a difference, DataNimbus is the place for you.

What do we want you to do:

• Handle a variety of impactful customer technical projects which may include designing and building reference architectures, creating how-to's and productionalizing customer use cases
• Work with engagement managers to scope variety of professional services work with input from the customer
• Guide strategic customers as they implement transformational big data projects, 3rd party migrations, including end-to-end design, build and deployment of industry-leading big data and AI applications
• Consult on architecture and design, bootstrap or implement customer projects which leads to a customers successful understanding, evaluation and adoption of Databricks.
• Support customer operational issues with an escalated level of support.
• Ensure that the technical components of the engagement are delivered to meet customer's needs by working with the Project Manager, Architect, and Customer teams.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
• Mentor and provide guidance to junior data engineers and team members.

What would help make your case:

• 4+ years experience in data engineering, data architecture, data platforms & analytics
• At least 3+ years experience with Databricks, PySpark, Python, and SQL.
• Consulting / customer facing experience, working with external clients across a variety of industry markets
• Comfortable writing code in both Python and SQL
• Proficiency in SQL and experience with data warehousing solutions
• Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one
• Strong understanding of data modeling, ETL processes, and data architecture principles.
• Deep experience with distributed computing with Apache Spark™ and knowledge of Spark runtime internals
• Familiarity with CI/CD for production deployments - GitHub, Azure DevOps, Azure Pipelines
• Working knowledge of MLOps methodologies
• Design and deployment of performant end-to-end data architectures
• Experience with technical project delivery - managing scope and timelines
• Documentation and white-boarding skills
• Experience working with clients and managing conflicts
• Build skills in technical areas which support the deployment and integration of Databricks-based solutions to complete customer projects
• Good to have Databricks Certifications
• Strong communication and collaboration skills
• Excellent problem-solving skills
• Ability to travel up to 30% when needed