Big Data Developer

About the Role

We are looking for a Software Engineer to join our team and help build a high-performance reporting platform that powers data-driven decision-making. This is an opportunity to work with BigQuery, Spark, Airflow, and Python, designing and developing robust ETL pipelines and APIs that ensure high data quality, reliability, and performance.

Qualifications & Skills

• 5+ years of experience in software engineering with a focus on big data, ETL, and API development.
• Strong expertise in Python, including experience with Flask for building APIs.
• Experience working with BigQuery and Spark for processing large-scale data.
• Proficiency in Airflow for orchestrating data workflows.
• A deep understanding of data modeling, performance tuning, and scalability considerations in a reporting environment.
• A strong owner mindsetyou take pride in your work, prioritize data quality, and are proactive in solving problems.
• Ability to work independently and collaboratively in a fast-paced environment.

Key Responsibilities

• Design, develop, and maintain ETL pipelines using BigQuery, Spark, and Airflow to process and transform large datasets efficiently.
• Build APIs using Python and Flask to make reporting data easily accessible to internal and external stakeholders.
• Ensure data quality, accuracy, and consistency, establishing best practices for monitoring and validation.
• Collaborate with cross-functional teams, including data analysts and product managers, to understand reporting needs and translate them into scalable solutions.
• Optimise performance and scalability of the reporting platform to support growing data volumes and business requirements.
• Maintain and improve the orchestration of data workflows using Airflow.
• Take ownership of the platform's architecture, making key decisions to build a solid and future-proof foundation.

Nice to have experience in the advertising industry, working with ad-related data and reporting needs.

About Us

Demandbase is the Smarter GTM company for B2B brands. We help B2B companies hit their revenue goals using fewer resources. How By aligning their sales and marketing teams around a combination of their data, our data, and artificial intelligence what we call Account Intelligence so they can identify, engage, and focus their time and money on the accounts most likely to buy.

As a company, we're as committed to growing careers as we are to building world-class technology. We invest heavily in people, our culture, and the community around us. We have offices in the San Francisco Bay Area, Seattle, and India, as well as a team in the UK. We have also been continuously recognized as one of the best places to work in the San Francisco Bay Area including, Best Workplaces for Millennials and Best Workplaces for Parents!