We're looking for
Data Engineers!
Responsibilities
- Work with analytics teams to ensure data is clean, structured, and accessible for analysis and reporting
- Implement data quality and governance frameworks to ensure data integrity across the organization
- Contribute to data exploration and analysis projects by delivering robust, reusable data pipelines that support deep data analysis
- Design, implement, and optimize scalable data architectures, including data lakes, data warehouses, and real-time streaming solutions
- Develop and maintain ETL/ELT pipelines to ensure efficient data flow from multiple sources
- Leverage automation to streamline data ingestion, processing, and integration tasks
- Develop and maintain scripts for data automation and orchestration, ensuring timely and accurate delivery of data products
- Work closely with DevOps and Cloud teams to ensure data infrastructure is secure, reliable, and scalable
Qualifications
- Proficient in building and maintaining ETL/ELT processes using tools such as Apache Airflow, DBT, Talend, or custom scripts in Python, SQL, NoSQL etc
- Analytics: Strong understanding of data analytics concepts, with experience in creating data models and working closely with BI/Analytics teams
- Automation: Familiarity with data automation tools (eg, Apache Airflow, Prefect) and scripting (Python, Shell, etc) to automate data workflows
- Data Architecture: Proficiency in designing and maintaining data lakes, warehouses, and real-time streaming architectures using technologies like AWS/GCP/Azure, Hadoop, Spark, Kafka, etc
- Soft Skills:Excellent problem-solving skills and ability to work independently and as part of a team
- Ability to collaborate cross-functionally with analytics, business intelligence, and product teams
- Strong communication skills with the ability to translate complex technical concepts for non-technical stakeholders
- Attention to detail and commitment to data quality and governance
(*Note: This is a requirement for one of Scout's clients)
Skills: data,automation,analytics