Data Engineering Manager

The Software Engineering Manager will lead the Data Platform Sources team in developing software that extracts, cleans, and normalizes data from government websites and other data sources. The software will be based on data integration frameworks and pipeline architectures developed by the Verifiable.com Data Engineering team. The Software Engineering Manager will be responsible for defining projects, hiring and training the necessary permanent and temporary talent for executing these projects, and directly reviewing code and enforcing quality standards.

Responsibilities

• Manage a team of software engineers, providing technical guidance and direction
• Define projects and establish timelines and deliverables
• Hire and train software engineering talent to meet project needs
• Review code and ensure quality standards are met
• Collaborate with the core Verifiable.com team to use and extend our web scraping and data frameworks
  
  

Requirements

• At least 5 years of experience of direct involvement in software development, writing production code for data or backend applications
• At least 2 years experience managing teams as a team lead; track record of success delivering high-quality projects in tight time frames.
• Previous experience in assembling and coordinating a team of outsourced developers to execute on short term projects in collaboration with a core architecture team
• Familiarity in navigating team project definitions characterized by high volume and low- to-moderate complexity - the team will be integrating a large number of data sources where the implementation of each individual source is usually relatively straightforward
• Experience implementing software development best practices such as Scrum
• Excellent written and verbal communication skills
• Experience developing web scrapers that can circumvent bot detection, rate limits, and IP restrictions
  
  

Significant experience writing production code in Python

• Experience with writing jobs in workflow orchestrators such as Airflow, Dagster or Prefect
• Experience developing ETL transformations in SQL
  
  

Name *

Email *

Phone number*