Insight Global is hiring a Technical Lead / Data Architect to drive the build-out of an enterprise-grade digital supply chain data platform. This is a hands-on architecture and delivery leadership role: you'll own the migration of legacy Alteryx workflows and flat-file processes into a modern, governed Databricks/Azure ecosystem, and you'll be the technical authority other teams look to for direction. This is a senior, hands-on role. Candidates must demonstrate direct, hands-on build experience in both Azure Databricks and Alteryx.
Required Qualifications
- 8–12+ years in data engineering or data architecture
- Hands-on, production-level experience with Azure Databricks — building, optimizing, and operating pipelines
- Hands-on, production-level experience with Alteryx — building and maintaining workflows, with direct experience migrating Alteryx workflows to a cloud-native platform
- Proven track record building medallion/layered architectures (Bronze/Silver/Gold), ETL/ELT pipelines, and production-grade Python and SQL
- Direct experience migrating legacy systems (Alteryx, flat-file processes) to modern cloud platforms
- Strong data modeling, performance tuning, and testing strategy skills
- Experience leading technical teams in Agile/Scrum environments
Certifications Required
- Databricks Certified Data Engineer (Associate or Professional)
- Microsoft Azure Data Engineer Associate (DP-203) or equivalent Azure data certification
- Alteryx Designer Core/Advanced Certification preferred
Key Responsibilities
Architecture & Platform Design
- Lead design and optimization of medallion architecture across enterprise data pipelines
- Set and enforce data architecture standards across ingestion, transformation, storage, and consumption
- Redesign gold-layer datasets for performance, scalability, and downstream analytics
- Build the platform for reliability, performance, and governance from day one
Migration & Modernization
- Architect and own the migration of 40 Alteryx workflows to Databricks and 500 flat-file sources into scalable pipelines
- Set the conversion strategy for simple vs. complex pipelines
- Define flat-file ingestion strategy, including automation and replacement with stronger data sources where feasible
- Validate parity between legacy and new systems through comparison testing and SIT/UAT readiness
Engineering Excellence & Delivery
- Drive production-grade Python/SQL development and enforce engineering best practices
- Stand up CI/CD pipelines, testing frameworks, and automated validation
- Define and lead test strategy (unit, SIT, UAT, regression) with stakeholders
- Deliver complete technical documentation: architecture diagrams, runbooks, technical specs
Platform & Ecosystem Integration
- Lead implementation across Dev, QA, and Prod Azure environments
- Design scalable ingestion frameworks for structured and semi-structured data
- Enable downstream integrations, including Tableau dashboards and data sharing
Leadership & Stakeholder Management
- Act as the technical authority across architecture, engineering, and delivery
- Translate business requirements into scalable data solutions with Product, Business SMEs, and QA
- Guide development teams and hold the line on architectural alignment
- Own sprint planning and technical backlog for the workstream
