As an Senior Solution Architect - Azure Databricks, you will play a crucial role in designing, building, and maintaining scalable data pipelines and infrastructure. You will work with a variety of technologies, including Scala, Python, Spark, AWS services, and SQL, to support our data processing and analytics needs.
Responsibilities: -
- Enable end-to-end program planning/WBS and execution.
- Guiding the team technically and leading technical reviews with the project team and Client facing.
- Drive technical/solution and architecture reviews with the client business and IT stakeholders.
- Deploy CitiusTech accelerators, reusable assets, and frameworks for the engagements.
- Proactively identify technical/solution delivery risks and plan mitigation steps.
- Work with both technical and business users, platform/product partners, and other stakeholders to design and deliver quality outcomes for the data on Cloud/platform modernization engagements.
Educational Qualifications:
- Engineering Degree BE/ME/BTech/MTech/BSc/MSc.
- Technical certification in multiple technologies is desirable.
- Should be certified on at least one of the data platforms (Snowflake or Databricks), Hyperscaler/cloud certification.
Skills:
Mandatory Technical Skills:-
- Over 5 years of experience in Cloud data architecture and analytics
- Proficient in Azure, Snowflake, SQL, and DBT
- Extensive experience in designing and developing data integration solutions using DBT and other data pipeline tools
- Strong understanding of data validation, cleansing, and enrichment processes
- Experience in creating low-level design documents and unit test strategies
- Ability to perform code reviews and unit test plan reviews
- Excellent communication and teamwork skills
- Self-initiated, problem solver with a strong sense of ownership
- At least 12 to 13 years of IT experience, primarily in leading data and analytics programs tech delivery
- Should have led at least 3 large legacy EDW/data platform modernization and migrations to Snowflake/Databricks/data on Cloud engagements in the last 5 years.
- Having experience in leading all aspects of the project/program life cycle, including strategy, roadmap, architecture, design, development, and Implementation for the multi-phase/multi-year engagements and rollouts
- Should have led large team with up to 50 members
- Good to have experience in DataOps
- Snowflake
- Python/Spark/JavaScript
- AWS/Azure/GCP
- SQL
Good to Have Skills:-
- CI/CD (DevOps)
- Terraform/Airflow