Position: Solution Architect (AWS Data Platforms)
Experience: 12+ Years
Location: Chennai, Bangalore
Key Skills: Data & Analytics, AWS Data Engineering, AWS Glue, Glue data catalog, EMR, Amazon redshift
Job Description
We are looking for an experienced
Technical / Solution Architect to join our dynamic team of data professionals. The ideal candidate will play a key role in architecting, designing and leading the implementation of modern data and analytics platforms on cloud platforms, with deep expertise in AWS based solutions for data engineering and AI. You will be front-ending all the technical discussions with the customer stakeholders and provide the technical guidance and leadership for the implementation team internally.
Roles And Responsibilities
As the Solution Architect, your key responsibilities will include
- Owning end-to-end solution and technical architecture for data platform implementations on AWS, including cloud environment set-up, networking, data engineering, data storage and management, security, data privacy and access control
- Designing and communicating the data architecture and data management strategy for customer implementations
- Good understanding of leveraging AWS services for data preparation and wrangling for analytical use-cases, specifically for GenAI solutions
- Document solution architecture, technical architecture, design documentation (HLD) and relevant artifacts for the customer implementations
- Implement data security and privacy controls including policies, access control using RBAC/ABAC, data classification etc.
- Ensuring the proposed solution meets the applicable regulatory and compliance requirements; specifically for regulated industries like Insurance and Healthcare
- Providing technical guidance and reviewing the technical design for delivery artifacts for greenfield implementation projects, data modernization or data migration projects
- Driving technical design walk-throughs and reviews with customer stakeholders
- Driving delivery excellence and productivity with automation and adoption of coding standards and best practices
- Running discovery workshops with business and technical stakeholders for identifying business goals and objectives, and translating business requirements into solution roadmaps and backlogs
- Good understanding of data science concepts and foundational concepts of GenAI solutions
- Driving evaluation of technology choices, technical proof-of-concepts and documenting architecture and decision decisions, trade-offs between choices and presenting the same to stakeholders and executives
- Driving competency building in terms of technical mentoring of team members and owning development of tools and solution accelerators
Profile Requirements
- 12+ years of experience in data and analytics, with minimum of 3+ years of experience in technical architecture and / or solution architecture roles on AWS
- Proficiency in AWS stack for data and analytics specifically AWS Glue, Glue Data Catalog, EMR and Amazon Redshift
- Good hands-on experience with implementation of Lakehouse using Databricks (on AWS preferred)
- Experience implementing data integration using Delta Live Tables and Spark/pySpark jobs using job clusters
- Implementing data governance, including data catalog, data lineage and access control using Unity Catalog
- Implementing data analytics and consumptions using SQL Warehouses
- Good understanding of Databricks features and capabilities for GenAI solutions including Vector Search, Databricks BI/AI, Databricks Genie etc.
- Experience with AWS services for enabling the data foundation for GenAI solutions (content extraction using AWS Textract for example)
- Good understanding and experience in networking and common services on AWS including VPC, private endpoints, logging and monitoring services, credential vaults etc.
- Proven experience in documenting and presenting solution and technical architecture
- Minimum of 5+ years of experience in leading implementation of data engineering / analytics solutions on AWS, from architecture and technical design standpoint
- Excellent verbal and written communication skills, capable of conveying complex technical concepts to non-technical stakeholders
- Ability to work collaboratively in a fast-paced environment, demonstrating flexibility and adaptability
Skills: aws data platform,amazon redshift,aws data engineering,data & analytics,solution architect,aws,glue data catolog,aws glue,emr
