Search by job, company or skills

auxoai

Data Architect - Databricks

new job description bg glownew job description bg glownew job description bg svg
  • Posted 18 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description

We are hiring a Data Architect to lead a strategic enterprise data modernization initiative forplatformusing Medallion architectureAWS Databricks. The role will define target-state architecture,establishenterprise data governance frameworks, implement CI/CD best practices for data platforms, and build GenAI-ready data foundations that enable advanced analytics, machine learning, and secure enterprise data access.

You willbe responsible forarchitecting scalable cloud-native data ecosystems, designing governed data models, and enabling real-time and batch data processing capabilities. This role requires deep ownership of architecture standards, platform performance, and cross-functional alignment across engineering, analytics, and data science teams to ensure consistent, secure, and high-performance data consumption across enterprise use cases.

Location- Mumbai/Bangalore/Hyderabad/Gurgaon (Hybrid - 3 Days a week in Office)

Responsibilities -

  • Lead enterprise-scaleimplementation ofdata warehousedataplatformson DatabricksandSnowflake environments.
  • Design and implement Medallion (Bronze/Silver/Gold) architecture and scalable enterprise data models.
  • Establish data modeling standards (dimensional, data vault,lakehousepatterns) and ensure best practices across projects
  • Establish enterprise data governance frameworks including cataloging, lineage, stewardship, and compliance using Atlan.
  • Define and implement CI/CD pipelines for infrastructure and data platform deployments
  • Design data architectures that support AI/ML and Generative AI workloads including vector storage, feature layers, and secure access patterns.
  • Build scalable ingestion frameworks supporting batch, streaming, and CDC pipelines.
  • Architect secure, high-performance data integration layers for analytics, BI, and AI consumption.
  • Develop target-state architecture blueprints and enforce data standards, governance, and best practices across teams.
  • Collaborate with engineering, analytics, and data science teams to ensure platform alignment and scalability.
  • Engage with clients as a trusted advisor, driving data strategy, roadmap definition, andidentifyingopportunities for expansion.

Requirements:

  • 10-15 years of experience in Data & Analytics Architecture with proven leadership in large-scale enterprise data modernization initiatives
  • Strong understanding of batch, streaming, real-time, and near real-time data architectures
  • Proven experience implementing enterprise Data Governance frameworks and tool
  • Hands-on experience enabling AI/ML and Generative AI data pipelines.
  • Deepexpertisein data domains including Data Warehousing, Data Modeling (Dimensional, Data Vault), MDM, Data Quality, Metadata Management, and Data Catalog implementation
  • AdvancedDatabricksexperience including architecture design, optimization, andsecurity;including hands-on experience with Delta Lake, Databricks SQL, Unity Catalog, Delta Live Tables,MLflowand integration with cloud services (AWS/Azure)
  • Strong hands-on experience with AWS data ecosystem (S3, Glue, EMR, Lambda, Redshift, Lake Formation, Athena, DMS, etc.)
  • Experience with real-time/streaming technologies (Kafka, Kinesis, or similar)
  • Familiarity with orchestration tools such as Apache Airflow or MWAA
  • Experience implementing CI/CD pipelines for data platforms
  • AWS, Databricksand/or Snowflake certifications preferred

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 145310181