About Position:
Were looking for a seasoned data leader who can own end-to-end analytics and ML workloads on Databricks Lakehouse, partnering with business stakeholders to solve high-impact problems. You will architect scalable data pipelines, build production-grade ML models, and deliver actionable insights through dashboards and experimentation.
- Role:Azure Data Engineer
- Location:All Persistent Location
- Experience: 8+ Years
- Job Type: Full Time Employment
What You'll Do:
- Design and maintain data lakehouse solutions using Delta Lake, Unity Catalog, Databricks SQL, Workflows, and Jobs.
- Build robust ELT/ETL pipelines using PySpark/Spark SQL, Delta Live Tables, Auto Loader, and streaming where needed.
- Implement cluster strategies (all-purpose, job clusters), Photon, and performance tuning (partitioning, Z-Ordering, caching, skew mitigation)
- Translate business problems into ML use-cases (forecasting, propensity modeling, churn, recommendation, anomaly detection, NLP).
- Build, evaluate, and productionize models using MLflow (tracking, model registry, deployment), feature engineering, and experiment management.
- Deliver analytical products: KPI frameworks, cohort/segmentation analyses, A/B testing and causal inference, time-series analytics.
- Create performant semantic layers and Databricks SQL endpoints; integrate with Power BI/Tableau for executive-ready dashboards.
Expertise You'll Bring:
- 8+ years in data engineering/data science/advanced analytics; 3+ years hands-on on Databricks in production.
- Strong in PySpark, Spark SQL, and Python; solid understanding of distributed systems and Spark internals (shuffles, partitions).
- Proven experience with Delta Lake, Databricks Workflows/Jobs, Databricks SQL, Unity Catalog, MLflow, and Git-based CI/CD.
- Expertise in data modeling (star/snowflake), medallion architecture (Bronze/Silver/Gold), performance tuning, and cost optimization.
- Demonstrated delivery of ML solutions (feature engineering, model training/validation, deployment, monitoring) or advanced analytics at scale.
- BI and stakeholder enablement with Power BI or Tableau; strong storytelling with data.
- Strong command of SQL, data quality frameworks, version control, and agile delivery.
Benefits:
- Competitive salary and benefits package
- Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
- Opportunity to work with cutting-edge technologies
- Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
- Annual health check-ups
- Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Values-Driven, People-Centric & Inclusive Work Environment:
Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
- We support hybrid work and flexible hours to fit diverse lifestyles.
- Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
- If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment
Let's unleash your full potential at Persistent - persistent.com/careers
Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.
