Databricks Engineer
Databricks Engineer
Numeric TechnologiesThis job is no longer accepting applications
Job Description
Job Title: Databricks Developer
Location: Remote (India)
Shift: Night Shift – 10:00 PM IST to 6:00 AM IST
Experience: 8-10 Years ( Min 5 Years in Databricks)
Job Summary
We are seeking an experienced Databricks Developer with 5–8 years of experience in data engineering and cloud-based analytics. The ideal candidate should have strong expertise in Databricks, PySpark, Python, SQL, and ETL development, with the ability to build, optimize, and maintain scalable data pipelines.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Databricks and PySpark.
- Build and optimize ETL/ELT workflows for large-scale data processing.
- Develop and manage Delta Lake tables and implement best practices for data engineering.
- Optimize Spark jobs for performance, scalability, and cost efficiency.
- Collaborate with data architects, analysts, and business stakeholders to deliver high-quality data solutions.
- Troubleshoot production issues and provide ongoing support.
- Participate in code reviews and follow Agile development practices.
Required Skills
- 5–8 years of experience in Data Engineering.
- Strong hands-on experience with Databricks, PySpark, Python, and SQL.
- Experience with Delta Lake and Spark performance tuning.
- Knowledge of Azure Databricks, AWS, or GCP.
- Experience with Git and CI/CD practices.
- Strong analytical, debugging, and problem-solving skills.
Preferred Qualifications
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Databricks certification is an added advantage.
- Experience with Azure Data Factory, Kafka, Airflow, or Snowflake is a plus.
More Info
Key Skills
About Company
Skills:
data warehouses , Spark SQL, Azure Synapse, Azure Data Factory, Apis, Pyspark, Databricks, Sql, Etl, ELT, Git, Data lakes, Z-ordering, Liquid clustering, Bucketing, Medallion Architecture, Batch Processing, Data partitioning, CI/CD pipelines, Azure data services, Streaming Data, Indexing
Skills:
Pyspark, Sql, ELT, Databricks, Azure, Python, AWS, Etl, Spark performance tuning, DLT, Auto Loader, Delta Live Tables, Unity Catalog, Lakeflow, Optimization, Delta Lake, Structured Streaming, Lakehouse architecture, Databricks Workflows
Skills:
cloud security, Pyspark, Apache Spark, Kafka, Azure Databricks, Data Modeling, Sql, Git, Azure Data Factory, Python, Azure DevOps, Spark Structured Streaming, Azure Data Lake Storage ADLS Gen2, Event Hub, GitHub Actions, rbac, CI CD pipelines, Delta Lake
Skills:
Spark SQL, Pyspark, Version Control, Databricks, Azure, Python, Sql, AWS, Delta Lake, Unity Catalog
Skills:
Medallion Architecture (Bronze, Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), Gold), Data Modeling, Pyspark, Kafka, Data Warehouse, Azure Synapse Analytics, Microsoft Azure, Data Governance, Spark SQL, Views, SQL Server, Stored Procedure, Data Warehousing Concepts, SSIS, Triggers, Sql, Devops, Git, Databricks, Essbase, Data Quality Frameworks, Spark Structured Streaming, Infrastructure as Code, Event Hub, Performance Tuning and Optimization, silver, Delta Lake, CI/CD