Data Engineer
Job Description
Databricks Data Engineer
Locations: Hyderabad | Bengaluru | Pune
We are looking for an experienced to design, develop, and optimize scalable data pipelines and data processing solutions on Azure.
Key Responsibilities
- Design and develop scalable data pipelines using Azure Databricks.
- Build ETL/ELT workflows using PySpark and Spark.
- Develop and optimize complex SQL queries.
- Perform data transformation, cleansing, and integration from multiple sources.
- Work with Azure data services and Databricks to support analytics solutions.
- Monitor and troubleshoot data pipelines for performance and reliability.
- Collaborate with data architects, analysts, and business stakeholders.
Must-Have Skills
- Azure
- Databricks
- Python
- PySpark
- Apache Spark
- SQL
- Data Engineering / ETL
More Info
Key Skills
About Company
Skills:
Cloud Computing, Cloud security, Data Modeling, Data Warehousing, Compliance, Scalability optimization, Access controls, Caching, Snowflake platforms, Data partitioning, ETL processes, Data encryption, Data engineering principles
Skills:
Azure Data Factory, Power Bi, Pyspark, Azure Databricks, Dax, Sql, Python
Skills:
Azure Cosmos DB, FastAPI, MongoDB, Microsoft Databricks, Azure API Management
Skills:
snowflake , kimball methodologies , Github, Sql, Dimensional Modeling, Python, Airflow, Data Vault concepts, Medallion Architecture, dbt, Data modeling concepts, Fivetran
Skills:
Apache Spark, Apache Airflow, Azure Synapse, Databricks, Kubernetes, Unix Shell Scripting, Couchbase NoSQL databases, ETL development and orchestration, Advanced SQL development and performance tuning, Apache Druid, Data migration to cloud platforms, Stambia, Python for ETL orchestration and automation, Data Platform Management, Agile delivery methodologies, Big Data Engineering, JSON API-based integrations