Job Description
Experience:4+ Years
Role: Data Engineer
Location: Bengaluru & Kolkata
Employment Type: Full-Time / Permanent
Work Mode: Onsite/ Hybrid
Job Description:
We are looking for an experienced Data Engineer with strong expertise in Databricks, Python, SQL, and PySpark to design, develop, and optimize large-scale data processing solutions. The ideal candidate will have hands-on experience working in modern data platforms and building efficient data pipelines. Experience with Qlik or any BI tool is an added advantage.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.
- Work with structured and unstructured data across multiple data sources.
- Optimize data processing for performance, reliability, and scalability.
- Write efficient SQL queries for data extraction, transformation, and reporting.
- Collaborate with Data Scientists, Analysts, and Business Teams to deliver reliable datasets.
- Implement data quality checks, validations, and automation.
- Ensure best practices in coding, security, and data governance.
- Support performance tuning and troubleshooting of data workflows.
- Build reusable frameworks and components for data processing.
Required Skills & Experience:
- 57 years of professional experience as a Data Engineer
- Strong hands-on experience in Databricks (Data Engineering)
- Proficiency in Python & PySpark
- Strong expertise in SQL and database concepts
- Experience working in cloud or big-data environments
- Good understanding of ETL concepts and data warehouse design
- Experience with version control tools (Git, etc.)
Good to Have:
- Experience with Qlik or any BI/Data Visualization tool
- Exposure to Azure / AWS / GCP data platforms
- Experience with CI/CD & data automation workflows
