Location: Pune / Indore / Bangalore / Noida
Job Title: Big Data Engineer
Job Description:
Key Technical Skills (Must-Have & Good-to-Have):
- 2-4 years of professional experience
- Expertise and hands-on experience with Python Must Have
- In-depth knowledge of SparkQL / Spark DataFrame Must Have
- Strong understanding of SQL Good to Have
- Experience with Shell scripting Good to Have
- Knowledge of workflow engines such as Oozie, Autosys Good to Have
- Familiarity with Agile development methodologies Good to Have
- Understanding of Cloud technologies Good to Have
- Passion for exploring new technologies Good to Have
- Approach to Automation Good to Have
Roles & Responsibilities:
The selected candidate will be responsible for Data Warehouse modernization projects, including:
- Developing programs/scripts using Python/Java combined with SparkSQL/Spark DataFrame or Python/Java + Cloud-native SQL (e.g., RedshiftSQL, SnowSQL).
- Script validation and ensuring optimal performance.
- Performance tuning of data processes.
- Data ingestion from source to target platforms.
- Job orchestration.
Experience Required: 2 to 4 years
Education/Qualification: BE / B.Tech / MCA / M.Tech / M.Com
