
Search by job, company or skills
AB-NPC1-L91969
| BIU:Data Engineer | |||||
| INTERNAL USAGE: | |||||
| No. of Vacancies: | 1 | Reports to: | |||
| Is a Team leader | Team Size: | 8-15 | |||
| Grade: | M/DM | ||||
| Business: | BIU | Department: | BIU | Sub-Department: | BIU |
| Location: | Mumbai/Bangalore | ||||
| About BIU | |||||
| Axis Banks (BIU): This is a high profile team with a mandate to drive data based decisions within the bank. Reporting in to Head Banking Operations and Transformation, this department works with all businesses of the bank including retail, small business and corporate to drive analytics. In terms of functions, the department has teams focused on all aspects of analytics for the bank including risk analytics, financial crime analytics, business and marketing analytics, building predictive scores, data engineering and business reporting. | |||||
| AbouttheRole | |||||
We are looking for a Data Engineer with 2 years of hands-on experience in PySpark-based pipeline development and data engineering on distributed platforms. The role involves building scalable data workflows, optimizing performance, and ensuring data quality for analytical and operational use cases. | |||||
| Key Responsibilities | |||||
. Develop and optimize ETL pipelines using PySpark on distributed compute engines. . Work with large datasets across Hadoop/Spark ecosystems (HDFS, Hive, Yarn). . Implement data quality checks, validation logic, and reusable framework components. . Perform data modeling for fact/dimension tables and analytical datasets. . Debug production issues, tune Spark jobs, and handle performance bottlenecks. . Collaborate with cross-functional teams to understand requirements and deliver reliable datasets. . Maintain documentation, version control, and adhere to coding best practices. | |||||
| Qualifications | |||||
B.Tech, B.E., or equivalent | |||||
| Role Proficiencies: | |||||
. Strong proficiency in PySpark, DataFrames, Spark SQL, and performance tuning basics. . Strong SQL skills and understanding of data warehousing concepts. . Strong analytical, debugging, and problem-solving skills. . Knowledge in Informatica PowerCenter/IICS is a plus. . Effective communication and collaboration skills. |
Job ID: 142945969