Job Description
As a Data Engineer,you will be responsible for designing, developing, and maintaining our data pipelines, databases, and systems. You will work closely with cross-functional teams to ensure efficient data flow and support data-driven decision-making across the organization.
Your Main Responsibilities Will Include
Designing and implementing scalable, reliable, and efficient data pipelines and ETL processes to collect, process, and store large volumes of structured and unstructured data from various sources.
Collaborating with data scientists, analysts, and other stakeholders to understand data requirements and ensure data quality, integrity, and availability.
Building and optimizing data warehouses, data lakes, and other storage solutions to support analytics, reporting, and machine learning initiatives.
Developing and maintaining data infrastructure and tools, automating processes, and implementing best practices for data management, governance, and security.
Troubleshooting issues, identifying bottlenecks, and optimizing performance of data systems to meet business needs and performance goals.
Responsibilities:-
Manage the end-to-end implementation of the Data Warehouse/Datalake project, ensuring adherence to timelines, and quality standards.
Working closely with the development team to design and implement appropriate data models, ETL processes, and reporting solutions.
Requirements:-
Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
Proven experience (5+ yrs and max 12-to-20 years) working as a Data Engineer or similar role, handling large-scale data infrastructure and ETL processes.
Proficiency in programming languages such as Python, Java, or SQL for data processing and manipulation.
Strong knowledge of database technologies (SQL, Redshift) data warehousing concepts, and big data tools/frameworks (PySpark, Kafka, etc.).
Excellent communication and interpersonal skills with the ability to convey technical concepts to non-technical stakeholders.
Experience with cloud platforms like AWS or Google Cloud and their data services (S3, Redshift, , etc.).
Candidate is form BFSI industry is a plus.
