Job Description
- MUST have expereince in Talend, DBT, Snowflake and AWS
- 6-9 years of experience in Data Engineering (for Sr. Associate, 4-6 for Associate)
- Creation and maintenance of optimum data pipeline architecture for ingestion, processing of data
- Creation of necessary infrastructure for ETL jobs from a wide range of data sources
- Collecting data requirements, maintaining metadata about data
- Experience with stream-processing systems
- Experience in Data storage technologies like Amazon S3, SQL, NoSQL, Snowflake
- Data modeling technical awareness
- Conduct research and identify automation tasks
- Hands on experience using Talend, Kafka/MSK/RabitMQ
- Sound experience developing ETL pipeline using DBT
- Integration using Talend/Talend API.
- Knowledge on Cloud computing services such as AWS
Good to have - AWS data services development experience.
- Working knowledge on using Bigdata technologies.
- Good to have in building Data pipeline using AWS data pipeline service as well as database service
- Working experience Collabra.
- Experience in collaborating data quality and data governance team.
- Exposure to reporting tools like Tableau
- Apache Airflow, Apache Kafka (nice to have)
- Payments domain knowledge
- CRM, Accounting, etc. in depth understanding
- Regulatory reporting exposure
Other skills - Good Communication skills
- Team Player
- Problem solver
- Willing to learn new technologies, share your ideas and assist other team members as needed
- Strong analytical and problem-solving skills; ability to define problems, collect data, establish facts, and draw conclusions.
Job Responsibilities: - Build and maintain data pipelines adhering to suggested enterprise architecture principles and guidelines
- Collection and management of data, converting it into useful information
- Generating data validation processes and analytical tools
- Design, build, test, and maintain data management systems
- Work in sync with internal and external team members like data architects, data scientists, data analysts to handle all sorts of technical issue
- Act as technical leader within the team
- Working in Agile/Lean model
- Deliver quality deliverables on time
- Translating complex functional requirements into technical solutions.
