GCP Cloud- Data Engineer

ABOUT TREDENCE

Tredence is a global analytics services and solutions company. We are one of the fastest growing private companies in the country for three straight years according to the Inc. 5000 and we continue to set ourselves apart from our competitors by attracting the greatest talent in the data analytics and data science space. Our capabilities range from Data Visualization, Data Management to Advanced analytics, Big Data and Machine Learning. Our uniqueness is in building Scalable Big Data Solutions on Onprem/GCP/Azure cloud in a very cost effective and easily scalable manner for our clients. We also come in with some strong IP and pre-built analytics solutions in data mining, BI and Big Data.

Job Description

In this rapidly evolving world, Tredence is always looking for new ways to disrupt the status quo, go to market faster, and optimize customer experiences. We are seeking an experienced product engineer to lead the charge on this mission. The ideal candidate will have thorough experience in executing ML and DS solutions and managing and collaborating with a team of data engineers, data scientists and software engineers. They will foster an environment of collaboration and creativity. Most importantly, they will be integral to helping us build better products that people [or businesses] love to use.

Job title : AWS Ingestion Developer- Data Services

Your Role:

Developing, testing and maintaining data ingestion pipelines and liaising with other system owners

Interact with business users to understand the requirements

Develop new data ingestion pipelines as well as to maintain/upgrade existing ones running in production and to ensure their smooth operations

Run and report on data quality metrics for early identification of anomalies and erroneous data pipeline executions

Build and support reusable data pipelines

Analyze source data and provide clarifications to the users as per need

Your Deliverables:

Data Extraction from multiple sources as per business requirements

Ensuring right data quality by proactively measuring the quality of ingested data

Build reusable frameworks for faster deployments

Your Qualities:

Inherent curiosity and empathy for customer success

Obsessive about solving customer problems

Think long and Act short

Collaborative with your peers, partners and your team.

Excited about the mission and milestones not titles and hierarchies

Nurture an environment of experimentation and learning

Your Expertise:

Good understanding of enterprise data warehousing principles and ETL/ELT solutions

Prior experience working on or with API's for data delivery/ingestion, e.g. REST APIs, GrapQL, etc.

Experience working on or with batch-based data delivery/ingestion paradigms, e.g. csv files, ODBC connections, etc.

Excellent experience on data management technologies and frameworks, preferably on Python, Airflow, AWS API Gateway, SNS, SQS, Lambda

Excellent understanding of prevailing SQL technologies such as Amazon Redshift, Postgres, MySQL, Microsoft SQL Server, etc. and ability to write complex queries to extract/inject data into those databases

Experience with Agile methodologies and tools, preferably using Jira/Confluence

Experience - 5 to 8 years

Job locations- Bangalore/Chennai/Pune/Gurgaon

Notice Period- 30 days/60 days/90 days

Visit our website for more details: https://www.tredence.com/