Equal Opportunity Employer
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, or disability status. EEO/Disabled/Vets
Job Description :
About The Role
We are looking for a Senior Data Engineer
with experience in excellent analytical
abilities in GCP BigQuery, ETL/BI, Python,
Composer/Airflow, SQL, GCP Services -
with the ability to operate in an agile
environment and keen to detail while
understanding the larger data warehouse.
Skills & Competencies
A minimum of 4.5+ years of
working experience as a hands-on
data engineering is a must
Advanced Degree in the field of
Computer Science, Data
Engineering, Data Analytics or
equivalent discipline
Strong programming experience
with Python, SQL, ETL and
efficiently querying big datasets
using SQL
Prior experience with CircleCI
CI/CD, Terraform and Github
version control is a must
Solid understanding of Data
Collection, Data Ingestion, Data
Integration, and Data Operations
& Maintenance
Implement data governance
practices, including data quality,
security, and compliance, in line
with organizational standards.
Domain knowledge on News,
Media & Communications is an
added advantage
R E S P O N S I B I L I T I E S
Design, build, and maintain scalable
ETL/ELT pipelines in Google Cloud, using
tools like Cloud Composer (Airflow), and
BigQuery.
Collaborate with cross-functional teams to
define data architecture and data
warehouse requirements
Automate data pipelines, ETL/ELT
processes, and data integration workflows
using infrastructure-as-code (IaC) and
configuration management tools
Deep understanding of BigQuery,
including SQL, optimization techniques,
partitioning, clustering, and performance
tuning.
Deliver production quality, modular,
reproducible code in Python, SQL
Implement continuous integration and
continuous deployment (CI/CD) pipelines
for data pipelines and data-related
applications
Keep abreast of the latest developments
in the field through continuous learning
and proactively champion promising new
methods relevant to the problems at hand.
Our Tech Stack
- Google Cloud Platform is IaaS
- BigQuery, GCS, Python, SQL
- Composer / Airflow - orchestration
tools
- Terraform, CircleCI, CI/CD, GIthub,
Jira, Confluence
This job is posted with NTS Technology Services Pvt. Ltd.
Job Category:
