Role: Data Engineer
Skill : Data Engineering, Bigquery,ETL Pipelines
Experience: 7 to 12 years
Job Description:
Key Responsibilities
- Design, develop, and optimize data pipelines using Google BigQuery
- Execute and support Teradata to BigQuery migration projects
- Develop and manage data ingestion using BigQuery Data Transfer Service (BQ DTS)
- Build and maintain ETL/ELT pipelines using Python
- Automate workflows using Cloud Composer (Apache Airflow)
- Deploy scalable data processing services using Cloud Run
- Manage data storage in Google Cloud Storage (GCS)
- Ensure data quality, governance, and performance tuning
- Collaborate with cross-functional teams
- Monitor and troubleshoot data workflows
Required Skills
- Strong experience with Google BigQuery
- Hands-on with BigQuery Data Transfer Service (BQ DTS)
- Experience in Teradata to BigQuery migration
- Proficiency in Python
- Experience with Cloud Composer (Airflow)
- Knowledge of Cloud Run
- Experience with Google Cloud Storage (GCS)
- Strong SQL skills
- Experience in automation
Good to Have
- CI/CD pipelines in GCP
- Knowledge of Dataflow / Pub-Sub
- Terraform or Infrastructure as Code
- Data modeling and warehousing concepts
Educational Qualification
Bachelors/Masters degree in Computer Science, IT, or related field
Key Competencies
- Problem-solving skills
- Ability to work in fast-paced environments
Good communication skills
