Gcp Engineer
Tekskills India Private LimitedThis job is no longer accepting applications
Job Description
Job description
JD:
1. Data Pipeline Development & Orchestration -Design, develop, and orchestrate data pipelines using Apache Airflow (Cloud Composer) to automate data ingestion, transformation, and loading (ETL/ELT) workflows.
2. Data Transformation with DBT -Implement DBT (Data Build Tool) models for transforming raw data into analytics-ready datasets in BigQuery, applying SQL-based transformations, modular modeling, and version control.
3. Stream & Batch Processing with Dataflow - Build real-time (Streaming) and batch data processing pipelines using Apache Beam on Dataflow, ensuring scalable and efficient data processing.
4. BigQuery Optimization & Performance Tuning - Design optimized BigQuery schemas, implement partitioning, clustering, and tune queries for cost-efficiency and performance.
5. Monitoring, Logging, and CI/CD for Data Pipelines - Set up monitoring with Stackdriver, logging, error handling, and CI/CD pipelines for automated testing and deployment of DBT, Airflow DAGs, and Dataflow jobs.
More Info
Key Skills
About Company
Tekskills is a leading IT company which offers cost effective and quality software solutions and consultancy services. Our service portfolio includes on site project management, IT Infra services, onsite consultancy, Off-shore IT & ITES services, product and application development. Tekskills is an ISO: 9001 certified company and CMM Level 3 certified company.
Tekskills headquarters in New Jersey along with the state of the art off-shore development center in Hyderabad, India. Having around 400+ consultants across US working with our premier partners like EMC2 Data domain and Cisco globally, our clientele includes some of the fortune 500 companies like Pfizer, Citi, JP Morgan Chase, NTT Data, YASH, Infosys, and AT&T, etc.
