
Search by job, company or skills
Role Overview:
The Data Engineer will focus on developing, maintaining, and optimizing data pipelines. You will work on BigQuery, and Incorta,
ensuring efficient data ingestion, transformation, and governance while integrating AI-driven automation.
Key Responsibilities:
· Build and optimize data pipelines for ingestion, transformation, and storage using BigQuery, SQL Managed Services, and Incorta.
· Implement AI-driven automation for data pipeline monitoring, performance tuning, and anomaly detection.
· Ensure data governance, security, and compliance standards are met across all platforms.
· Optimize data workflows for cost efficiency and scalability.
. Must be comfortable with rotational shifts
· Collaborate with BI, AI, and application teams for seamless data access and analytics.
· Integrate data from multiple sources including Salesforce, Oracle AMS, and other enterprise applications.
Required Skills:
Primary: BigQuery, ETL Development, SQL Managed Services, Incorta
Secondary: Data Pipeline Optimization, Cost Optimization, Pipeline Maintenance .
Job ID: 116696885
Skills:
composer , Apache Airflow, Cloud Storage, BigQuery, Pyspark, DataFlow, Sql, ETL processes
Skills:
BigQuery, Scala, DataFlow, Python, Sql
Skills:
BigQuery, Hadoop, Pyspark, Spring Boot, Dataproc, Sql, Mapreduce, Java 8, Cloud Storage, Hive, Core Java, Spark, DataFlow, Pub Sub, GCS
Skills:
BigQuery, Hadoop, Pyspark, Spring Boot, Dataproc, Sql, Mapreduce, Java 8, Cloud Storage, Hive, Core Java, Spark, DataFlow, Pub Sub, GCS
Skills:
BigQuery, Hadoop, Pyspark, Spring Boot, Dataproc, Sql, Mapreduce, Java 8, Cloud Storage, Hive, Core Java, Spark, DataFlow, Pub Sub, GCS
We don’t charge any money for job offers