Data Engineer
Search Jobs
Search by job, company or skills
Search by job, company or skills
Experience: 5 to 12 Years
Location: Noida, Gurgaon, Bangalore
Notice Period: Immediate to Mid-August joiners
Skills
Mandatory Skills: GCP BigQuery, GCP Dataform, GCP Cloud SQL
JD
Extensive hands on experience in object-oriented programming using Python PySpark APIs
Experience in building data pipelines for huge volume of data
Deep understanding of ETL concepts data warehousing principles SQL
Hands on experience in writing basic to advance level of optimized queries using SQL BigQuery
Hands on experience in developing solutions using Dataflow Dataproc and BigQuery
Good experience in SQL Queries
Understanding of databases data flows and data architecture
Experience on Python and GCP platform
Willingness to Collaborate with Cross Functional teams to drive validation and Project Execution
Review and evaluate policies and procedures
To develop implement monitor and manage the compliance needs as per the AEMP70 policy
Good to have
Familiarity with CICD pipelines eg Jenkins Github Actions
Job ID: 151539219
Skills:
Power Bi, Power Query, Azure Sql, Sql, ELT, Azure Data Factory, Azure Data Lake, Dax, Python, Etl, Synapse, Microsoft Fabric
Skills:
Unix, BigQuery, PostgreSQL, Apache Spark, ELT, Apache Airflow, Cloud Storage, Git, Docker, Linux, MySQL, MongoDB, DataFlow, Kubernetes, Python, Etl, Cloud Pub Sub, GCP services
Skills:
Azure Synapse Analytics, Pyspark, Scala, Azure Databricks, Microsoft Azure, Sparksql, Azure Time Series Insights, Azure HDInsight, Azure Stream Analytics, Azure Analysis Services, Azure Data Explorer
Skills:
Sql, Git, Python, NoSQL document databases Firestore DB, Chunking and embedding techniques for LLM RAG workflows, Google BigQuery, Cloud Composer Apache Airflow pipeline orchestration, Gen AI development using OpenAI APIs, Docker containerization, Google Cloud Storage, PostgreSQL including pgvector for vector search, Google Cloud Platform hands-on
Skills:
BigQuery, Hive, Pyspark, Spark, Dataproc, DataFlow, Mapreduce, GCS
