Data Engineer
- Posted 2 months ago
- Be among the first 20 applicants
Job Description
Location - Pune
Full time Employee
- Experience: 7+ years in data engineering or a related field.
- ETL Expertise: Proficiency with any standard ETL platform.
- SQL & Data Warehousing: Strong command of SQL for extraction and transformation, along with extensive experience in data warehousing.
- GCP Skills: Hands-on experience with Google Cloud Platform services, including BigQuery, Dataflow, and Cloud Storage.
- Scripting: Proficiency in Python and Shell scripting for automation and custom solutions.
- Data Management: Experience handling large-scale datasets and performance optimization.
- Soft Skills: Strong analytical and problem-solving abilities.
- Leadership: Prior experience leading technical teams and managing project delivery is required.
More Info
Key Skills
About Company
Skills:
Sql, Google Cloud, ELT, Apache Airflow, Nosql, Jenkins, Git, Docker, Azure, Python, AWS, Etl
Skills:
PostgreSQL, Apache Spark, Kafka, Apache Airflow, Pandas, Elasticsearch, Python, Polars, Batch and real-time data pipelines, NoSQL databases, Scalable backend systems, OpenSearch, Data models and storage architectures, Distributed data systems, Data processing performance and optimisation, Data pipelines, Machine learning data pipelines, Vector search retrieval
Skills:
Apache Airflow, Pyspark, Spark, Databricks, Azure, Python, Sql, Fabric, ETL pipelines
Skills:
snowflake , Azure Databricks, Sql, ELT, Devops, Azure Data Factory, Azure Synapse Analytics, Spark, Python, Etl, Infrastructure as Code, Generative AI, CI CD
Skills:
Sql Performance Tuning, Azure Data Factory, Power Bi, Pyspark, Apache Spark, Azure Databricks, Data Governance Unity Catalog, Microsoft DP-203 certification, CI CD for ADF Databricks, Azure Data Lake Gen2