Senior Data Engineer
Search Jobs
Search by job, company or skills
Search by job, company or skills
Experience- 6+years
Work Mode- All 5 days WFO
Budget- Best in industry
Location- Bengaluru/ Hyderabad
Job Description
AWS Glue, Amazon EMR, Amazon Redshift,Pyspark,Python,SQL
Cloud and AWS Expertise:
In-depth knowledge of AWS services related to data engineering: EC2, S3, RDS, DynamoDB, Redshift, Glue, Lambda, Step Functions, Kinesis, Iceberg,EMR, and Athena.
Strong understanding of cloud architecture and best practices for high availability and fault tolerance.
Data Engineering Concepts:
Expertise in ETL/ELT processes, data modeling, and data warehousing.
Knowledge of data lakes, data warehouses, and big data processing frameworks like Apache Hadoop and Spark.
Proficiency in handling structured and unstructured data.
Programming and Scripting:
Proficiency in Python, Pyspark and SQLfor data manipulation and pipeline development.
Expertise in working with data warehousing solutions like Redshift.
Job ID: 153640053
Skills:
Pyspark, Dimensional Modeling, Jira, Sql, Git, Confluence, Gcp, Azure, Python, Azure DevOps, AWS, Etl, cdc, Medallion Architecture, SAP HANA to Snowflake migration, Snowflake Architecture, dbt, ELT Development, SCD Type 1
Skills:
Metadata Management, Databricks, Python, Data lineage techniques, Master data management, Data modeling methodologies, Big Data storage architecture
Skills:
snowflake , Data Modeling, Pyspark, PostgreSQL, Data Warehouse, ELT, Oracle, Python, Azure DevOps, Spark SQL, SQL Server, Apache Spark, Sql, Git, Azure Data Factory, Data Lake, Databricks, Etl, Medallion Architecture, CI CD, Lakehouse, Azure Data Engineering, Delta Lake, Microsoft Fabric
Skills:
Postgres Sql, Debugging, Pyspark, Data Modeling, Data Warehousing, Sql, Data Analysis, Azure cloud ecosystem, Performance optimization, Enterprise data flows, ETL pipelines
Skills:
Hadoop, Pyspark, Kafka, Presto, Spark, Python, AI tools, Pinot, pgvector, Codex, vector databases, Claude, Pinecone, Flink, cloud data warehouses, Hudi, Milvus, Weaviate
