Aws Data Engineer
- Posted a month ago
- Over 100 applicants have applied
Job Description
- Proficiency in Python,PySpark architecture, complex SQL, and RDBMS.
- Hands-on experience with ETL tools (e.g., Informatica) and SCD1, SCD2. 2-6 years of DWH, AWS Services and ETL design knowledge
- Hand on experience using AWS services like Glue (Pyspark), Lambda, S3, Athena, experience on implementing different loading strategies like SCD1 and SCD2, Table/ partition refresh, insert update, Swap Partitions
Role: Data Engineer
Industry Type: IT Services & Consulting
Department: Engineering - Software & QA
Employment Type: Full Time, Permanent
Role Category: Software Development
Education
UG: Any Graduate
More Info
Job Type:
Industry:
Function:
Employment Type:
About Company
Innova Solutions is a trusted global technology partner specializing in transformative digital solutions. Innova's robust technology and talent offerings span across an array of industries and include generative AI, data & analytics, cloud computing, digital product engineering, and cybersecurity. Through offices and global delivery centers across North America, Europe, and APAC, our Innovators deliver strategic technology and business transformation solutions to clients enabling them to operate as leaders within their fields.
Skills:
Pyspark, Python Scripting, S3, Lambda, Database Technologies, Iam, Sqs, Sns, Big Data, AWS EMR, Spark UI Optimization
Skills:
Github, Apache Spark, AWS Glue, Amazon Redshift, Data Lake, Data Warehousing, Python, Etl, Apache Iceberg, Amazon Athena, JSON processing, API integrations
Skills:
snowflake , Python, Sql, AWS, Etl
Skills:
snowflake , Kafka, Sql, Kinesis, Terraform, Docker, ECS, Kubernetes, Python, Airflow, Airbyte, AWS core services, EKS, dbt
Skills:
Sql, Aws S3, Lambda, Api Gateway, Kafka, Linux, Python, Redshift, Crawler, AWS Cloud platform, Athena, Dynamic DB, Glue