L
AWS Data engineer
L
- Posted a day ago
- Be among the first 10 applicants
Job Description
Exp : 6yrs to 8yrs
AWS Data engineer
Job Description:
We are seeking a skilled Data Engineer to design, develop, and maintain scalable data solutions on AWS. The ideal candidate will have strong expertise in PySpark, Python, and AWS data services, with the ability to work independently and deliver high-quality data engineering solutions.
Responsibilities:
- Design, develop, and maintain scalable data pipelines using PySpark and Python.
- Build and deploy AWS-based data solutions using services such as S3, Lambda, SNS, and Step Functions.
- Process, transform, and optimize large-scale datasets for analytics and reporting.
- Develop efficient and reliable ETL/ELT workflows.
- Monitor and troubleshoot data pipelines to ensure performance and reliability.
- Work independently as an individual contributor to deliver data engineering initiatives.
- Follow best practices for data quality, governance, and metadata management.
Required Skills:
- PySpark
- Python (NumPy, Pandas, etc.)
- AWS Services (S3, Lambda, SNS, Step Functions)
- Data Pipeline Development & ETL
- SQL
More Info
Key Skills
About Company
Skills:
S3, Lambda, Pyspark, Sns, AWS, Delta Tables, Cloud Step Functions, MWAA Airflow
Skills:
AWS, Sql, Databricks, Python, Git, Data Modelling, Pyspark, Airflow, AWS Step Functions
Skills:
Data Modeling, Pyspark, Kafka, ELT, Lambda, Python, AWS, Spark SQL, Streaming, Emr, Redshift, Sql, Jenkins, Data Quality, Git, Cloudwatch, Iam, Aws S3, Etl, Spark Structured Streaming, Lakehouse Architecture, CI CD, Security, GitHub Actions, Step Functions, Data Lakes, Schema Registry, Governance, Kafka Connect, Glue, Real-Time Data Pipelines
Skills:
snowflake , Aws Services, Terraform, Pyspark, Python, Sql, dbt
Skills:
Data Engineer, AWS, AWS Glue, Etl, Pyspark, Airflow, Llm, Ai