AWS Data Engineer
- Posted 12 days ago
- Over 400 applicants have applied
Job Description
- Design, develop, and maintain ETL/ELT data pipelines to ingest data from various sources, including databases and flat files, into our data warehouse.
- Utilize AWS services such as AWS Lambda, AWS DMS, and AWS Glue for data ingestion and transformation processes.
- Develop and optimize Snowflake stored procedures to implement complex business logic and data transformations.
- Manage and monitor scheduled data workflows using Apache Airflow.
- Work closely with stakeholders to understand project requirements and translate them into technical solutions, ensuring seamless integration with existing data pipelines.
- Implement and maintain robust data quality checks to ensure accuracy and reliability of all delivered datasets and reports.
- Adhere to the full project delivery lifecycle, including requirements gathering, design, implementation, documentation, and obtaining user acceptance testing (UAT) approvals.
- Deliver data sets to other AWS accounts and support the creation of Power BI reports.
More Info
About Company
ValueLabs is a global technology company providing consulting, technology, and outsourcing services. Established in 1997, we focus on digital solutions that drive innovation and long-term partnerships. With over 7,000 employees in 30+ locations, we specialize in Product Development, Data Technology, DevOps, Cloud Computing, and Digital Transformation. Our emphasis on quality and client-centricity ensures exceptional customer experiences and business outcomes. We deliver scalable, cutting-edge solutions, helping businesses thrive in the digital age through collaboration and technology-driven excellence.
Skills:
Amazon Web Services (AWS), Python, Apache Spark, Amazon Redshift, Data Warehousing, AWS Data Engineering, Big Data Processing, Enterprise Data Warehouse
Skills:
Spark SQL, Git, Pyspark, Apache Spark, Python, Sql, Etl, ELT, DataFrames
Skills:
Python Scripting, Sql, AWS Core Services S3 Lambda IAM, Query Database Performance Tuning, ETL Integrations Data Transformations
Skills:
Aws Redshift, Sql, cloud computing concepts, ETL ELT processes, AWS ecosystem, data modeling and schema design, data warehousing concepts and best practices
Skills:
Spark, Performance Tuning, Pyspark, Data Modeling, Sql, Python, Airflow, AWS Step Functions, Amazon S3 Data Lake, Amazon Redshift Athena, AWS data services, Optimization, AWS Glue ETL ELT Catalog Crawlers, Lambda EMR