We are looking forSr. AWS Cloud Architect
- Architect and Design: Develop scalable and efficient data solutions using AWS services such as AWS Glue, Amazon Redshift, S3, Kinesis(Apache Kafka), DynamoDB, Lambda, AWS Glue(Streaming ETL) and EMR
- Integration: Integrate real-time data from various Siemens organizations into our data lake, ensuring seamless data flow and processing.
- Data Lake Management: Design and manage a large-scale data lake using AWS services like S3, Glue, and Lake Formation.
- Data Transformation: Apply various data transformations to prepare data for analysis and reporting, ensuring data quality and consistency.
- Snowflake Integration: Implement and manage data pipelines to load data into Snowflake, utilizing Iceberg tables for optimal performance and flexibility.
- Performance Optimization: Optimize data processing pipelines for performance, scalability, and cost-efficiency.
- Security and Compliance: Ensure that all solutions adhere to security best practices and compliance requirements.
- Collaboration: Work closely with cross-functional teams, including data engineers, data scientists, and application developers, to deliver end-to-end solutions.
- Monitoring and Troubleshooting: Implement monitoring solutions to ensure the reliability and performance of data pipelines. Troubleshoot and resolve any issues that arise.
You'd describe yourself as:
- Experience: 8+ years of experience in data engineering or cloud solutioning, with a focus on AWS services.
- Technical Skills: Proficiency in AWS services such as AWS API, AWS Glue, Amazon Redshift, S3, Apache Kafka and Lake Formation. Experience with real-time data processing and streaming architectures.
- Big Data Querying Tools:Strong knowledge of big data querying tools (e.g., Hive, PySpark).
- Programming: Strong programming skills in languages such as Python, Java, or Scala
- for building and maintaining scalable systems.
- Problem-Solving: Excellent problem-solving skills and the ability to troubleshoot complex issues.
- Communication: Strong communication skills, with the ability to work effectively with both technical and non-technical stakeholders.
- Certifications: AWS certifications are a plus.
