Python Data Engineer
Python Data Engineer
digitrix software llp- Posted 12 days ago
- Be among the first 10 applicants
Job Description
We are looking for an experienced Python Data Engineer to join our team on a remote contract opportunity.
Role: Python Data Engineer
Experience: 6+ Years
Work Mode: Remote
Engagement: 3PT Contract
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
- Build data engineering solutions using Python.
- Work with AWS cloud services for data processing, storage, and deployment.
- Develop and optimize data workflows to ensure performance and reliability.
- Write and optimize SQL queries for data processing and analysis.
- Collaborate with cross-functional teams to deliver high-quality data solutions.
Must-Have Skills
- 6+ years of experience in Data Engineering.
- Strong hands-on experience with Python.
- Strong experience with AWS and cloud-based data solutions.
- Good knowledge of ETL/ELT and data pipeline development.
- Strong SQL and database concepts.
- Experience working in cloud-based data engineering environments.
Good to Have
- Experience with AWS data services such as S3, Lambda, Glue, Redshift, EMR, etc.
- Knowledge of data warehousing and cloud-native architectures.
- Experience with distributed data processing frameworks.
More Info
Key Skills
Cloud-native architectures
Distributed data processing frameworks
Data pipeline development
Cloud-based data engineering environments
About Company
Skills:
Data Modeling, Advanced Analytics, Flask, Python, Redis, Data Integration, AWS
Skills:
Gitlab, Sql, Version Control Systems, Gcp, Restful Services, Azure DevOps, Bitbucket, Github, AWS, Python, Azure, Jenkins, search indexing log analytics engines, GitLab CI, container orchestration platforms, workflow orchestration scheduling platforms, modern Python API frameworks, distributed data processing frameworks, CI CD platforms, GitHub Actions, Azure Repos, big data distributed systems technologies, streaming messaging platforms, structured unstructured data, cloud data platforms
Skills:
snowflake , Sql, MySQL, Hive, Python, Data Lake, Scala, Agile Methodologies, Spark, Streaming data processing, Data Lifecycle Management, Delta Lake
Skills:
Apache Airflow, Sql, Etl, S3, ELT, Python, Kubernetes, Docker, Rest Apis, Spark
Skills:
.NET, Nosql, C#, React, SQL Server, Flutter, Rest Apis, Azure, AWS