Data Engineer
- Posted a day ago
- Be among the first 10 applicants
Job Description
Data Engineer AWS+Python+Cloud Management + ETL
EXP : 8-10yrs
Location : Sydney & Banglore
The candidate should be at least below skillset- The resource we are looking for should have the these skillset
1. AWS Cloud Development experience
2. Atleast 3 years of Databases development experience. (Must have)
3. Understanding of Databases, Data warehousing concepts and Implementation experience. (Must have)
4. Experience working in Python or ETL Tool
5. Real time data ingestion experience.
More Info
Key Skills
Databases development
AWS Cloud Development
Real time data ingestion
About Company
Skills:
data engineering , Java, Devops, Sql, Python, Integration Engineering, Ai, CI/CD, ontologies, Knowledge Graphs
Skills:
snowflake , Data Modelling, Data Migration, Data Warehousing, Python, facts, Performance Optimization, Data Pipelines, Operational support frameworks, Dimensions, Medallion Architecture, Root-cause analysis, Metadata artifacts, CI CD processes, Data dictionaries, Reporting Datasets, STTM documents, Enterprise data products, Stored Procedures, RRDs, Reconciliation testing, Data quality governance, Data Validation
Skills:
Pytest, Apis, Pyspark, Amazon S3, AWS Glue, Json, Sql, Lambda, Git, Pandas, Xml, FastAPI, Python, Api Gateway, Amazon SageMaker Unified Studio, Airflow, Amazon Athena, Step Functions, EventBridge, OAuth 2.0, boto3, AWS data stack, CI/CD
Skills:
BigQuery, Pyspark, Apache Spark, Dataproc, Sql, ELT, Cloud Storage, Git, Gcp, DataFlow, Python, Etl, Airflow, cloud security best practices, CI CD, Pub Sub, Cloud Composer, data quality monitoring
Skills:
Java, BigQuery, Hadoop, Kafka, Hive, MLops, Spark, Databricks, Python, Kubernetes, Airflow, HDFS, Delta Lake, CI/CD