Data Engineer
- Posted 3 months ago
- Over 500 applicants have applied
Job Description
Total Experience:1+ years
Job Summary:
- We are looking for skilled Data Engineer(s) with strong expertise in Azure Data Factory to support
- ETL/ELT pipeline development, data integration, and transformation across cloud-based environments.
- Minimum Requirements:
- 1+ years of experience in data engineering roles.
- Strong hands-on experience with Azure Data Factory (ADF), including pipeline creation, triggers,
- and parameterized datasets.
- Proficiency in SQL for data extraction, transformation, and loading.
- Experience working with Azure Blob Storage, Azure SQL, and Synapse Analytics.
- Familiarity with source control tools such as Git and CI/CD pipelines for ADF.
- Strong debugging and troubleshooting skills.
- Ability to work independently with minimal supervision.
Nice to Have:
- Knowledge of Data Lake, Delta Lake, or Spark-based architecture.
- Familiarity with other Azure services like Logic Apps, Functions, or Event Grid.
- Python or PySpark experience for data transformation.
More Info
Job Type:
Industry:
Function:
Employment Type:
Key Skills
About Company
Skills:
Pyspark, AWS Glue, Data Modeling, Emr, Avro, Autosys, Sql, Cloudwatch, Terraform, Etl Tools, Databricks, Python, AWS, Airflow, Parquet, AWS Lake Formation, Iceberg
Skills:
snowflake , Data Warehousing, Kafka, Automated Testing, ELT, Docker, Python, Azure DevOps, AWS, Data Modelling, Sql, Devops, Data Quality, Git, Databricks, Kubernetes, Etl, data lakes, Security, MDM, Event Hubs, metadata lineage, production reliability, GitHub Enterprise, DataOps, dbt, CI CD pipelines
Skills:
Power Bi, Pyspark, Agile Scrum, Tableau, Databases, Git, Data Warehousing, Informatica Powercenter, Python, Airflow, Data Lake concepts, Advanced SQL and performance tuning, IICS, dbt, CI/CD
Skills:
Sql, Databricks, AWS IAM, Aws Redshift, AWS Glue, Aws S3, Aws Lambda, Pyspark, Python, AWS CodePipeline, Jenkins, AWS CloudWatch, GitHub Actions, Kinesis Analytics, Spark Performance Tuning, Kinesis Firehose, Amazon Kafka, Delta Lake, Amazon Kinesis Data Streams, AWS Lake Formation, Structured Streaming
Skills:
Gcp, Pyspark, Azure, Python, Sql, AWS