Azure Data Engineer
Azure Data Engineer
Fragma Data SystemsThis job is no longer accepting applications
Job Description
Must-Have Skills
- Good experience in Pyspark - Including Dataframe core functions and Spark SQL
- Good experience in SQL DBs - Be able to write queries including fair complexity.
- Should have excellent experience in Big Data programming for data transformation and aggregations
- Good at ELT architecture. Business rules processing and data extraction from Data Lake into data streams for business consumption.
- Good customer communication.
- Good Analytical skill
- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub.
- Experience in migrating on-premise data warehouses to data platforms on AZURE cloud.
- Designing and implementing data engineering, ingestion, and transformation functions
- Azure Synapse or Azure SQL data warehouse
- Spark on Azure is available in HD insights and data bricks
- Experience with Azure Analysis Services
- Experience in Power BI
- Experience with third-party solutions like Attunity/Stream sets, Informatica
- Experience with PreSales activities (Responding to RFPs, Executing Quick POCs)
- Capacity Planning and Performance Tuning on Azure Stack and Spark.
More Info
Key Skills
ELT architecture
Big Data programming
Azure Blob Storage
Spark HDInsights
EventHub
Azure Analysis Services
IOTHub
Azure SQL DWH
CosmosDB
Stream sets
Attunity
About Company
Skills:
MS-SQL, Python, data engineering best practices, data models, logical and physical data warehouse design
Skills:
Azure Data Factory, Python, Sql, Power Bi, Data Integration, SQL Server, Azure Data Lake, Data Modeling, Business Intelligence systems, ETL pipelines, Data ingestion, Event processing, Workflow orchestration, Real-time processing
Skills:
Azure Logic Apps, Azure SQL Database SQL Server, ETL ELT, CI CD, Azure Data Factory ADF, Azure Storage ADLS Gen2
Skills:
Pyspark, Adf, Spark, Azure Databricks, Data Engineer, Azure, Synapse, ADLS, Data Bricks
Skills:
Azure Databricks, Apache Airflow, Azure Data Factory, Azure Synapse Analytics, Apache Kafka, Cosmos DB, Azure Functions with Python, Azure Purview, Event Hub, Synapse Analytics with Spark, Spark Scala, dbt, SQL Azure functions with Python, SQL DW, ADLS2 Blob Storage, Spark Python