Senior Data Engineer
Senior Data Engineer
Miba GroupThis job is no longer accepting applications
Job Description
Ihre Aufgaben
Must Have
Soft Skills
Must Have
- Proven hands-on experience designing, building, and maintaining data solutions using Databricks and Azure Data Factory.
- Experience in gathering and translating business requirements into effective technical solutions.
- Strong background in building and optimizing ETL (Extraction, Transformation, Loading) processes using Azure Databricks and SQL technologies
- Experience in designing and maintaining data architectures and data models that support business intelligence and analytics
- Ability to implement processes and systems to monitor and ensure data quality, accuracy, and availability
- Demonstrated ability to work with analytics, business, product, and executive teams to improve data models and resolve technical issues.
- Experience delivering and operating data platforms throughout their lifecycle (Development + Operations)
- Capable of providing technical leadership regarding implementation (How) and supporting shared product delivery responsibility
- Excellent verbal and written communication skills for cross-functional collaboration
- Experience designing and evaluating tools for data lineage, metadata management, and data quality
- Exposure to DevOps practices in data platform delivery and operations
- Experience working with business units to develop long-term strategies for data platform architecture
- Proactive in identifying and implementing improvements to data architecture and processes
- Familiarity with BI tools and improving data accessibility for data-driven decision making
- Experience supporting teams and IT/D products in data modelling and analysis
Soft Skills
- Assuming personal responsibility & demonstrating reliability
- Own Initiatives and perseverance
- Customer Orientation
- Conceptual skills
- Decision making
- Ability to Cooperate
- Excellent written and verbal communication skills
- Diploma/Bachelors or equivalent degree in Computer Science, IT, electronics and commu-nications
- Minimum 8 years of professional experience in relevant Data Platform field i.e., Cloud, Data Engineering
- Ability to take ownership for data integration and data management
- Experience with Azure Data Lake, Azure Synapse, Azure Data Factory, SQL Data Ware-house, Azure Blob, Azure Storage Explorer
- Proficient in creating Data Factory pipelines for on-cloud ETL processing; copy activity, cus-tom Azure development etc.
- Experience into SQL stored procedures, Viwes, functions, SAP ODATA etc.
- Knowledge or experience in row level security, GIT, CI/CD, PowerShell scripting an added advantage.
- Knowledge in streaming technologies, containerized services and new technologies in the market is an added advantage.
- Experience with or knowledge of Agile Software Development methodologies.
- Excellent verbal and written communication skills
More Info
Key Skills
Azure Blob
Azure Storage Explorer
Data Factory pipelines
SQL stored procedures
About Company
Skills:
Apache Airflow, Github, Pyspark, Spark, Azure Databricks, Azure Storage, Python, CodeQL, Cycode
Skills:
data engineering , snowflake , Apis, Power Bi, Json, Sql, Apache Airflow, Git, Azure Data Factory, Xml, Python, AWS, ELT, Etl, Matillion, dbt, Fivetran
Skills:
snowflake , Data Modelling, Power Bi, Tableau, Redshift, Sql, ELT, Database Design, Azure Data Factory, Postgres, Databricks, Python, Etl, Aws S3
Skills:
Scala, Apache Spark, Sql, Apache Nifi, Git, Linux, Apache Kafka, Ceph, Python, shell scripting, Pyspark, Data Modeling, HDFS, CI CD pipelines, Apache Ozone
Skills:
snowflake , Python, Sql, Snowpark, dbt