V
Lead Software Engineer
Job Description
The Senior Data Engineer is responsible for the design, development, administration, governance, and operational support of enterprise data platforms built on Databricks and Microsoft Fabric. This role combines deep data engineering expertise with platform administration capabilities to ensure scalable, secure, reliable, and cost-effective data solutions that support business operations, analytics, AI initiatives, and project delivery.
Own end-to-end technical design, development, and delivery of enterprise data engineering solutions.
Design and implement scalable ETL/ELT, data integration, and data transformation pipelines for structured and unstructured data sources.
Develop and maintain batch, near real-time, and streaming data ingestion pipelines from databases, APIs, files, cloud storage, and enterprise applications.
Build reusable notebooks, data transformations, and processing frameworks using Databricks, Microsoft Fabric, Python, PySpark, and SQL.
Create trusted datasets, curated data products, and semantic-ready data structures supporting analytics, reporting, AI, and machine learning initiatives.
Primary Skill
Databricks
Microsoft Fabric
Python
SQL
Secondary Skill
OneLake
Spark
Own end-to-end technical design, development, and delivery of enterprise data engineering solutions.
Design and implement scalable ETL/ELT, data integration, and data transformation pipelines for structured and unstructured data sources.
Develop and maintain batch, near real-time, and streaming data ingestion pipelines from databases, APIs, files, cloud storage, and enterprise applications.
Build reusable notebooks, data transformations, and processing frameworks using Databricks, Microsoft Fabric, Python, PySpark, and SQL.
Create trusted datasets, curated data products, and semantic-ready data structures supporting analytics, reporting, AI, and machine learning initiatives.
Primary Skill
Databricks
Microsoft Fabric
Python
SQL
Secondary Skill
OneLake
Spark
More Info
Key Skills
About Company
Skills:
Cpq, Data Modelling, Power Bi, Tableau, JIRA, Sql, Confluence, Service Cloud, Sales Cloud, Excel, Lead Management, ETL concepts, Salesforce modules, Visio, Billing, reporting structures, Lucidchart, Pricing, Revenue recognition concepts, Opportunity Management
Skills:
Ml, Tcl, Verilog, Python, Pcie, Verification planning, systemverilog, Ai, CHI, Rtl Design, CXL, Coverage, SVAR, Axi
Skills:
, UNIX, Python, Debugging, LINUX, Algorithms, Topological Operations, Data Analysis, Physical Verification
Skills:
Sql, Integrations, Cloud deployment, Typescript, React, System Design, Node.js, Backend Engineering, FastAPI, Python, Apis, PostgreSQL, Databases, Javascript, modern software architecture, automations, AI-enabled applications, Next.js, LLM workflows, workflow automation