Job Description

We are looking for an experienced Data Engineer with strong expertise in SQL Server, data integration, and structured data processing. The role will focus primarily on building, supporting, and troubleshooting reliable data loads and integrations, including ServiceNow extracts and future data solutions using Microsoft Fabric.

The ideal candidate will have strong SQL skills, hands-on experience working with JSON and XML data, and an analytical mindset with the ability to investigate issues, evaluate different solutions, and quickly learn unfamiliar technologies.

Key Responsibilities

Design, develop, maintain, and troubleshoot complex SQL Server solutions and data processing workflows.
Develop and support data loads and extracts from enterprise platforms, including ServiceNow.
Work with complex SQL constructs, including:
Stored procedures
Common Table Expressions
MERGE statements
Window functions such as ROW_NUMBER, RANK, DENSE_RANK, LEAD, and LAG
Conditional branching and complex process flows
Perform SQL query analysis and optimization and understand database locking considerations.
Process structured and semi-structured data, particularly JSON and XML, including parsing within SQL Server.
Develop and support SSIS solutions involving loops, derived columns, and script tasks.
Work with REST APIs and various authentication methods to support data extraction and integration.
Use tools such as PowerShell to troubleshoot API endpoints and inspect data returned from third-party applications.
Work with Git-based source control and Microsoft Fabric development environments.
Troubleshoot unexpected integration or platform changes by reviewing documentation, validating endpoints, analyzing returned data, and identifying appropriate solutions.

Required Skills & Experience

5–7 years of relevant experience in data engineering, database development, business intelligence data integration, or a related area.
Strong hands-on expertise in SQL Server and advanced SQL development.
Strong experience with:
Stored procedures
Common Table Expressions
MERGE
Window functions
Query optimization
Complex SQL processing logic
Strong working knowledge of JSON and XML, including schemas and parsing structured data.
Experience developing and supporting data integration and ETL solutions.
Experience with SSIS, including:
For and ForEach loops
Derived columns
Script tasks
Familiarity with C#, especially for SSIS script tasks.
Exposure to REST APIs, including:
Basic and OAuth2 authentication
GET, POST, PUT, PATCH, and DELETE methods
Good understanding of troubleshooting data-processing and integration issues.
Strong analytical and problem-solving skills.
Ability to independently investigate issues, consider alternative solutions, and learn new technologies as requirements change.

Strong SQL capability and comfort working with JSON and XML should be treated as essential requirements, consistent with the original skill recommendation.

Preferred / Good-to-Have Skills

Experience with Microsoft Fabric, particularly:
Warehouses
Gateways
Parameterized connections
Basic familiarity with semantic models
Git integration
Build and support current and future data-loading solutions using Microsoft Fabric.
Experience using PowerShell for troubleshooting APIs and integration endpoints.
Familiarity with Git, Visual Studio Code, and Git Bash.