Job Description: Databricks Engineer with SAP BW
Experience: 8-10 Years
Location: Remote
Job Type: Full Time
Job Summary:
We are seeking an experienced Databricks Engineer with strong SAP BW expertise to support enterprise data modernization initiatives within the Finance and Manufacturing domains. The ideal candidate will have hands-on experience in Databricks, PySpark, SAP BW/BW4HANA, and cloud-based data platforms, with a proven track record of designing scalable data solutions, integrating SAP and non-SAP systems, and delivering analytics that drive business insights.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using Databricks, PySpark, and Spark SQL.
- Extract, transform, and load (ETL/ELT) data from SAP BW, SAP ECC, SAP S/4HANA, and other enterprise systems.
- Develop and optimize Delta Lake and Lakehouse architectures for analytics and reporting.
- Perform SAP BW/BW4HANA data modeling, including ADSOs, Composite Providers, InfoObjects, Transformations, and Queries.
- Integrate SAP and non-SAP data sources to support Finance and Manufacturing business processes.
- Work closely with business stakeholders, functional teams, and solution architects to gather requirements and deliver data solutions.
- Support enterprise reporting, KPI dashboards, and advanced analytics initiatives.
- Optimize data processing performance, data quality, and governance frameworks.
- Troubleshoot and resolve data integration, transformation, and performance issues.
- Participate in SAP BW modernization and migration projects to Databricks and cloud platforms.
- Implement security, data governance, and compliance best practices.
Required Skills:
- 8+ years of hands-on experience with Databricks and SAP BW.
- Strong experience with Databricks Lakehouse Platform.
- Hands-on expertise in PySpark, Spark SQL, Delta Lake, and Python.
- Experience building large-scale ETL/ELT pipelines.
- Strong SQL and data warehousing concepts.
- Experience with dimensional and star-schema modeling.
- Strong knowledge of SAP BW data modeling and extraction frameworks.
- Experience with SAP ECC and SAP S/4HANA integration.
- Knowledge of ODP, CDS Views, SAP Extractors, and Open Hub.
- Experience with Process Chains, DTPs, and Transformations.
- Experience with Azure, AWS, or GCP.
- Experience integrating SAP data with Databricks.
- Knowledge of Azure Data Factory, Microsoft Fabric, or similar data integration tools.
- Familiarity with CI/CD and DevOps practices.
Preferred Skills:
- Experience with SAP Datasphere.
- Experience with Microsoft Fabric and Power BI.
- Knowledge of Unity Catalog and data governance frameworks.
- Exposure to machine learning and advanced analytics on Databricks.
- Databricks, Azure, AWS, or SAP certifications.
Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
- 8–10 years of overall IT experience with strong exposure to Databricks and SAP BW.
- Experience working in Finance and Manufacturing domain projects is mandatory.
