Software Development Engineer

Position Summary

We are seeking a Senior Software Development Engineer – Data Engineering with 3–5 years of experience to design, build, and optimize data pipelines and analytics workflows using Snowflake, Databricks, and Apache Spark. The ideal candidate will have strong expertise in big data processing, cloud data platforms, and performance optimization to support scalable, data-driven solutions.

Key Responsibilities

• Design and develop scalable data pipelines for ETL/ELT workflows
• Work with cloud data platforms (Azure, AWS, or GCP)
• Implement data modeling and warehousing solutions using tools like Azure Synapse and Snowflake
• Optimize data storage in data lakes and data warehouses
• Ensure data quality through validation, cleansing, and error handling
• Collaborate with data analysts, architects, and software engineers to deliver clean and usable datasets
• Implement and manage data access controls and security protocols
• Troubleshoot and monitor data pipelines, notebooks, and SQL workflows
• Develop dashboards and reports using Power BI, with hands-on experience in DAX and Power Query

Basic Qualifications

• Bachelor's or Master's degree in Computer Science, Data Science, or related field
• 3–5 years of hands-on experience in data engineering and big data environments
• Proficiency in SQL, Python, or Scala
• Experience with Apache Spark, Databricks, and Snowflake
• Strong working knowledge of Azure Data Factory, Azure Synapse, and/or Microsoft Fabric

Preferred Qualifications

• Experience with streaming data platforms (Kafka, Flink, Kinesis, or Pub/Sub)
• Familiarity with BI tools like Tableau, Power BI, or Looker
• Exposure to data observability tools (e.g., Monte Carlo, Great Expectations)
• Contributions to open-source projects in the data engineering space