About the company
USEReady helps businesses to be self-reliant on data. Headquartered in New York City, USEReady has offices in New Jersey, Texas, Bangalore, India and Beijing, China. Growing over 3000% since inception, USEReady achieved #113 rank in Inc. 500 2015, honoured top 100 companies in North America 2015 by Red Herring and is recognised as Partner for the year by Tableau. USEReady is built on strong entrepreneurial spirit with unprecedented opportunities for career growth. At USEReady, we believe in achieving career growth while improving our individual competencies.
Job Description
About the Role
We're looking for a Senior Azure Data Engineer with deep expertise in Databricks and modern Azure data engineering tools. You'll design, build, and optimize scalable data pipelines and solutions, leveraging advanced features of Databricks and Azure to deliver high-quality, secure, and efficient data platforms.
Key Skills & Expertise
- Strong hands-on experience with Databricks, including:
- Databricks Notebooks (Python, SQL)
- Unity Catalog for governance & security
- Advanced Databricks performance optimization techniques
- Best practices for cost and compute efficiency
- Proficient in Azure Data Factory (ADF) for orchestrating ETL workflows.
- Excellent programming in Python, with advanced PySpark skills.
- Solid understanding of Apache Spark internals & tuning.
- Expertise in SQL writing complex queries, optimizing joins, working with large datasets.
- Familiar with data warehousing principles & modeling techniques (e.g., star/snowflake schemas).
- Knowledge of Azure data services: Data Lake Storage, Synapse Analytics, SQL Database.
- Experience implementing data governance, access control, and data lineage.
What You'll Do
- Design and implement robust, scalable, and efficient data pipelines using Databricks and ADF.
- Leverage Unity Catalog to secure and govern sensitive data.
- Optimize Databricks jobs & queries for speed, cost, and scalability.
- Build and maintain Delta Lake tables and data models suitable for analytics and BI.
- Collaborate with stakeholders to define data needs, provide solutions, and deliver business value.
- Automate manual workflows, improve reliability, and ensure data quality.
- Troubleshoot and monitor pipelines to guarantee uptime and data accuracy.
- Mentor junior engineers and foster best practices in Databricks & Azure data engineering.
Preferred Background
- 5+ years in data engineering with a focus on Azure.
- Demonstrated ability to work with large-scale distributed systems.
- Strong communication and teamwork skills.
- Certifications in Databricks and/or Azure Data Engineering are a plus