We are looking for a Data Engineer to support enterprise data and e-commerce initiatives. This role will focus on building scalable cloud-based data pipelines, processing streaming data, and integrating data across AWS, Databricks, MongoDB, and Delta Lake environments.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and cloud-native data processing solutions.
- Develop and support AWS Lambda-based data processing workflows.
- Build and optimize streaming and event-driven data architectures.
- Source, process, and transform data from MongoDB, Delta Tables, and other enterprise data sources.
- Support ingestion, transformation, and movement of data across AWS and Databricks platforms.
- Collaborate with engineering, architecture, and business teams to support e-commerce and customer data initiatives.
- Troubleshoot and optimize data quality, performance, and reliability of production data pipelines.
- Support deployment, monitoring, and ongoing maintenance of cloud-based data solutions.
Required Skills & Qualifications
- Strong experience as a Data Engineer within AWS environments.
- Hands-on experience with AWS Lambda.
- Experience processing streaming or near real-time data.
- Strong SQL and Python development skills.
- Hands-on experience with Databricks and Delta Tables.
- Experience sourcing and processing data from MongoDB or similar NoSQL databases.
- Strong understanding of ETL/ELT frameworks and cloud data architectures.
- Experience supporting production-grade enterprise data platforms.
Preferred Qualifications
- Experience supporting e-commerce, digital commerce, retail, or customer-facing transaction platforms.
- Familiarity with AWS Glue.
- Experience with customer data, analytics, or transactional data environments.
- Experience working in Agile delivery environments.
- Exposure to modern cloud-native data engineering practices.
Benefits
- Health Insurance, Accident Insurance.
- The salary will be determined based on several factors, including, but not limited to, location, relevant education, qualifications, experience, technical skills, and business needs.
Additional Responsibilities
- Participate in OP monthly team meetings and participate in team-building efforts.
- Contribute to OP technical discussions, peer reviews, etc.
- Contribute content and collaborate via the OP-Wiki/Knowledge Base.
- Provide status reports to OP Account Management as requested.
About Us
At OP, we help you harness the power of technology for maximum impact. A technology consulting and solutions company, we offer advisory and managed services, innovative platforms, and staffing solutions across a wide range of fields including AI, cyber security, enterprise architecture, and beyond. For nearly two decades, we ve been challenging the status quo of the consulting industry, serving up fresh, ingenious thinking through a radically lean structure. Together, this strategy delivers unprecedented performance at an unparalleled pace for faster results that propel your business forward.
