As a Data Engineer, you will be a key contributor to Neuron's core technology team, helping design, build, and optimize scalable data pipelines and intelligent document/data solutions. You will work closely with data scientists, product managers, and engineering leads to enable advanced analytics, LLM integrations, and cloud-based data management. You will be responsible for hands-on development using Python and Pandas for data processing, integrating with LLM APIs, and building robust REST APIs. Exposure to Azure and MongoDB will help you support the team in building high-quality, production-grade data platforms.
The role:
- Integrate with internal/external LLM APIs (e.g., OpenAI, Azure OpenAI), including prompt engineering and pre/post-processing as required.
- Build and maintain data analysis workflows using Pandas for data transformation and insight delivery.
- Develop RESTful APIs using FastAPI or Flask for data and document management.
- Design and implement clean, efficient, and modular Python codebases for backend services, data pipelines, and document processing workflows.
- Support the team in onboarding new data sources, integrating with Azure services, and ensuring smooth cloud deployments.
- Collaborate with product, data science, and engineering teams to translate business requirements into technical solutions.
- Write unit tests and contribute to CI/CD pipelines for robust, production-ready code.
Stay up to date with advances in Python, LLM, and cloud technologies
Qualifications:
- Bachelor's or master's in computer science, Engineering, or related quantitative discipline.
Experience:
- 6 to 9 years of hands-on experience in data engineering or backend development with Python.
Technical Competencies:
- Exposure to LLM integration (prompt design, API integration, handling text data).
- Strong experience in Python with focus on data analysis (Pandas) and scripting.
- Hands-on experience in building REST APIs (FastAPI or Flask).
- Experience in developing data pipelines, data cleaning, and transformation.
- Working knowledge of Azure cloud services (Azure Functions, Blob Storage, App Service, etc.)
- (Nice to have) Experience integrating MongoDB with Python for data storage, modelling, or reporting.
Skills:
- Strong problem-solving and quantitative skills.
- Impactful written and verbal communication.
- Ability to work both independently and collaboratively in an agile, fast-paced team.
- Business acumen and eagerness to learn new technologies.
Self-driven and able to manage tasks and priorities effectively.
