Key Responsibilities
- Develop scalable, high performancebackend applications and Distributed data pipelinesusingPythonandPySpark
- Design and optimize complexSQL queries,stored procedures, and data models onMS SQL Server
- Leverage theHadoop ecosystem(Hive, Hue, Impala, HBase) andElasticsearchfor high-volume data processing and search
- Implement real-time event processing usingApache Kafka
- Automate environment management and infrastructure tasks usingPowerShell scripting
- Collaborate with cross-functional teams usingJirafor Agile planning andBitbucketfor version control and code collaboration
- Develop, integrate, and maintainRESTful APIswithin distributed systems architecture
- Participate incode reviews, contribute to technical documentation, and mentor junior engineers
- Optionally contribute to:
- Frontend developmentusingAngularorReact
- Enhancing legacy or low-code applications usingVBA,Appian, orBRMS toolslikeDrools
- Cloud-native deploymentsanddata pipelinesonAWSorOCI (Oracle Cloud Infrastructure)
Mandatory Skills
Backend & Data Engineering
- Proficiency inPythonandPySparkfor backend services and data pipeline development
- Hands-on experience withHadoop ecosystem tools: Hive, Hue, Impala, HBase
- Strong expertise inMS SQL Server writing advanced queries, designing schemas, and implementing stored procedures
- Knowledge ofElasticsearchfor distributed search and analytics
- Working knowledge ofApache Kafkafor event-driven and real-time processing
- Scripting experience withPowerShellfor task automation and environment configuration
Version Control & Agile Practices
- Experience usingBitbucketfor source control
- Working in Agile environments usingJirafor sprint planning, issue tracking, and backlog management
Software Engineering Fundamentals
- Designing and integratingRESTful APIs
- Building and maintainingdistributed systems
- Active participation incode reviewsand technical documentation
- Familiarity with Agile/Scrum methodologies
Optional / Preferred Skills
- Exposure toAngularorReactfor UI development
- Experience withAppian,VBA, orDrools (BRMS)for automation and business logic management
- Understanding ofcloud platformssuch asAWSorOCI
- Experience withcloud-native deploymentsandcloud-based data workflows
- Advanced backend development inJavaandSpring Bootfor microservices (a plus)
Experience & Qualifications
- Bachelor's or Master's degree inComputer Science,Engineering, or a related field
- 7+ yearsof software development experience, with a focus on backend systems and data engineering
- Demonstrated success in delivering robust and scalable backend solutions
- Experience working withlarge-scale data platforms(e.g., Cloudera Hadoop)
- Solid understanding ofsoftware engineering principles, performance optimization, and system integration
Core Competencies
- Strong problem-solving and analytical skills
- Excellent communication and collaboration in cross-functional teams
- Ability to work independently and manage deliverables end-to-end
- Adaptability and continuous learning in dynamic environments
