
Search by job, company or skills
This job is no longer accepting applications
Role: Python + BigData Lead Developer
Experience: 6+ years
Location: Pune & Chennai
Proven, extensive experience (6+ to 10 Years) as a Python Lead Developer, with a portfolio of successful projects.
In-depth knowledge and hands-on experience with Python frameworks like Django, Flask, FastAPI, or others depending on the specialization.
Looking for The role is for a Data Engineer who would be responsible to work independently on end-to-end data acquisition, transformation and Governance including Infra set ups in Big Data.
The resource should have around 6+ years of experience in the IT Industry with hands on development experience in Cloudera/AWS/Azure with expertise in Python, Hive, Shell scripting.
Experience with RESTful APIs, web services, and containerization technologies like Docker and Kubernetes.
Experience with version control systems (e.g., Git) and familiarity with CI/CD pipelines and agile methodologies.
Strong proficiency with databases, including both SQL (e.g., Oracle) and NoSQL databases (e.g., MongoDB), along with an understanding of schema design.
Excellent analytical and problem-solving skills to troubleshoot complex software issues and propose innovative solutions.
Write clean, well-crafted, and maintainable Python code for server-side logic and backend features.
Work with cross-functional teams, including UX/UI designers, AbInitio & Spark Scala developers, to integrate / migrate different application components and deliver features.
Create and maintain technical documentation and specifications for software applications.
Job ID: 151862831
Skills:
Document Databases Working knowledge of MongoDB, ETL Tools Proficiency in Ab Initio GDE EME Co Operating System, Unix Linux Scripting, SQL PL SQL Querying, Testing QA Exposure to SIT E2E and OAT testing cycles, Messaging Systems Experience with IBM MQ Apache Kafka, Agile Delivery Experience with JIRA, Scheduling Tools Familiarity with Tivoli Workload Scheduler TWS, Security Compliance Awareness of access control vulnerability assessments
Skills:
.NET, data warehouses , Spark SQL, Power Bi, Azure Log Analytics, Powershell Scripting, Hive, Azure Data Factory, Data lakes, Microsoft Azure Data platform, Azure SQL Data Warehouse, Azure Storage Services, Azure Application Insights, Data Bricks, Stream Analytics, data marts, Event Hubs, Azure SQL DB, Azure Analysis Services
Skills:
S3, RDS, Pyspark, Databricks, Emr, Redshift, Python, Sql, AWS, Etl
Skills:
Java, Unix, Apache Flink, Data Modeling, Schema Design, Pyspark, Data Cleansing, Apache Spark, Data Warehouse Concepts, Shell Scripting, Sql, ELT, Apache Airflow, Linux, Apache Kafka, Restful Apis, Python, Etl, Data Transformation, Data Quality Validation
Skills:
proxmox , Servicenow, Kvm, Windows Server, Prometheus, Grafana, Datadog, Terraform, Vcenter, Python, AWS, Esxi, Vmware Vsphere, PowerShell, Bash, Jira, Ubuntu, Git, Nsx, Ansible, Rhel, Powercli, Vsan, networking fundamentals