Search by job, company or skills

L

Senior Data Engineer

7-10 Years
Save
new job description bg glownew job description bg glow
  • Posted 14 hours ago
  • Over 50 applicants
Early Applicant
Quick Apply

Job Description

• Strong hands-on experience in Python programming and backend data engineering development.

• Expertise in PySpark and Python-based data processing frameworks for handling large-scale data pipelines.

• Experience working with AWS Glue and PySpark for ETL development and data transformation processes.

• Good working knowledge of Python libraries such as Pandas, NumPy, and Joblib.

• Experience in parallel batch processing using Python for optimized performance and scalability.

• Hands-on experience with AWS Batch and AWS Step Functions for workflow orchestration and automation.

• Strong understanding of AWS services including ECS, ECR, Docker, CloudWatch, and Athena.

• Ability to design, build, and maintain scalable cloud-based data engineering solutions.

• Experience in developing efficient and reliable data pipelines in cloud environments.

• Collaborate with cross-functional teams to support data integration and analytics requirements.

• Troubleshoot and optimize data workflows to improve performance and reliability.

More Info

Function:
Employment Type:
Open to candidates from:
Indian

About Company

Logicplanet IT Services (India) Pvt. Ltd., incorporated in 2007 and headquartered in Hyderabad, operates as a software publishing, consulting, and IT solutions provider. The company delivers enterprise technology services including software development, digital transformation, and IT staffing solutions. With expertise in areas such as embedded systems, QA automation, ERP, and cloud technologies, Logicplanet supports global clients by combining technical innovation with workforce solutions, positioning itself as both a technology partner and a recruitment facilitator.

Job ID: 147443635

Similar Jobs

Chennai, India

Skills:

SolrHadoop EcosystemKafkaImpalaMapreducePigNosqlDevopsCloud TechnologiesHiveRDBMSDockerSparkBig Data TechnologiesRest ApisKubernetesMicroservices ArchitecturesHDFSKudu

Kolkata, India

Skills:

snowflake Power BiKafkaSqlGcpKinesisExcelAzurePythonAWSAI toolingdbt

India

Skills:

snowflake GcpPysparkApache SparkDatabricksAzureSqlPythonAWSDelta Lake

India

Skills:

snowflake GitAzure Data FactoryGcpAzureSqlPythonAWSAirflowdbtCI CD

Pune, India

Skills:

JavaScalaKafkaSqlELTGcpPrestoSparkAzurePythonAws S3EtlAWSData LakesHDFSIcebergADLSStarburstDelta LakeTrino