Search by job, company or skills

Data Engineer

8-10 Years
Early Applicant
  • Posted 3 months ago
  • Be among the first 10 applicants

Job Description

Job Role - Python Data Engineer

Experience Required - 8+ Years

Mandate Skills - Python, Pyspark and Databricks

Location - Indore or Pune (Hybrid)

Overview:

We are seeking a highly skilled Python and PySpark Data Engineer who is passionate about building robust data solutions from the ground up. The ideal candidate should have a deep understanding of core programming concepts, be highly proficient in Python and PySpark, and possess strong SQL skills. We're looking for someone who thinks out of the box, understands the value of reusable and scalable solutions, and is comfortable working in dynamic, fast-paced environments. Experience with Databricks and Azure Data Factory (ADF) is needed.

Responsibilities:

Design, develop, and maintain Python and PySpark.

Write complex SQL queries for data transformation, validation, and analysis.

Build scalable, reusable code frameworks with a dynamic and modular mindset.

Develop solutions from scratch with clean, well-documented code.

Optimize and refactor existing code for better performance and scalability.

Collaborate closely with data engineers, analysts, and business stakeholders to deliver impactful solutions.

Implement best practices in data engineering, coding standards, and deployment.

Work with Databricks and ADF to orchestrate and manage data workflows.

Requirements:

Strong foundational knowledge and hands-on experience in Python and PySpark.

Proficiency in SQL and experience working with large datasets.

Demonstrated ability to code from scratch, not just maintain or tweak existing codebases.

Ability to think innovatively and approach problems with a solution-oriented mindset.

Understanding of reusable design patterns and dynamic solutioning.

Experience working with Databricks and Azure Data Factory (ADF).

One of the cloud data platforms (Azure, AWS, or GCP) is required

Bachelor's degree in Computer Science, Engineering, or a related field.

About InfoBeans:

InfoBeans is a global digital transformation and product engineering company, enabling businesses to thrive through innovation, agility, and cutting-edge technology solutions. With over 1,700 team members across the globe, we specialize in custom software development, enterprise solutions, cloud, AI/ML, UX, automation, and digital transformation services.

At InfoBeans, we live by our core purpose of Creating WOW!—for our clients, team members, and the community. Our collaborative culture, growth opportunities, and people-first approach make us one of the most trusted and rewarding workplaces.

Link: https://infobeans.ai/

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 126925989

Similar Jobs

Pune, India

Skills:

Document Databases Working knowledge of MongoDBETL Tools Proficiency in Ab Initio GDE EME Co Operating SystemUnix Linux ScriptingSQL PL SQL QueryingTesting QA Exposure to SIT E2E and OAT testing cyclesMessaging Systems Experience with IBM MQ Apache KafkaAgile Delivery Experience with JIRAScheduling Tools Familiarity with Tivoli Workload Scheduler TWSSecurity Compliance Awareness of access control vulnerability assessments

Pune, India

Skills:

.NETdata warehouses Spark SQLPower BiAzure Log AnalyticsPowershell ScriptingHiveAzure Data FactoryData lakesMicrosoft Azure Data platformAzure SQL Data WarehouseAzure Storage ServicesAzure Application InsightsData BricksStream Analyticsdata martsEvent HubsAzure SQL DBAzure Analysis Services

Pune, India

Skills:

JavaUnixApache FlinkData ModelingSchema DesignPysparkData CleansingApache SparkData Warehouse ConceptsShell ScriptingSqlELTApache AirflowLinuxApache KafkaRestful ApisPythonEtlData TransformationData Quality Validation

Pune, India

Skills:

snowflake KafkaELTDevopsSparkIncident ManagementDatabricksRestful ApisAzureEtlAWSAirflowMonitoring

Pune, India

Skills:

Data GovernanceData ModelingSqlPythondata orchestration workflowsdata quality frameworksdistributed data processing frameworksETL pipelines

Beware of Scammers

We don’t charge money for job offers