Search by job, company or skills

  • Posted a month ago
  • Over 50 applicants
Quick Apply

Job Description

Roles & Responsibilities:

  • Develop and maintain data pipelines and workflows using PySpark on Databricks
  • Write Python scripts for data processing, transformation, and integration with Spark
  • Utilize PySpark and related libraries (e.g., pyspark-ai) to incorporate AI and machine learning functionalities into Spark workflows
  • Perform data analysis, transformations, and aggregations on large datasets
  • Deploy and optimize machine learning models within the Databricks environment
  • Collaborate with data engineers, data scientists, and business teams to understand requirements and deliver solutions
  • Use the Databricks platform to manage, monitor, and optimize Spark jobs and workflows
  • Work with the English SDK for Apache Spark to facilitate natural language interactions with Spark DataFrames
  • Ensure code quality, performance, and scalability of data pipelines and Spark jobs.

More Info

Job Type:
Employment Type:
Open to candidates from:
Indian

About Company

Elfonze Technologies, a Great Place to Work-Certified™ company & is a dynamic IT and Engineering Consulting and Services company, uniquely positioned at the intersection of technology and engineering expertise. We excel in various verticals, including Enterprise Application and Digital Transformation, Product Development, Engineering, Connected Supply Chain Services, and Specialized Talent Solutions. Our dual focus allows us to provide comprehensive solutions that address both IT and engineering challenges, making us a one-stop partner for our clients. With a strong focus on Oracle Enterprise Solutions, Elfonze offers a wide range of services such as consulting, integration, application support, and program management. Our innovative consulting services and product solutions span areas like Unified Health Interface, Logistics Optimization, and Real-Time Business Insights. We specialize in digital process automation, user-centric design, and quality assurance, ensuring that our solutions are both cutting-edge and user-friendly. Elfonze has a proven track record in Engineering, delivering advanced solutions in Sustainability, Intelligent Mobility, and Industry 4.0. Our unique blend of IT and engineering services enables us to provide holistic solutions that drive operational efficiencies and business growth. With a strong presence in Bengaluru, Bhubaneswar, Pune, Hyderabad, Denver & Dubai. Elfonze is committed to delivering exceptional results, leveraging our dual expertise to solve complex problems and deliver value to our clients.

Job ID: 137572849

Similar Jobs

Early Applicant