Search Jobs

Search by job, company or skills

Python Pyspark, Gen AI

Python Pyspark, Gen AI

Tata Consultancy Services
Early Applicant
  • Posted 4 days ago
  • Be among the first 10 applicants

Job Description

Skill: Python Pyspark, Gen AI

Exp: 5 to 8 Years

Location: Chennai

Required Skills & Responsibilities

  • Strong hands-on experience in Python programming, Object-Oriented Programming (OOP), data structures, APIs, and software development best practices.
  • Expertise in PySpark, Apache Spark, Databricks, and building scalable ETL/data processing pipelines for large datasets.
  • Experience with Generative AI technologies, including LLMs, Transformers, Prompt Engineering, RAG, embeddings, and vector databases.
  • Develop, optimize, and maintain data pipelines using Python, PySpark, SQL, and cloud platforms such as Azure, AWS, or GCP.
  • Build and integrate AI/GenAI solutions using frameworks such as LangChain, OpenAI, Hugging Face, TensorFlow, or PyTorch.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

LangChain

embeddings

Generative AI

LLMs

Hugging Face

vector databases

RAG

OpenAI

Prompt Engineering

Similar Jobs

8-15 yrs
Chennai, India
Skills:
Spring BootTensorflowPytorchMLopsDockerAzureKubernetesPythonAWSmulti-agent systemsvector searchscikit-learnprompt engineeringRmicroservices architectureLLM observability frameworksAWS SageMakerGoogle Vertex AIAzure AI
4-6 yrs
Chennai, India
Skills:
.NETJavaVersion ControlLoggingTensorflowPytorchMLopsKerasPythonembeddingsGenerative AI conceptsLLMsLLMOpsMonitoringNLP fundamentalsprompt engineeringfoundation models
5-12 yrs
Chennai, India
Skills:
.Net CoreReactArtificial IntelligenceAngularMicroservicesGenerative AIAzure services
5-7 yrs
Chennai, India
Skills:
PythonGen AI
6-10 yrs
Chennai, India
Skills:
react.js DockerKafkaRabbitmqTypescriptGcpJavascriptEtl ToolsAzureKubernetesAWSNoSQL databasesmessage brokersLLM IntegrationGraphQL APIsSQL databases