Search by job, company or skills

Infinite Computer Solutions

Technical Lead

Save
new job description bg glownew job description bg glow
  • Posted 15 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Job Description

Skillset

  • Hands-on experience with GCP (BigQuery, Composer, Dataproc, Dataflow, Pub/Sub)
  • Working knowledge of Databricks for data processing and pipelines
  • Strong programming skills in SQL and PySpark
  • Experience with Oracle and SQL Server databases
  • Understanding of data modelling (dimensional / medallion basics)
  • Experience in batch pipelines and exposure to streaming
  • Familiarity with data ingestion, ETL/ELT processes
  • Basic understanding of data quality and validation
  • Exposure to Airflow/Composer and scheduling
  • Working knowledge of Git and CI/CD

Detailed Responsibilities

  • Develop and maintain batch and streaming data pipelines
  • Build SQL and PySpark transformations for large datasets
  • Ingest data from multiple sources into BigQuery/cloud platforms
  • Implement data transformation logic as per requirements
  • Work with teams to consume curated datasets
  • Develop workflows using Cloud Composer (Airflow)
  • Perform data validation and reconciliation
  • Optimise queries and pipelines for performance
  • Support migration of legacy ETL jobs to cloud
  • Troubleshoot pipeline and performance issues
  • Participate in testing, UAT, and deployment
  • Document pipelines, transformations, and sources
  • Collaborate with analytics and reporting teams

Qualifications

B Tech

Range Of Year Experience-Min Year

7

Range Of Year Experience-Max Year

10

More Info

Job Type:
Industry:
Employment Type:

Job ID: 148331341

Similar Jobs

Hyderabad, India

Skills:

Machine LearningArtificial IntelligencePostgreSQLNode.jsAPI designSqlReactGitTypescriptJavascriptMySQLMongoDBRestful ApisAzureAWSPrompt engineeringserver-side architectureChatbotsAI integrationRetrieval Augmented GenerationLarge Language ModelsLLM tuning

Hyderabad, India

Skills:

Hcm ExtractsRest ApisBi Publisher ReportsOracle Integration Cloud OICSOAP APIsPayroll InterfacesFBDI File-Based Data ImportHDL HCM Data LoaderOracle Cloud IntegrationsTechnical Design DocumentationOracle Fusion HCM TechnicalFast FormulaSecurity Configuration and RBACMigration and Deployment ActivitiesOTBI Reports and Dashboards

Hyderabad, India

Skills:

S3GraphqlNodePluginsSqlLambdaReactKmsTypescriptJavascriptSplunkRest ApisAppianAWSClaude CodeElasticAppian connected systemsDevSecOps toolsAthena

Hyderabad, India

Skills:

UnixPaasSNMPPythonArgoJenkinsGitNetconfLinuxAnsibleKubernetesGitOpsK8SGoCaaScontainerized application developmentCI-CD automationYANGcloud-native technologies5G NR standardsSMO RIC frameworkML based xApps rAppsprivate public or hybrid cloud environmentsRESTful interfaces

Hyderabad, India

Skills:

JavaS3DockersSpring BootJIRASqlReact JsMicroservicesDevopsLambdaTesting ToolsConfluenceCloudJUnitMockitoTerraformAgileKubernetesAWSCI CDBuild Jules