Search by job, company or skills

Python , Pyspark, GCP, BigQuery , Astronomer

Early Applicant
  • Posted 12 hours ago
  • Be among the first 10 applicants

Job Description

Role** Data Engineer

Required Technical Skill Set** Python , Pyspark, GCP, BigQuery , Astronomer

Desired Experience Range** 6+ years

Location of Requirement Bangalore

Desired Competencies (Technical/Behavioral Competency)

Must-Have**

(Ideally should not be

more than 3-5)

· Development, Production Support and delivery of Python, BigQuery, SQL, GCP, Airflow based applications.

· Resource should have experience in Astronomer DAGS, Python, Pyspark, GCP, BigQuery.

· Collaborate with cross-functional teams including designers, product owners, managers, and stakeholders.

· Execute the unit testing to produce defect-free software.

· Ensuring test coverage and creating test methods.

· Creating documentation on modules/enhancements developed.

· Experience on Airflow, Python coding, BigQuery concepts.

· Functional knowledge of billing automations.

· Ensure high quality code standards, security, & performance optimization.

· Agile Methodology and prior experience of implementation with Agile way of working.

· Stay with current trends and new technologies.

Good-to-Have

· Strong knowledge of Python, BigQuery, SQL, GCP, Airflow, Pyspark, Astronomer, Git, Code Version Management

· Strong knowledge of data structures

· Hands on experience in working with NoSQL databases, Firebase, GCP.

· Excellent leadership and mentorship skills

· Strong communication skills

· Ability to work in fast paced and dynamic environment

· Strong problem-solving skills

· Strong commitment towards delivering high quality software solutions.

More Info

Job Type:
Industry:
Employment Type:

Job ID: 151863665

Similar Jobs

Bengaluru, India

Skills:

PysparkDatabricksAzure

Bengaluru, India

Skills:

BigQueryData ModelingGoogle Cloud PlatformApache SparkDataprocSqlAgile MethodologyELTCloud StorageTerraformDataFlowData GovernanceKubernetesPythonEtlAirflowCI CDData Pipeline DevelopmentCloud Monitoring

Bengaluru, India

Skills:

PythonKnowledge of cloud computing platforms and infrastructureKnowledge of database management systems and data structuresKnowledge of software architecture and design patternsKnowledge of project management tools and Agile methodologies

Bengaluru, India

Skills:

XpathScrapyPostgreSQLSeleniumProxiesMongoDBuser-agent rotationPlaywrightaiohttpheadless browsersDOM parsingBeautiful SoupasyncioCSS selectorsPython 3.xasync programming

Bengaluru, India

Skills:

BigQueryApache SparkSqlELTApache AirflowCloud StorageDatabricksData WarehousingDataFlowPythonEtlCloud Composer

Beware of Scammers

We don’t charge money for job offers