
Search by job, company or skills
Role** Data Engineer
Required Technical Skill Set** Python , Pyspark, GCP, BigQuery , Astronomer
Desired Experience Range** 6+ years
Location of Requirement Bangalore
Desired Competencies (Technical/Behavioral Competency)
Must-Have**
(Ideally should not be
more than 3-5)
· Development, Production Support and delivery of Python, BigQuery, SQL, GCP, Airflow based applications.
· Resource should have experience in Astronomer DAGS, Python, Pyspark, GCP, BigQuery.
· Collaborate with cross-functional teams including designers, product owners, managers, and stakeholders.
· Execute the unit testing to produce defect-free software.
· Ensuring test coverage and creating test methods.
· Creating documentation on modules/enhancements developed.
· Experience on Airflow, Python coding, BigQuery concepts.
· Functional knowledge of billing automations.
· Ensure high quality code standards, security, & performance optimization.
· Agile Methodology and prior experience of implementation with Agile way of working.
· Stay with current trends and new technologies.
Good-to-Have
· Strong knowledge of Python, BigQuery, SQL, GCP, Airflow, Pyspark, Astronomer, Git, Code Version Management
· Strong knowledge of data structures
· Hands on experience in working with NoSQL databases, Firebase, GCP.
· Excellent leadership and mentorship skills
· Strong communication skills
· Ability to work in fast paced and dynamic environment
· Strong problem-solving skills
· Strong commitment towards delivering high quality software solutions.
Job ID: 151863665
Skills:
Pyspark, Databricks, Azure
Skills:
BigQuery, Data Modeling, Google Cloud Platform, Apache Spark, Dataproc, Sql, Agile Methodology, ELT, Cloud Storage, Terraform, DataFlow, Data Governance, Kubernetes, Python, Etl, Airflow, CI CD, Data Pipeline Development, Cloud Monitoring
Skills:
Python, Knowledge of cloud computing platforms and infrastructure, Knowledge of database management systems and data structures, Knowledge of software architecture and design patterns, Knowledge of project management tools and Agile methodologies
Skills:
Xpath, Scrapy, PostgreSQL, Selenium, Proxies, MongoDB, user-agent rotation, Playwright, aiohttp, headless browsers, DOM parsing, Beautiful Soup, asyncio, CSS selectors, Python 3.x, async programming
Skills:
BigQuery, Apache Spark, Sql, ELT, Apache Airflow, Cloud Storage, Databricks, Data Warehousing, DataFlow, Python, Etl, Cloud Composer