Big Data Engineer
Big Data Engineer
Grid DynamicsThis job is no longer accepting applications
Job Description
Our data engineering team is building and maintaining mission-critical data infrastructure to power business intelligence and analytics capabilities. This involves developing robust data pipelines, implementing scalable data architectures, and establishing data governance frameworks to support data-driven decision making across the organization.
Essential functions
- SQL (Primary tool for data manipulation and analysis)
- Python for data processing and automation
- BigQuery, Cloud SQL
- Google Cloud Platform (DataFlow, DataProc, Data Fusion)
- Data warehousing solutions
- ETL/ELT tools and frameworks
Qualifications
- 8-10 years of experience in data engineering or related field
- Expert knowledge of SQL
- Mid-level knowledge of Python (expert preferred)
- Experience with cloud platforms, particularly Google Cloud
- Strong understanding of data modeling and warehouse concepts
- Experience with ETL pipeline design and implementation
- Experience with big data technologies (Hadoop, Spark)
Would be a plus
- Knowledge of data governance and security practices
- Experience with real-time data processing
- Familiarity with BI tools and reporting platforms
- Strong background in performance optimization and tuning
- Advanced debugging and troubleshooting skills
More Info
Job Type:
Industry:
Role:
Function:
Employment Type:
About Company
Skills:
Nosql, Performance Tuning, Unix Shell Scripting, Azure Functions, Cosmos DB, Python, Hadoop, Scala, Apache Spark, Sql, Git, Hive, Azure Data Factory, Databricks, MongoDB, Hbase, Data lakes, Gen AI technology and tools, Batch data processing, Optimization, Eventhub, Medallion architecture, Synapse, data marts, Nifi, Data quality validation
Skills:
Python Programming, Big Data Technologies, Apache Airflow, Data Modeling ETL, AWS Cloud Services, Databases SQL
Skills:
Hadoop, Data Modeling, Etl Tools, Scala, Spark, Kafka, Sql, Python, AWS