Data Engineer (AWS + Databricks)
Job Description
Position: Data Engineer (AWS + Databricks)
Location: Singapore
Experience: 4 to 8 Years
Key Skills Required
- Strong hands-on experience with Databricks
- Expertise in PySpark and Spark SQL
- Good experience with AWS Cloud Services, including:
- S3
- Glue
- Lambda
- Redshift
- Athena
- IAM
- Experience with Delta Lake and Lakehouse Architecture
- Strong SQL and Data Modeling skills
- Experience designing and developing scalable ETL/ELT pipelines
- Knowledge of CI/CD, Git, and cloud-based data engineering best practices
Responsibilities
- Design, build, and optimize scalable data pipelines using AWS and Databricks.
- Develop ETL/ELT workflows for processing large-scale data.
- Implement and maintain Delta Lake/Lakehouse solutions.
- Collaborate with business and technical stakeholders to deliver data solutions.
- Monitor, troubleshoot, and optimize data processing workloads.
Preferred Certifications
- AWS Certified Data Engineer / Solutions Architect
Databricks Certified Data Engineer
More Info
Key Skills
AWS Data Engineer
Data Pipelines
Scalable Data Pipelines
Delta Lake
Lakehouse Architecture
Amazon Athena
Cloud Data Engineering
Data Lakehouse
Workflow Orchestration
Real-Time Data Processing
CI/CD
AWS Certified Data Engineer
AWS Certified Solutions Architect
Databricks Certified Data Engineer
Data Platform
Data Optimization
About Company
Skills:
data engineering , large systems integration , team involvement , S3, It Operations, Ec2, Databricks, Puppet, Data Governance, AWS, Operational Delivery Teams, Compliance Solutions, Government, system integrators, Health Insurance
Skills:
Spark SQL, Apache Spark, Data Warehouse Concepts, Tableau, Oracle Database Management, Incident Management, Data Profiling, Databricks, AWS, Advanced Analytics Techniques, RDDs, Cloud Cost Control, Amazon SageMaker, DataFrames, DataRobot, ML Ops, IDMC Informatica Data Management Cloud, Data Verification, Monitoring
Skills:
Spark SQL, Pyspark, Data Modeling, Sql, Terraform, Databricks, Python, AWS, Databricks SQL, CI CD, Infrastructure-as-code, Unity Catalog, Delta Lake, Lakeflow Delta Live Tables