Data Engineer
- Posted 16 hours ago
- Be among the first 10 applicants
Job Description
Basic Qualifications
- 3+ years of data engineering experience
- Experience with data modeling, warehousing, and building ETL pipelines
- Experience as a data engineer or related specialty (e.g., software engineer, business intelligence engineer, data scientist) with a track record of manipulating, processing, and extracting value from large datasets
- Experience in at least one modern scripting or programming language, such as Python.
Preferred Qualifications
- Experience with AWS technologies like Redshift, S3, AWS Glue, Athena, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience with non-relational databases/data stores (object storage, document or key-value stores, graph databases, column-family databases)
- Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
- Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence.
- Knowledge of SSIS, SSMS
Note - Will be able to join Immediately
More Info
Key Skills
Non-relational databases
Key-value stores
Column-family databases
ETL pipelines
About Company
Skills:
amazon emr , S3, RDS, Amazon Ec2, Pyspark, AWS Glue, Dynamodb, Redshift, Git, Sns, Python, AWS, Parquet, Amazon Athena, ElastiCache, Snappy, Spark Dataframes, Aurora, Gzip, Amazon Lambda
Skills:
Adf, Pyspark, Databricks, Data Engineer, Azure, Python, Sql
Skills:
snowflake , Artificial Intelligence, Data Structures, Sql, ELT, Algorithms, Databricks, Python, Etl, Generative AI, Prompt engineering, LLMs, Cloud-based data engineering, Large-scale data processing, AI-assisted development, Data pipelines
Skills:
data engineering , Github, Pyspark, Apache Spark, Data Architecture, Data Modeling, Sql, Gcp, Databricks, Azure, Python, AWS, Azure DevOps, Azure Pipelines, data platforms, data warehousing solutions, MLOps methodologies, CI CD, Analytics, technical project delivery, ETL processes
Skills:
monte carlo , snowflake , Sql, Git, Azure, Python, Azure DevOps, Atlan, GitHub Actions, dbt, Fivetran, Immuta