As a Data Engineer you will work with the latest development tools to design and build new data pipelines to onboard data to our new, modern cloud architecture. This is an exciting opportunity for self-starter, tech savvy engineers to build out our next-generation big data platforms.
Primary Responsibilities
- Design, develop and operationalize new data pipelines and data transformation rules.
- Profile data and identify potential data gaps.
- Propose and document data transformation workflows.
- Build, test and implement advanced SQL scripts.
- Monitor data pipelines and ensure SLAs.
- Conduct performance tuning assessment to optimize data pipelines and cost-effective scaling.
- Promote Data Trust by thoroughly testing solutions and quickly resolving data quality issues.
Experience And Requirements
- Bachelor s degree in Computer Science, Engineering, or a related discipline.
- 3+ years of using SQL to profile, analyze and transform data.
- 2+ years programming experience using one of the major programming languages like Java/Python/Perl/C++ etc.
- Experience in creating Shell Scripts.
- Experience with ETL tools such as SSIS, Informatica, Talend, Fivetran.
- Experience with one or more database platforms such as SQL Server, MySQL, PostgreSQL, DynamoDB, Snowflake.
- Experience with Snowflake or similar cloud-based data warehouse technologies such as AWS Redshift or Google BigQuery is a big plus.
- Knowledge of data warehouse concepts such as dimensional modeling and aggregate tables.
- Experience with systems analysis and design, SDLC, and Agile approaches.
Skills/Requirements
Skills And Abilities
- Effective oral, written and interpersonal communication skills
- Effective presentation skills
- Collaborates and openly seeks and shares information across teams and departments.
- Takes initiative to complete critical tasks, and overcomes obstacles in a proactive manner.
- Works well in a growing, fast-paced, entrepreneurial environment.
- Keeps informed on the latest technological approaches and trends in his/her technical field.
- Brings a work ethic that inspires your fellow team members to give their best.
