Job Summary Senior Data Engineer
- Monitor and manage daily ETL pipeline operations for data ingestion and transformation.
- Troubleshoot and resolve failures/errors in data pipelines; investigate root causes.
- Escalate unresolved pipeline issues, providing initial analysis and timely updates.
- Serve as a liaison between the Data Engineering team and Business units, communicating issues and resolution timelines.
- Develop a deep understanding of the team's data platforms, architectures, and best practices.
- Conduct data profiling to understand data domains, dependencies, and lineage.
- Collaborate with external business teams (sales, marketing, finance) for data integration needs.
- Participate in Agile ceremonies such as daily stand-ups, sprint reviews, and planning sessions.
- Utilize workflow orchestration tools (e.g., Airflow) and RDBMS (MSSQL, Postgres).
- Write, test, and optimize SQL queries; troubleshoot API-related issues.
- Work with BI tools (Power BI, Qlik) and contribute to enterprise-scale data warehouse projects.
- Preferably experienced with CI/CD pipelines (Azure DevOps), Cloud Data Warehousing (Snowflake), Azure Platform, and data modeling concepts (Data Vault).
- Operate in a remote role, working EST hours (4AM12PM EST), supporting pharma development and manufacturing clients.
Let me know if you need a shorter version or a more tailored summary!
