Search Jobs

Search by job, company or skills

Senior Data Engineer (PYTHON, SQL, PYSPARK, Data Modelling, Stored procedures)

Senior Data Engineer (PYTHON, SQL, PYSPARK, Data Modelling, Stored procedures)

NielsenIQ
5-7 Years
Early Applicant
  • Posted a month ago
  • Be among the first 20 applicants

Job Description

Job DescriptionNote:- 7+ Years

NIQ is looking for a Senior Data Engineer to join our Financial Services Engineering team.

At NIQ, the Financial Services team uses alternative datasets to help global public equity investors (hedge funds, mutual funds, pension funds) make better investment decisions. We work with some of the largest hedge funds in the world. As a Senior Data Engineer, you will be at the cutting edge of the alternative data space where you will help maintain and improve our data infrastructure, which enables us to develop market research products and delivery data to our customers. In this role, you would also get the opportunity to work with world-class big data and cloud services, such as: AWS, Azure, Snowflake, Databricks, DBT, Airflow, and Looker. Apply now to start taking your career to the next level.

Who we are looking for:

  • You have a strong entrepreneurial spirit and a thirst to solve difficult challenges through innovation and creativity with a strong focus on results
  • You have a passion for data and the insights it can deliver
  • You are intellectually curious with a broad range of interests and hobbies
  • You take ownership of your deliverables
  • You have excellent analytical communication and interpersonal skills
  • You have excellent communication skills with both technical and non-technical audiences
  • You can work with distributed teams situated globally in different geographies
  • You want to work in a small team with a start-up mentality
  • You can work well under pressure, prioritize work and be well organized. Relish tackling new challenges, paying attention to details, and, ultimately, growing professionally.

Responsibilities:

  • Develop robust data flows to connect and maintain large-scale data processing systems, data for analytics, and BI systems.
  • 5+ years of hands-on programming experience with Python and SQL including familiarity with stored procedures, Snowflake and dbt.
  • 5+ years of experience with PySpark to design, optimize and scale distributed data processing pipelines.
  • Experience working on data modeling.
  • Familiarity with a cloud provider (AWS, GCP, Azure) and their data infrastructure services (e.g., S3, EC2, etc.).
  • Utilize programming languages like Python or JavaScript to build robust data pipelines and implement ETL processes.
  • Ensure data quality and accessibility for end-users. Recommend ways to improve data reliability, efficiency, and quality.
  • Collaborate with data scientists, business stakeholders, and IT team members on project goals.
Qualifications
  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • 5+ years experience as a Data Engineer, Database Developer, or similar role.
  • Strong knowledge and experience with SQL Server, Stored Procedures, and OLAP BI tools.
  • Expertise in MDX or similar query languages for complex data analysis.
  • Experience in building and optimizing big data pipelines, architectures, and data sets.
  • Strong organizational skills with an ability to manage multiple projects and priorities.
  • Knowledge of Databricks, Spark, Snowflake, or Airflow will be a plus.
Additional Information
  • Enjoy a flexible and rewarding work environment with peer-to-peer recognition platforms.
  • Recharge and revitalize with help of wellness plans made for you and your family.
  • Plan your future with financial wellness tools.
  • Stay relevant and upskill yourself with career development opportunities.

Our Benefits

  • Flexible working environment
  • Volunteer time off
  • LinkedIn Learning
  • Employee-Assistance-Program (EAP)

More Info

Job Type:
Industry:
Employment Type:

About Company

Similar Jobs

3-13 yrs
Remote
Skills:
Data EngineerPythonSqlPandasBigQueryEtlDockerPolar
7-9 yrs
Pune, India
Skills:
.NETSQL ServerVisual StudioCss3Rest ApiGitjQueryJavascriptHtml5BootstrapEntity FrameworkAzureVisual Studio Code
4-8 yrs
Pune, India
Skills:
UnixWaterfallMs Sql ServerPostgreSQLSqlApplication ArchitectureLinuxDockerAgileKubernetesActimize solutionsCloud-based deployments
3-7 yrs
Pune, India
Skills:
UnixVba MacroData WarehouseSqlLinuxOracle Pl SqlMicrosoft ExcelSAS scriptingETL processesOracle ODI programmingTeradata DBA activitiesOracle DB configuration
5-7 yrs
Pune, India
Skills:
ScriptingSql DevelopmentDatabase AdministrationPostgreSQLPerformance TuningAws RdsQuery TuningDatabase MigrationViewsData MigrationSQL ServerFunctionsTriggersVersion ControlDatabase OptimizationAurora PostgreSQLTroubleshootingSchema conversionExecution plan analysisStored proceduresDatabase deployment toolsAutomation using PythonWriting and optimizing complex SQL queriesIndexing