Senior Data Engineer en Barcelona

Netquest

Lugar de trabajo
En sede
Horas
Full-Time
Prácticas
false
Habilidades
Comparte la oferta

Descripción de la oferta

Netquest is among the most advanced and innovative digital data collection specialists worldwide in the market research and analytics industry. We currently have more than 2,000,000 consumers willing to share their behavioral data and give us their opinion in 27 countries.

Our ambition is to be the most reliable, flexible and powerful data source in the market, and contribute to the future of market research through automation and innovation.

Job description

About the company

 

Netquest is among the most advanced and innovative digital data collection specialists worldwide in the market research and analytics industry. Our mission is to enable our customers to make confident business decisions. We provide insights and actionable recommendations by combining our data, market research heritage, and technical prowess in data analytics and machine learning.

 

Our ambition is to be the most reliable, flexible and powerful data source in the market, and contribute to the future of market research through automation and innovation.

 

Job Description  

Netquest is among the most advanced and innovative digital data collection specialists worldwide in the market research and analytics industry. Our mission is to enable our customers to make confident business decisions. We provide insights and actionable recommendations by combining our data, market research heritage, and technical prowess in data analytics and machine learning.

 

Our ambition is to be the most reliable, flexible and powerful data source in the market, and contribute to the future of market research through automation and innovation.

Netquest is looking for a talented Data Engineer to join our team. As part of a growing Data & Analytics team you will work to grow and expand our data platform to solve our current and future challenges. You will be working with clickstream data generated by our users to optimally provide it for both our internal and external customers, transforming huge log data sources into final products.

 

The main responsibilities of the all team are:

  • Design, evolve and maintain the data platform that ingests, stores, processes and exploits data from disparate data sources
  • Design, build, and maintain processes and components of ETL/ELT pipelines to support both real-time & batch analytics.
  • Govern all data ingested by the platform and define and implement the data models that support the different analytics needs.

 

Your main responsibilities will be:

  • Understand current and future needs of the clickstream data
  • Take ownership of current pipelines to evolve and maintain them
  • Analyze the data requirements and define the needed data sources, formats, extraction frequency, etc.
  • Evaluate current Data Architecture of certain pipelines, and propose solutions to improve them
  • Automation: use of tools like Apache Airflow, AWS Batch or AWS Lambda and bash scripts for the automated management of the data pipeline.
  • Data governance: be able to organize and maintain a data lake (AWS S3) and/or a Data Warehouse so that it does not become a data swamp

 

We offer you:

  • challenging project, where you can learn new things every day and show the team what you’ve got.
  • The possibility to be part of talented team, working with highly skilled individuals.
  • nice place to work, where we foster training, as well as professional and personal development.
  • Flex Office:a mix of remote and in-office work to boost our productivity and promote a work-life balance
  • Flexible retribution: meal and transport tickets, kindergarten cheques and/or private health insurance
  • And free coffee and fresh fruit once a week.

At Netquest, we’re a team in constant growth. Currently, we’re more than 270 people coming from 27 nationalities. We’re committed to equal employment opportunities and we strive to be a more equal opportunity workplace day by day.

 

 

 

Requirements

  • You have at least 3 to 5 years of experience as a Data Engineer working on AWS
  • You’re an ace at data modeling, able to keep into account the needs of multiple users and can code SQL in your sleep, optimizing queries for performance and maintainability
  • You are knowledgeable with various ETL/ELT techniques and frameworks
  • You have experience designing data architecture for Big Data
  • You are able to work-out effective solutions under uncertain or ambiguous circumstances
  • You’re always willing to learn something new and embrace a healthy debate.

It’s a bonus if you have:

  • Experience with streaming platforms like Kafka or Aws Kinesis.
  • Experience with Apache Spark or Hadoop.
  • Experience with orchestration tools like Airflow or Luigi.
  • Experience with AWS Glue and AWS EMR
  • Experience with AWS Redshift or other MPPs.
  • Some experience working with agile methodologies (Scrum/Kanban).

 

Acerca de Netquest

  • Big Data

  • Barcelona, Spain

  • 200-500

  • 2001

Netquest is among the most advanced and innovative digital data collection specialists worldwide in the market research and analytics industry. We currently have more than 2,000,000 consumers willing to share their behavioral data and give us their opinion in 27 countries.

Our ambition is to be the most reliable, flexible and powerful data source in the market, and contribute to the future of market research through automation and innovation.

Otras ofertas de ingeniero de datos que podrían interesarte...