Data Engineer in Madrid

Idealista

Workplace
Onsite
Hours
Full-Time
Internship
No
Share offer

Job Description

You will be joining the Dataservices team, where we produce query-able datasets in order to enable higher analytics.

 

About the Dataservices team

 

The team is in charge of maintaining a self-service data feed that enables anyone within the company to make decisions backed up by data. We clean, transform and normalize data from both internal and external sources. We orchestrate pipelines composed of multiple stages using a workflow manager, Apache Airflow. Data ingestion, data profiling, ETLs using Apache Spark are part of our daily tasks. Options to work remotely.

 

What we offer

 

  • Trust: you manage your own work schedule
  • Join a diverse and multicultural environment
  • Work with the latest open source technologies
  • A comprehensive employee benefits package
  • Permanent contract
  • Top notch office located in the city center

 

Technical skills

  • Solid Python knowledge: Pandas, PySpark
  • SQL mastery
  • Experience developing ETLs
  • Relational database and data warehousing concepts
  • Experience with version control systems, we use Git
  • Familiarity with Unix commands, a predilection for command line
  • Have a strong knowledge of the HTTP protocol
  • 2+ years of software development experience

 

Soft skills

  • You know how to translate business requirements into feasible tasks
  • Communicate with other departments on behalf of the team, providing support on how to gather insights from the existing data
  • Spot repetitive tasks and detect the underlying problem. Automate all the things.

 

Bonus points

  • Obsessed with data quality. You know how to detect outliers in a dataset.
  • You know what is data governance
  • Experience with workflow managers (Apache Airflow, Luigi, etc.)
  • Experience with Scala/Java
  • Experience with Docker
  • Familiarity with techniques and tools for crawling and transforming data
  • Know how to handle performance issues with crawling at scale and common anti-scraping protection methods
  • Have excellent communication in both spoken and written English

 

About Idealista

  • Marketplace

Idealista company page is empty
Add a description and pictures to attract more candidates and boost your employer branding.

Other data engineer jobs that might interest you...