Filled
This offer is not available anymore

Senior Data Engineer in Madrid

Airbus

Workplace
Onsite
Hours
Full-Time
Internship
No
Share offer

Job Description

Data Engineers understand how to apply technologies to solve big data problems with expert knowledge in programming languages like Java, Python, Hive, Spark, and Flink. Be an expert in designing and building data pipelines (using Kafka), and ETL (and general data wrangling) within the big data space. You will need to be analytical, a self-starter, comfortable with ambiguity in a fast-paced and ever-changing environment, and able to think big while paying careful attention to detail.


You will be using your skills and knowledge to help solve tough problems across the technology spectrum including architecting, designing, creating and, extending the data platform.

 

We also want you to continue to develop your skills and establish your public reputation. We care deeply about giving back to the data community: you will have the opportunity to attend and present at conferences, contribute to the open source community and create new generations of enterprise software.


This role sits at the epicenter of a once-in-a-generation inflection point in the evolution of our industry:

  • Unmanned aerial vehicles ("drones") are at the cusp of widespread adoption for commercial use cases.
  • Space is opening up to entrepreneurial opportunities.
  • Cyber-security and cyber-intelligence are more relevant than ever before as attacks against critical infrastructure (media, payment systems, utilities, transport etc.) come into public view.
  • Defense capabilities are being upgraded across many countries, following several decades of 'peace dividend’.


Situated under the VP Digital Platforms, this role needs to accelerate the digital transformation at Airbus Defence and Space, notably by contributing to software-led innovation and enabling revenue growth in data-as-a-service, analytics-as-a-service, and software-as-a-service business models.


Job Responsibilities

  • Work with the data scientists to refine, harden, and productionize the models developed by the team.

  • Translate complex functional and technical requirements into detailed design.

  • Design for now and future success.

  • Build infrastructure for real-time analytics and real-time predictive intelligence based on large, diverse, and dynamic data sets.

  • Apply data to solve complex problems— understanding the importance of data pipelines and quality.

  • Loading from disparate data sets. by leveraging various big data technology e.g. Kafka

  • Pre-processing using Hive, Impala, Spark.

  • Following and contributing best engineering practice for source control, release management, deployment etc.

  • Apply software testing practices to the work you do.

  • Help grow our engineering team.

  • Hadoop technical development and implementation.



Basic Qualifications

  • Degree in Computer Science, Engineering, Mathematics, or a related field or 5+ years industry experience.

  • BA/BS from a top school in Computer Science or a related technical discipline.

  • 5-8 years of Python, Java or Spark development experience.

  • 3+ years of demonstrated technical proficiency with Hadoop and big data projects.

  • 5-8 years of demonstrated experience and success in data modeling.

  • 5+ years of experience with Hadoop, Hive, Cassandra and related big data systems.

  • 3+ years of industry experience as a Data Engineer or related specialty (e.g., Software Engineer, Business Intelligence Engineer, Machine Learning Engineer, Data Scientist).

  • Experience with Python.

  • Programming experience in Java, Scala.

  • Advanced skills using one or more scripting languages (i.e. python, Unix Shell Scripts).

  • Experience in data modeling and ETL development.

  • Proficient in designing efficient and robust data workflows.

  • Experience building data pipelines. Includes data cleaning, transformation, preparation etc.

  • Experience with Kafka, Storm, and other data pipeline technologies.

  • Experience providing technical leadership and mentor other engineers for the best practices on the data engineering space.

  • Strong coordination and project management skills to handle complex projects.

  • Profound and extensive experience with cluster computing frameworks.

  • Experience building large scale distributed systems or applications.

  • Experience with building large scale frameworks or contributing to open source.

  • Strong knowledge of Agile development methodology.

  • Excellent oral and written communication skills.

  • Documenting requirements as well as resolve conflicts or ambiguities.

  • Tune Hadoop solutions to improve performance and end-user experience.

  • Experience working in teams and collaborate with others to clarify requirements.

  • Ability to setup, maintain, and implement Kafka topics and processes.

  • Good knowledge of database structures, theories, principles, and practices.

  • Analytical and problem solving skills, applied to Big Data domain.

  • Significant experience with SQL and NoSQL databases.

     

 

Preferred Qualifications

  • Track record of manipulating, processing, and extracting value from large datasets.

  • Some experience leveraging Python, R or Matlab to manipulate data and set up automated processes as per business requirements.

  • Experience with Big Data Technologies (Hadoop, Hive, Hbase, Spark, etc.).

  • Strong ability to interact, communicate, present and influence within multiple levels of the organization.


 

About Airbus

  • Aviation

  • Toulouse, France

  • 10,000+

  • 2014

.

Other data engineer jobs that might interest you...