This company in the scientific publishing sector, dedicated to developing an open-source platform, is looking for a Senior Data Engineer that helps us to design and build a new generation of tools that will transform open-access publishing.
As a Senior Data Engineer, you will be responsible for optimizing or even re-designingdata architecture to support our next generation of product features and data initiatives. You will be expanding and optimizing our data pipeline architecture, as well as optimizing data flow and collection.
The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing existing data systems or building them from the ground up. You will work together with other data engineers, software developers, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.
Work closely with IT Architects to provide overall consistent and reliable data solutions for all the applications’ ecosystem.
Design, implement, monitor, and optimice our data platforms to meet the data pipeline needs.
Understand the functional requirements for defining the best data models and data flows between our applications, services, data storage and synchronization mechanisms.
Integrate, transform, and consolidate data from various structured and unstructured data systems into structures that are suitable for building analytics solutions.
Support the different SW development teams in the modelling, design, construction, evolution, and decommission of their data-intensive applications and data models.
Understand and promote the best Data frameworks and solutions, technical standards and key technologies, to effectively support existing and future business requirements.
Collaborate closely with Machine Learning and Data Science Team to improve the performance of our ML pipelines.
Databricks (Python & Spark or PySpark).
Azure Data Factory.
Experience with ETLs/ELT.
Experience with Data Modelling.
Understanding of big data principles and ability to implement these (volume, velocity, variety, veracity and value).
Expertise in data processing.
Ability to prioritise.
Familiarity with Agile framework.
Good English skills.
What they offer
Really senior colleagues in all fields of IT, you will learn new things every single day.
Exciting projects, you’ll work on different applications and features throughout the year.
25 annual leave days + 4 well-being days.
Participation in the annual company bonus scheme.
Flexible working framework.
Remote working across Spain.
On-off bonus to set up your workspace at home.
If you ever come to the office, we have top-notch facilities.
Extensive learning opportunities.
A monthly social Happy Hour to share beers and tapas with colleagues.