Data Steward - Weather Forecasting & Climate Data

Your role

This is an exciting opportunity for a motivated individual to work at the forefront of numerical weather prediction (NWP). ECMWF generates several hundred terabytes of data every day and hosts the largest archive of meteorological data (around 1 exabyte) in the world. We are entering an exciting and challenging period in NWP. One aspect includes the rapid growth of machine learning applications adding new dimensions and requirements on data management. Another aspect is the technological challenge of reliably storing vast amounts of data, accessible to diverse users, on future storage media taking account of uncertainties in the market.

As Data Steward – Weather Forecasting & Climate Data you will be responsible for improving the processes and activities associated with the substantial amounts of data created by ECMWF. This will include designing, developing and maintaining the necessary databases and software to enable ECMWF and its users to have a clear oversight of their data, and to effectively manage its lifecycle with a clear view to reducing the volume of data holdings. This role will require collaborating with many stakeholders, both inside and outside of ECMWF, on matters of data usage and management, including advising on the efficient use of current resources, the collection of future storage requirements and the planning of future necessary storage resources. This role will also play a significant part in determining future data storage strategies at ECMWF. Additionally, the successful candidate will have the opportunity to contribute to other areas of data management and governance.

The position sits in the Data Archives and Dissemination Services (DADS) Team within the Production Services Section. The DADS team is responsible for the management of the Archives, such as the Meteorological Archival and Retrieval System (MARS) and the ECMWF File Storage system (ECFS), the online Fields DataBase (FDB) and the generation and dissemination of ECMWF’s products. The Production Services Section is responsible for the operational production services of ECMWF, including in the framework of DestinE and of the Copernicus services, working closely with teams across the organisation to maintain, develop and manage the operational forecasting systems and associated data services.

About ECMWF

The European Centre for Medium-Range Weather Forecasts (ECMWF) is a world-leader in weather and environmental forecasting. As an international organisation we serve our members and the wider community with global weather predictions and data that is critical for understanding and solving the climate crisis. We function as a 24/7 research and operational centre with a focus on medium and long-range predictions, holding one of the largest meteorological data archives in the world. The success of our activities builds on the talent of our scientists and experts, strong partnerships with 35 Member and Co-operating States and the international community, some of the most powerful supercomputers in the world, and the use of innovative technologies and machine learning across our operations. ECMWF is a multi-site organisation, with a main office in Reading, UK, a data centre/supercomputer in Bologna, Italy, and a large presence in Bonn, Germany.  

ECMWF has also developed a strong partnership with the European Union and has been entrusted with the implementation and operation of the Destination Earth Initiative and the Climate Change and Atmosphere Monitoring Services of the Copernicus Programme. Other areas of work include High Performance Computing (HPC) and the development of digital tools that enable ECMWF to extend provision of data and products covering weather, climate, air quality, fire and flood prediction and monitoring. 

For additional detail about ECMWF, see www.ecmwf.int

Main duties and key responsibilities

• Design, develop and maintain databases and software tools for staff and external users to measure and control their use of the data archive
• Work closely with ECMWF and Member States staff to understand and improve their use of the Data Archives
• Create and continuously improve policies, processes and guidance on use of ECMWF's Data Archives in close collaboration with teams managing archives, i.e. MARS and ECFS teams, in Forecast and Services Department as well as the Storage team of the Computing Department
• Analyse current processes and operational practices and suggest improvements to workflows. For example, define and enforce retention periods for Research experiments, identification and deletion of unused data or contain the growth in number of files in the Archives
• Work with project owners and managers to provide projections for anticipated usage of the data archive by their projects. Make projections based on Annual plan, 4 Year plan and 10 Year Strategy
• Be responsible for ongoing analysis of ECMWF and Member State usage of Data Archives and alerting users/management to deviations from forecasts.
• Produce costing models to help anticipate the cost of storage requirements for new projects
• Actively participate in existing working groups responsible for the Archives, support ECMWF’s data storage strategy and contribute to data governance initiatives

What we're looking for

• Excellent interpersonal and communication skills are vital, to communicate with a wide range of technically skilled colleagues at ECMWF and in partner organisations, also to non-technical staff
• Dedication and enthusiasm to work as part of a team, taking initiative to work collaboratively with other team members and project partners
• Ability to at times work independently, but to know when it is important to seek advice
• Excellent analytical and problem-solving skills with a proactive continuous improvement approach, in particular addressing data-related challenges
• Ability to work with precision and care and having a good awareness of the need to test thoroughly and document changes appropriately
• Ability and willingness to collaborate with internal and external experts on related aspects of governance and exchange of data for machine learning applications
• Active listener who seeks and respects the views of others
• Highly organised with the capacity to work on a diverse range of tasks to tight deadlines
• Flexibility, with a willingness to adapt plans if partner organisations work at different paces, and if priorities shift over time

Education

• A university degree (EQF Level 6 or above) or equivalent professional experience is required

Experience

• Experience curating and managing large, complex and growing digital data holdings required
• Programming skills with Python and scripting languages (such as Bash) in a UNIX/Linux environment required
• Experience with database management systems and data querying languages
• Experience with developing and enforcing data policies, standards and best practices required

Knowledge and skills

The following skills and experience would be an advantage. However, you are encouraged to apply even if you don’t feel you meet all these criteria. 

• Experience in an operational numerical weather prediction centre
• A proven track record in the design and implementation of both SQL and NoSQL databases
• Familiarity with big-data analytics, cloud technologies and machine learning fundamentals
• Knowledge of meteorological modelling and experience working with scientists in a similar environment would be an advantage
• Knowledge of standardised meteorological data formats for international exchange

Candidates must be able to work effectively in English . A good knowledge of one of the Centre’s other working languages (French or German) is an advantage.

Other information

Grade remuneration    The successful candidate will be recruited at the A2 grade, according to the scales of the Co-ordinated Organisations. ECMWF also offers a generous benefits package, including a flexible teleworking policy. The position is assigned to the employment category STF-PL as defined in the ECMWF Staff Regulations. Full details of salary scales and allowances available on the ECMWF website at www.ecmwf.int/en/about/jobs, including the ECMWF Staff Regulations and the terms and conditions of employment.

Starting date:               1st March 2025

Contract duration:      3 years with the possibility of further contract extensions in the future depending on requirements and funding availability.

Location:                       Reading, UK  (Candidates are expected to relocate to the duty station)

As a multi-site organisation, ECMWF has adopted a hybrid working model that allows flexibility to staff to mix office working and teleworking. We allow for remote work 10 days/month away from the office, including up to 80 days/year away from the duty station country (within the area of our member states and co-operating states).

Successful applicants and members of their family forming part of their households will be exempt from immigration restrictions.

Interviews will take place via videoconference (MS Team).  If you require any special accommodations in order to participate fully in our recruitment process, please contact us via email:  jobs@ecmwf.int

Who can apply 

Applicants are invited to complete the online application form by clicking on the apply button below. 

At ECMWF, we consider an inclusive environment as key for our success. We are dedicated to ensuring a workplace that embraces diversity and provides equal opportunities for all, without distinction as to race, gender, age, marital status, social status, disability, sexual orientation, religion, personality, ethnicity and culture. We value the benefits derived from a diverse workforce and are committed to having staff that reflect the diversity of the countries that are part of our community, in an environment that nurtures equality and inclusion. 

Applications are invited from nationals from ECMWF Member States and Cooperating States, listed below, as well as from all EU Member States:

ECMWF Member and Co-operating States are: Austria, Belgium, Bulgaria, Croatia, Czech Republic, Denmark, Estonia, Finland, France, Hungary, Germany, Georgia, Greece, Iceland, Ireland, Israel, Italy, Latvia, Lithuania, Luxembourg, Montenegro, Morocco, the Netherlands, Norway, North Macedonia, Portugal, Romania, Serbia, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey and the United Kingdom.

In these exceptional times, we also welcome applications from Ukrainian nationals for this vacancy.  

Applications from nationals from other countries may be considered in exceptional cases.