title: WeatherBench 2: A benchmark for the next generation of data-driven
    global weather models
summary: WeatherBench 2 is an update to the global, medium-range (1-14 day) weather
  forecasting benchmark proposed by Rasp et al. (2020), designed with the aim to
  accelerate progress in data-driven weather modeling. WeatherBench 2 consists of
  an open-source evaluation framework, publicly available training, ground truth
  and baseline data as well as a continuously updated website with the latest
  metrics and state-of-the-art models:
  https://sites.research.google/weatherbench. This paper describes the design
  principles of the evaluation framework and presents results for current
  state-of-the-art physical and data-driven weather models. The metrics are based
  on established practices for evaluating weather forecasts at leading
  operational weather centers. We define a set of headline scores to provide an
  overview of model performance. In addition, we also discuss caveats in the
  current evaluation setup and challenges for the future of data-driven weather
  forecasting.
paper_authors._id: 64f0138277777df14e3a78c9
paper_authors.name: Stephan Rasp
paper_authors._id: 64f0138277777df14e3a78ca
paper_authors.name: Stephan Hoyer
paper_authors._id: 64f0138277777df14e3a78cb
paper_authors.name: Alexander Merose
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-31T12:27:00.146Z
paper_authors._id: 6313a82117838d05194fca7b
paper_authors.avatarUrl: /avatars/ab4749d69a329e8d9dbbbc7dfc7bf483.svg
paper_authors.fullname: Alex Merose
paper_authors.type: user
paper_authors.user: alxmrs
paper_authors._id: 64f0138277777df14e3a78cc
paper_authors.name: Ian Langmore
paper_authors._id: 64f0138277777df14e3a78cd
paper_authors.name: Peter Battaglia
paper_authors._id: 64f0138277777df14e3a78ce
paper_authors.name: Tyler Russel
paper_authors._id: 64f0138277777df14e3a78cf
paper_authors.name: Alvaro Sanchez-Gonzalez
paper_authors._id: 64f0138277777df14e3a78d0
paper_authors.name: Vivian Yang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-31T12:28:57.432Z
paper_authors._id: 64e81395f2f5545edaf04e5d
paper_authors.avatarUrl: /avatars/904978e34725a4641a85a4e4afcc11fe.svg
paper_authors.fullname: VivianYang
paper_authors.type: user
paper_authors.user: VivianYang
paper_authors._id: 64f0138277777df14e3a78d1
paper_authors.name: Rob Carver
paper_authors._id: 64f0138277777df14e3a78d2
paper_authors.name: Shreya Agrawal
paper_authors._id: 64f0138277777df14e3a78d3
paper_authors.name: Matthew Chantry
paper_authors._id: 64f0138277777df14e3a78d4
paper_authors.name: Zied Ben Bouallegue
paper_authors._id: 64f0138277777df14e3a78d5
paper_authors.name: Peter Dueben
paper_authors._id: 64f0138277777df14e3a78d6
paper_authors.name: Carla Bromberg
paper_authors._id: 64f0138277777df14e3a78d7
paper_authors.name: Jared Sisk
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-08-31T12:30:21.513Z
paper_authors._id: 630c1b634c0945d20b8babd4
paper_authors.avatarUrl: /avatars/9d90dc4d70901b0d4486ad2b24d43658.svg
paper_authors.fullname: Jared Siskin
paper_authors.type: user
paper_authors.user: jtsiskin
paper_authors._id: 64f0138277777df14e3a78d8
paper_authors.name: Luke Barrington
paper_authors._id: 64f0138277777df14e3a78d9
paper_authors.name: Aaron Bell
paper_authors._id: 64f0138277777df14e3a78da
paper_authors.name: Fei Sha
paper_title: WeatherBench 2: A benchmark for the next generation of data-driven
    global weather models
paper_summary: WeatherBench 2 is an update to the global, medium-range (1-14 day) weather
  forecasting benchmark proposed by Rasp et al. (2020), designed with the aim to
  accelerate progress in data-driven weather modeling. WeatherBench 2 consists of
  an open-source evaluation framework, publicly available training, ground truth
  and baseline data as well as a continuously updated website with the latest
  metrics and state-of-the-art models:
  https://sites.research.google/weatherbench. This paper describes the design
  principles of the evaluation framework and presents results for current
  state-of-the-art physical and data-driven weather models. The metrics are based
  on established practices for evaluating weather forecasts at leading
  operational weather centers. We define a set of headline scores to provide an
  overview of model performance. In addition, we also discuss caveats in the
  current evaluation setup and challenges for the future of data-driven weather
  forecasting.
paper_ai_summary: WeatherBench 2 provides an improved framework for evaluating data-driven weather forecasting models using established operational metrics and an open-source dataset.