<p>To understand the history of the figure in question it is important to understand some of the context. In the run up to the operation of advanced LIGO, it was widely expected that the first detections would come in the form of relatively weak signals, whose presence in the data could only be established by comparing with theoretical templates through <a href="https://en.wikipedia.org/wiki/Matched_filter" rel="nofollow noreferrer">matched filtering</a>. (As ended up being the case with the second event identified <a href="https://en.wikipedia.org/wiki/GW151226" rel="nofollow noreferrer">GW151226</a>.) Consequently, quite elaborate algorithms were devised to identify such events and establish their significance. While very rigorous, these methods are fairly abstract in how they treat the data.</p>
<p>The detection of GW150914 therefore came as quite a surprise. It came from a much heavier binary than most had anticipated, resulting in a much louder and shorter signal. The signal was in fact so loud that one could discern its presence by eye when looking at data. To illustrate this the following figure was included in the discovery paper (1):</p>
<p><a href="https://i.sstatic.net/UFixn.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/UFixn.png" alt="Figure 1 of (1)" /></a></p>
<p>It is important to realize that this figure was not part of rigorous statistical analysis of the data. Instead it was generated by taking some of the outputs of the rigorous analysis of the data to generate a representative waveform using numerical relativity, which was then overlayed on the data. It is my understanding that a number of steps in overlaying the waveform on the data ( like establishing various scaling
and shifts due to its sky position) where essentially done “by eye”.</p>
<p>However, the real scientific analysis of the data was done with the rigorous algorithms that had been designed beforehand, resulting in the true “money plot” of the discovery paper (1), figure 4:</p>
<p><a href="https://i.sstatic.net/FZGYI.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/FZGYI.png" alt="Figure 4 of (1)" /></a></p>
<p>While less “sexy” than Figure 1, and much harder to interpret to the layman, it is this figure that establishes beyond any reasonable doubt that the observed LIGO event was in fact the gravitational waves coming from a black hole binary merger. It is the analysis leading to this figure (and the detection of multiple later events) that lead to the awarding of the Nobel prize (not figure 1).</p>
<p>So the answers to your questions are:</p>
<ol>
<li>No the Nobel prize for gravitational waves was not handed out based on a “hand drawn theoretical curve”.</li>
<li>Rigorous fitting of the data happened already in the original discovery paper (and its companions).</li>
</ol>
<p>(1) B. P. Abbott et al. (LIGO Scientific Collaboration and Virgo Collaboration) Phys. Rev. Lett. 116, 061102 DOI: <a href="https://doi.org/10.1103/PhysRevLett.116.061102" rel="nofollow noreferrer">10.1103/PhysRevLett.116.061102</a></p>

CC BY-SA 4.0
2021-09-26T02:07:07.213Z
Thank you for your answer! I'm starting to get a better understanding of of what's going on now. One suggestion; the figures are even harder to interpret by the layman when the captions are missing. Since the 2nd figure "establishes beyond any reasonable doubt that the observed LIGO event was in fact the gravitational waves coming from a black hole binary merger" it would be great to at least have a brief discussion of what the figure represents. Is it possible to reunite it with it's caption?
uhoh
CC BY-SA 4.0
2021-09-26T02:08:00.010Z
If you're on a mobile device at the moment and you like, I can help make the edit.
uhoh
CC BY-SA 4.0
2021-09-25T23:28:14.103Z
2021-09-27T15:20:25.840Z
2021-09-27T15:20:25.840Z
TimRias
<p>This issue is a bit complex, and at its core revolves around the claim of a Copenhagen group led by Andrew Jackson that LIGO data was not handled correctly, a mislabeled plot, and some small (but since resolved) controversy regarding the transparency of LIGO science.</p>
<p>When LIGO published their initial findings, they included a plot that was, indeed, adjusted for pedagogical purposes <em>but this was not the plot that LIGO based their discovery on.</em> That key detail was misunderstood (understandably, because LIGO failed to mention that the plot was a pedagogical one in the paper) by Andrew Jackson and his team who sought to replicate the data reduction done by LIGO.</p>
<p>Following the initial claim by Andrew Jackson and his team that LIGO had not dealt with the noise in their data as they should have, two independent research groups (independent of the Danish group and of LIGO) delved in to determine why they were getting results, and essentially determined that the Copenhagen group had made a mistake.</p>
<p>Based off of independent papers released by John Moffat (et al.) and Alex Nielsen (et al.) as well as an internal investigation done by LIGO, they raised some major concerns that Andrew Jackson kind of just insulted by calling Moffat’s paper “absolute rubbish” without actually addressing the issues raised by Moffat and Nielsen. It sounds like Andrew Jackson (at the time of the article I’m referencing) wanted to prepare a response to this, but based off of an interview with Moffat it seems Jackson did not completely understand the claims Moffat was making, and the paper will likely address those misconceived notions.</p>
<p>These proceedings were important, as more transparency is always better, but it seems the vast majority of the community has moved on, accepting the errors pointed out by the three parties as sufficient reason why the Copenhagen group came out with different results. All evidence does suggest that people were quite concerned at the time, and all are even more confident now then ever before.</p>
<p>So to answer the two questions succinctly, it turned out it was done rigorously from the beginning after all, there was just a mislabeled plot and a misguided Jackson that made everyone worry for a bit.</p>
<p>To really dive deep into what led to the Copenhagen group’s mistake, see this article : <a href="https://www.quantamagazine.org/studies-rescue-ligos-gravitational-wave-signal-from-the-noise-20181213/" rel="nofollow noreferrer">https://www.quantamagazine.org/studies-rescue-ligos-gravitational-wave-signal-from-the-noise-20181213/</a></p>

CC BY-SA 4.0
2021-09-25T06:38:23.390Z
Wow thank you for the speedy and insightful answer! I'll give the Quanta article a good read.
uhoh
CC BY-SA 4.0
2021-09-25T11:22:07.070Z
Is this relevant to the question posed which is about the origins of the plot shown in the initial LIGO papers/press releases?
ProfRob
CC BY-SA 4.0
2021-09-25T15:24:12.413Z
I should have been a bit clearer about the connection; will edit for clarity
Justin T
CC BY-SA 4.0
2021-09-25T21:58:42.800Z
I don’t think that anybody with actual expertise in the subject was ever truly worried or concerned about the criticisms raised by Jackson et al.
TimRias
CC BY-SA 4.0
2021-09-25T23:18:22.960Z
The claims of Jackson et al. we’re purely signal processing related, and so while those in LIGO itself were not worried since they knew their own algorithms, those outside were unsure because of the lack of transparency with LIGO’s methods at the time of the publication Jackson et al. Since then, LIGO has become fully transparent and relieved any lingering doubts. Many interviewed during and after the fact expressed the opinion that while gravitational waves were most likely real (multi-messenger methods proved this) that they wanted more transparency from LIGO and a response to Jackson et al.
Justin T
CC BY-SA 4.0
2021-09-25T23:35:28.000Z
@JustinTackett LIGO’s methods have always been completely public, and free for anyone to download. Those asking for more transparency for the most part were simply too lazy to do so.
TimRias
CC BY-SA 4.0
2021-09-25T23:54:49.403Z
@mmeent While the noise reduction algorithms are available now, they were not always since the original publication, as seen evidenced in an interview with Duncan Brown (a member of the collaboration) who in response to Jackson et al. and their concerns said, “ It’s the kind of paper we didn’t really want to write because it’s boring and we’ve got more exciting things to do”. While many things were transparent, their noise reduction methods were not, because no one thought they needed to be. They were later published. This quote can be found in the link posted by OP.
Justin T
CC BY-SA 4.0
2021-09-25T06:32:48.060Z
2021-09-25T15:30:40.207Z
2021-09-25T15:30:40.207Z
Justin T
<p>In Sabine Hossenfelder's November 2019 video &quot;Have we really measured gravitational waves?&quot; (<a href="http://backreaction.blogspot.com/2019/11/have-we-really-measured-gravitational.html" rel="nofollow noreferrer">transcript</a>, <a href="https://youtu.be/WWTvNlfkvoI" rel="nofollow noreferrer">video</a>), Sabine mentions the now famous image of the generally agreed-upon-to-be-very-likely first direct detection of a gravitational wave. It shows the now-famous chirp as both a noisy experimental line and a smooth line which one would reflexively believe to be the theoretical model-based fit to it.</p>
<p>Sabine points out that there does not seem to be any evidence that this line is the direct result of any rigorous calculation.</p>
<blockquote>
<p>...saying it was &quot;not found using analysis algorithsm&quot; but partly done &quot;by eye&quot; and &quot;hand-tuned for pedaggical purposes.&quot; For a reference on these quotes, please check the information below the video... We should not hand out Nobel Prizes if we don't know how the predictions were fitted to the data.</p>
</blockquote>
<p>and in the notes below the video:</p>
<blockquote>
<p>&quot;Plot was made by eye&quot; quotes: <a href="https://www.newscientist.com/article/mg24032022-600-exclusive-grave-doubts-over-ligos-discovery-of-gravitational-waves/" rel="nofollow noreferrer">https://www.newscientist.com/article/mg24032022-600-exclusive-grave-doubts-over-ligos-discovery-of-gravitational-waves/</a></p>
</blockquote>
<p><strong>Questions:</strong></p>
<ol>
<li>Was the Nobel prize for gravitational waves handed out based on a hand-drawn theoretical curve?</li>
<li>Has the data been fit more rigorously now?</li>
</ol>
<p>I'd like to emphasize that the content of the video goes way beyond this one curve and covers several different and interesting aspects of current gravitational wave detection and interpretation, verification and prediction. One should listen or use the closed captions and review the whole video if the topic is of interest.</p>
<hr />
<p>Screen captures with closed-captions of relevant points</p>
<p><a href="https://i.sstatic.net/tqEIK.jpg" rel="nofollow noreferrer"><img src="https://i.sstatic.net/tqEIK.jpg" alt="Screen capture with closed-caption of Sabine Hossenfelder's November 2019 video &quot;Have we really measured gravitational waves?&quot;" /></a>
<a href="https://i.sstatic.net/4ruWx.jpg" rel="nofollow noreferrer"><img src="https://i.sstatic.net/4ruWx.jpg" alt="Screen capture with closed-caption of Sabine Hossenfelder's November 2019 video &quot;Have we really measured gravitational waves?&quot;" /></a>
<a href="https://i.sstatic.net/M5qrJ.jpg" rel="nofollow noreferrer"><img src="https://i.sstatic.net/M5qrJ.jpg" alt="Screen capture with closed-caption of Sabine Hossenfelder's November 2019 video &quot;Have we really measured gravitational waves?&quot;" /></a></p>

CC BY-SA 4.0
2021-09-25T11:02:14.997Z
"Was the Nobel prize for gravitational waves handed out based on a hand-drawn theoretical curve?" This is a ludicrous summing up of 30 years work by thousands of scientists.
ProfRob
CC BY-SA 4.0
2021-09-25T11:13:50.850Z
@ProfRob yes, the prize is generally awarded to "contributions towards the understanding of" or similar. That point alone probably makes for a good answer.
uhoh
CC BY-SA 4.0
2021-09-25T11:19:12.710Z
"We should not hand out Nobel Prizes...". AFAIK, Hossenfelder (or her audience) played no role in awarding/judging the Nobel prize and "Have we really measured Gravitational Waves?" is just clickbait.
ProfRob
CC BY-SA 4.0
2021-09-25T22:14:42.927Z
Why is the first screen capture included in this post? It contains no relevant information for this question.
TimRias
CC BY-SA 4.0
2021-09-26T02:11:45.603Z
@mmeent I've removed it
uhoh
<observational-astronomy><astrophysics><history><gravitational-waves><modeling>
Was the Nobel prize for gravitational waves handed out based on a hand-drawn theoretical curve? Has the data been fit more rigorously now?
uhoh
# Was the Nobel prize for gravitational waves handed out based on a hand-drawn theoretical curve? Has the data been fit more rigorously now?

(Asked by: username_0 on 2021-09-25)

In Sabine Hossenfelder's November 2019 video "Have we really measured gravitational waves?" ([transcript](http://backreaction.blogspot.com/2019/11/have-we-really-measured-gravitational.html), [video](https://youtu.be/WWTvNlfkvoI)), Sabine mentions the now famous image of the generally agreed-upon-to-be-very-likely first direct detection of a gravitational wave. It shows the now-famous chirp as both a noisy experimental line and a smooth line which one would reflexively believe to be the theoretical model-based fit to it.

Sabine points out that there does not seem to be any evidence that this line is the direct result of any rigorous calculation.

> ...saying it was "not found using analysis algorithsm" but partly done "by eye" and "hand-tuned for pedaggical purposes." For a reference on these quotes, please check the information below the video... We should not hand out Nobel Prizes if we don't know how the predictions were fitted to the data.

and in the notes below the video:

> "Plot was made by eye" quotes: <https://www.newscientist.com/article/mg24032022-600-exclusive-grave-doubts-over-ligos-discovery-of-gravitational-waves/>

**Questions:**

1. Was the Nobel prize for gravitational waves handed out based on a hand-drawn theoretical curve?
2. Has the data been fit more rigorously now?

I'd like to emphasize that the content of the video goes way beyond this one curve and covers several different and interesting aspects of current gravitational wave detection and interpretation, verification and prediction. One should listen or use the closed captions and review the whole video if the topic is of interest.

---

Screen captures with closed-captions of relevant points

[![Screen capture with closed-caption of Sabine Hossenfelder's November 2019 video ](https://i.sstatic.net/tqEIK.jpg)](https://i.sstatic.net/tqEIK.jpg)
[![Screen capture with closed-caption of Sabine Hossenfelder's November 2019 video ](https://i.sstatic.net/4ruWx.jpg)](https://i.sstatic.net/4ruWx.jpg)
[![Screen capture with closed-caption of Sabine Hossenfelder's November 2019 video ](https://i.sstatic.net/M5qrJ.jpg)](https://i.sstatic.net/M5qrJ.jpg)

**Tags:** observational-astronomy, astrophysics, history, gravitational-waves, modeling
> **Comments:**
> **username_1**: "Was the Nobel prize for gravitational waves handed out based on a hand-drawn theoretical curve?" This is a ludicrous summing up of 30 years work by thousands of scientists.  
> **username_0**: @ProfRob yes, the prize is generally awarded to "contributions towards the understanding of" or similar. That point alone probably makes for a good answer.  
> **username_1**: "We should not hand out Nobel Prizes...". AFAIK, Hossenfelder (or her audience) played no role in awarding/judging the Nobel prize and "Have we really measured Gravitational Waves?" is just clickbait.  
> **username_2**: Why is the first screen capture included in this post? It contains no relevant information for this question.  
> **username_0**: @mmeent I've removed it  

---

## 2 answers

### Answer by username_2 on 2021-09-25. Score: 10

To understand the history of the figure in question it is important to understand some of the context. In the run up to the operation of advanced LIGO, it was widely expected that the first detections would come in the form of relatively weak signals, whose presence in the data could only be established by comparing with theoretical templates through [matched filtering](https://en.wikipedia.org/wiki/Matched_filter). (As ended up being the case with the second event identified [GW151226](https://en.wikipedia.org/wiki/GW151226).) Consequently, quite elaborate algorithms were devised to identify such events and establish their significance. While very rigorous, these methods are fairly abstract in how they treat the data.

The detection of GW150914 therefore came as quite a surprise. It came from a much heavier binary than most had anticipated, resulting in a much louder and shorter signal. The signal was in fact so loud that one could discern its presence by eye when looking at data. To illustrate this the following figure was included in the discovery paper (1):

[![Figure 1 of (1)](https://i.sstatic.net/UFixn.png)](https://i.sstatic.net/UFixn.png)

It is important to realize that this figure was not part of rigorous statistical analysis of the data. Instead it was generated by taking some of the outputs of the rigorous analysis of the data to generate a representative waveform using numerical relativity, which was then overlayed on the data. It is my understanding that a number of steps in overlaying the waveform on the data ( like establishing various scaling
and shifts due to its sky position) where essentially done “by eye”.

However, the real scientific analysis of the data was done with the rigorous algorithms that had been designed beforehand, resulting in the true “money plot” of the discovery paper (1), figure 4:

[![Figure 4 of (1)](https://i.sstatic.net/FZGYI.png)](https://i.sstatic.net/FZGYI.png)

While less “sexy” than Figure 1, and much harder to interpret to the layman, it is this figure that establishes beyond any reasonable doubt that the observed LIGO event was in fact the gravitational waves coming from a black hole binary merger. It is the analysis leading to this figure (and the detection of multiple later events) that lead to the awarding of the Nobel prize (not figure 1).

So the answers to your questions are:

1. No the Nobel prize for gravitational waves was not handed out based on a “hand drawn theoretical curve”.
2. Rigorous fitting of the data happened already in the original discovery paper (and its companions).

(1) B. P. Abbott et al. (LIGO Scientific Collaboration and Virgo Collaboration) Phys. Rev. Lett. 116, 061102 DOI: [10.1103/PhysRevLett.116.061102](https://doi.org/10.1103/PhysRevLett.116.061102)

> **Comments:**
> **username_0**: Thank you for your answer! I'm starting to get a better understanding of of what's going on now. One suggestion; the figures are even harder to interpret by the layman when the captions are missing. Since the 2nd figure "establishes beyond any reasonable doubt that the observed LIGO event was in fact the gravitational waves coming from a black hole binary merger" it would be great to at least have a brief discussion of what the figure represents. Is it possible to reunite it with it's caption?  
> **username_0**: If you're on a mobile device at the moment and you like, I can help make the edit.  

---

### Answer by username_3 on 2021-09-25. Score: 4

This issue is a bit complex, and at its core revolves around the claim of a Copenhagen group led by Andrew Jackson that LIGO data was not handled correctly, a mislabeled plot, and some small (but since resolved) controversy regarding the transparency of LIGO science.

When LIGO published their initial findings, they included a plot that was, indeed, adjusted for pedagogical purposes *but this was not the plot that LIGO based their discovery on.* That key detail was misunderstood (understandably, because LIGO failed to mention that the plot was a pedagogical one in the paper) by Andrew Jackson and his team who sought to replicate the data reduction done by LIGO.

Following the initial claim by Andrew Jackson and his team that LIGO had not dealt with the noise in their data as they should have, two independent research groups (independent of the Danish group and of LIGO) delved in to determine why they were getting results, and essentially determined that the Copenhagen group had made a mistake.

Based off of independent papers released by John Moffat (et al.) and Alex Nielsen (et al.) as well as an internal investigation done by LIGO, they raised some major concerns that Andrew Jackson kind of just insulted by calling Moffat’s paper “absolute rubbish” without actually addressing the issues raised by Moffat and Nielsen. It sounds like Andrew Jackson (at the time of the article I’m referencing) wanted to prepare a response to this, but based off of an interview with Moffat it seems Jackson did not completely understand the claims Moffat was making, and the paper will likely address those misconceived notions.

These proceedings were important, as more transparency is always better, but it seems the vast majority of the community has moved on, accepting the errors pointed out by the three parties as sufficient reason why the Copenhagen group came out with different results. All evidence does suggest that people were quite concerned at the time, and all are even more confident now then ever before.

So to answer the two questions succinctly, it turned out it was done rigorously from the beginning after all, there was just a mislabeled plot and a misguided Jackson that made everyone worry for a bit.

To really dive deep into what led to the Copenhagen group’s mistake, see this article : <https://www.quantamagazine.org/studies-rescue-ligos-gravitational-wave-signal-from-the-noise-20181213/>

> **Comments:**
> **username_0**: Wow thank you for the speedy and insightful answer! I'll give the Quanta article a good read.  
> **username_1**: Is this relevant to the question posed which is about the origins of the plot shown in the initial LIGO papers/press releases?  
> **username_3**: I should have been a bit clearer about the connection; will edit for clarity  
> **username_2**: I don’t think that anybody with actual expertise in the subject was ever truly worried or concerned about the criticisms raised by Jackson et al.  
> **username_3**: The claims of Jackson et al. we’re purely signal processing related, and so while those in LIGO itself were not worried since they knew their own algorithms, those outside were unsure because of the lack of transparency with LIGO’s methods at the time of the publication Jackson et al. Since then, LIGO has become fully transparent and relieved any lingering doubts. Many interviewed during and after the fact expressed the opinion that while gravitational waves were most likely real (multi-messenger methods proved this) that they wanted more transparency from LIGO and a response to Jackson et al.  
> **username_2**: @JustinTackett LIGO’s methods have always been completely public, and free for anyone to download. Those asking for more transparency for the most part were simply too lazy to do so.  
> **username_3**: @mmeent While the noise reduction algorithms are available now, they were not always since the original publication, as seen evidenced in an interview with Duncan Brown (a member of the collaboration) who in response to Jackson et al. and their concerns said, “ It’s the kind of paper we didn’t really want to write because it’s boring and we’ve got more exciting things to do”. While many things were transparent, their noise reduction methods were not, because no one thought they needed to be. They were later published. This quote can be found in the link posted by OP.  

---

