An example of noisy outputs for the running

CoS-E v1.0 example is presented in Table 6.

Results We present results on the effect of noise
on labels in Figure 4 (E-SNLI and CoS-E v1.11
in Figure 8 of Appendix B). As expected, the
accuracy of the I→OR model (red line) and the
percent of labels in the I→OR model which have
not flipped (black line) are almost identical for all
three datasets. We present results on the effect of
noise on rationales in Figure 5 for CoS-E (E-SNLI
in Figure 9 of Appendix B).
Measuring Association Between Labels and Free-Text Rationales