## How accurately we know the standard 252 Cf(sf) neutron multiplicity?

R. Capote, GLYPH&lt;3&gt; and D. Neudecker y

GLYPH&lt;3&gt; NAPC-Nuclear Data Section, International Atomic Energy Agency, Vienna, Austria, r.capotenoy@iaea.org y Los Alamos National Laboratory, Los Alamos, NM 87545, USA

## INTRODUCTION

Statistical evaluation methods of nuclear data have been investigated over several decades [1], but the dramatic increase in computer power over the last decade has allowed development of powerful stochastic nuclear data evaluation methods [2]. Pioneering works of D.L. Smith on the Unified Monte Carlo (UMC-G) method [3, 4] have been followed by the development of Backward-Forward Monte Carlo [5], UMC-B [6] and Bayesian Monte Carlo [7]. These evaluation techniques rely on the Bayes theorem (except the BFMC) for combining the experimental data with the physical constraints embedded in nuclear reaction models. Another Bayesian techniquethe generalized least-square method (GLSQ)-remains the workhorse of nuclear data evaluation, especially when nonmodel evaluation is used for cases when the available experimental database is comprehensive. One extremely important case is the evaluation of the Neutron Data Standards [8, 9].

All evaluation techniques rely on the quality and completeness of the input data used in the selected evaluation method, in particular of the experimental data that drive down our nuclear data uncertainties. This is even more important for non-model evaluations as is the case of Neutron Data Standards, where evaluated uncertainties depend exclusively on the assessed uncertainties of the experimental data used as input to the evaluation.

Small uncertainties obtained for the neutron cross-section standards [8] have been associated with possible missing correlations in the input data, with an incomplete uncertainty budget of the employed experimental database [10] or with unrecognized uncertainty sources common to many measurements. While further detailed studies may improve the first two issues, the issue of potential unrecognized uncertainties and correlations between di GLYPH&lt;11&gt; erent experiments has long been neglected. The goal of this short contribution is to address this gap; the selected test-case study is the evaluation of the total neutron multiplicity ( GLYPH&lt;23&gt; tot ) of the 252 Cf(sf) source, which is included in the evaluation of the Thermal Neutron Constants [9, 11].

## EXPERIMENTAL DATABASE

The experimental database used by Axton [12] in the evaluation of GLYPH&lt;23&gt; tot of 252 Cf(sf) is listed in Table 1. Three di GLYPH&lt;11&gt; erent experimental methods have been used in those measurements as detailed by Divadeenam and Stehn [13]: scintillator detectors, Mn-bath measurements and Boron pile (B-pile) measurements. Some evidence existed that scintillation measurements produce systematically higher GLYPH&lt;23&gt; tot values as seen in Table 1 [13]. However, the calculated 252 Cf(sf) GLYPH&lt;23&gt; tot mean value for scintillation detector measurements is equal to 3 7718 : GLYPH&lt;6&gt; 0 0169, which : is higher by just 0.2% than those corresponding to the Mn-bath detection (3 7643 : GLYPH&lt;6&gt; : 0271). For the two existing Boron-pile measurements the derived mean value is 0.5% lower than those measured by scintillator detectors, which suggest di GLYPH&lt;11&gt; erent systematic uncertainties between di GLYPH&lt;11&gt; erent measurement techniques. Note that both Divadeenam and Stehn [13] and also Axton [12] assumed that all 252 Cf(sf) multiplicity measurements are basically independent measurements . This is the key assumption that we are questioning in this paper.

TABLE I. Fifteen data points used to determine the unrecognized systematic uncertainty for the evaluated GLYPH&lt;23&gt; tot of 252 Cf(sf). References for these data can be found in the report by Axton [12].

|   N GLYPH<14> | Author          | Year      | Value (Uncert.)   | Method   |
|---------------|-----------------|-----------|-------------------|----------|
|             1 | Asplund         | 1963      | 3.7910 (1.066%)   | scintil. |
|             2 | Hopkins         | 1963      | 3.7767 (0.838%)   | scintil. |
|             3 | Boldeman        | 1977      | 3.7549 (0.431%)   | scintil. |
|             4 | Zhang           | 1981      | 3.7534 (0.490%)   | scintil. |
|             5 | Spencer         | 1982      | 3.7831 (0.221%)   | scintil. |
|             6 | Colvin / Axton* | 1966      | 3.7299 (0.806%)   | Mn-bath  |
|             7 | DeVolpi         | 1970 / 72 | 3.7507 (0.463%)   | Mn-bath  |
|             8 | White*          | 1968      | 3.8194 (1.033%)   | Mn-bath  |
|             9 | Axton           | 1985      | 3.7547 (0.300%)   | Mn-bath  |
|            10 | Bozorgmanesh    | 1977      | 3.7475 (0.580%)   | Mn-bath  |
|            11 | Spiegel         | 1981      | 3.7828 (0.759%)   | Mn-bath  |
|            12 | Aleksandrov     | 1981      | 3.7618 (0.483%)   | Mn-bath  |
|            13 | Smith           | 1984      | 3.7678 (0.303%)   | Mn-bath  |
|            14 | Colvin / Ullo   | 1965      | 3.7405 (0.438%)   | B-pile   |
|            15 | Edwards         | 1982      | 3.7641 (0.711%)   | B-pile   |

The standard value of GLYPH&lt;23&gt; tot for 252 Cf(sf) was derived using the whole database for all fissile nuclei and is equal to 3 764 : GLYPH&lt;6&gt; 0 005 (0 13%) [11]. This value is identical to the one derived : : from the GLSQ fit of the fifteen experiments listed in Table 1, if we assume that all experiments are independent. This is not surprising as measurements of neutron multiplicity of 252 Cf(sf) are among the most accurate neutron measurements featuring the lowest achievable uncertainty. Evaluated mean value and the corresponding standard deviation are represented in Fig. 1 by dashed red lines and compared to all measurements and corresponding uncertainties listed in Table 1. It is observed that the spread of measured mean values is much larger than the standard deviation of 0.13% derived from a GLSQ fit (red dashed lines). The derived uncertainty band does not overlap with Spencer 1982 measurement (set 5 in Fig. 1) that features the lowest uncertainty.

On the other side, if we calculate the un-weighted mean value and the standard deviation of the fifteen un-weighted measured data listed in Table 1 we obtain 3 765 : GLYPH&lt;6&gt; 0 023 (0.6%). : The un-weighted fit produces a larger standard deviation of 0.6% (blue dashed lines in Fig. 1) which better reflects the

Fig. 1. Plot of the fifteen measured points of the GLYPH&lt;23&gt; tot of 252 Cf(sf) with uncertainties. Red dashed line denoted the mean value and 1-sigma uncertainty band from the GLSQ fit. Blue dashed lines show the uncertainty bands if USU is added.

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00272v1-figure-33fb9fe5-0e01-4b3f-900d-785cf35a66bf.jpg)

observed spread in measured values. This larger uncertainty is strongly reduced by a factor of 1 = p 15 in the weighted leastsquare fit due to the assumption that all N = 15 measurements are practically independent. Indeed, the derived GLSQ uncertainty of 0 005 : GLYPH&lt;25&gt; 0 023 : = p 15. No matter how detailed and complete the uncertainty budget of individual measurements listed in Table 1 be, as long as those measurements are assumed to be independent, the resulting evaluated uncertainty will be too small due to sheer number of input data sets (N = 15) [14].

What could be the origin of the correlations that may keep the evaluated uncertainty above some minimum threshold, independent of the number of measurements? Obviously, an unknown systematic uncertainty, or as D. Rumsfeld defined it, an unknown unknowns 1 .

The unknown (or unrecognized [15, 16, 17]) systematic uncertainty (USU) can de defined as a minimum uncertainty that can be achieved using a given experimental method (or measuring tool). It does not matter how many times the measurements are repeated, it does not matter who is doing the measurement, or where those measurements are carried out. As long as we use the same experimental technique, then we can not get a result with lower uncertainty than USU. An interesting consequence is that we need measurements using new experimental methods as the way of estimating these unknown systematic uncertainties.

Authors of Neutron Standard evaluations [8, 9, 16] have investigated the unknown systematic uncertainties (USU) based on the unrecognized uncertainty-estimation method [15, 16, 17]. Each of the cross sections evaluated (and also the 252 Cf(sf) neutron multiplicity) had the normalization quantities for absolute measurements (or the measurements itself)

1 D. Rumsfeld stated: 'Reports that say that something hasn't happened are always interesting to me, because as we know, there are known knowns; there are things we know we know. We also know there are known unknowns; that is to say we know there are some things we do not know. But there are also unknown unknowns the ones we don't know we don't know. . . , it is the latter category that tend to be the di GLYPH&lt;14&gt; cult ones.'

statistically analyzed to obtain the standard deviation of that distribution. The value of the derived standard deviation was assumed as the normally-distributed type B uncertainty [18] that is equal to the USU. An additional assumption was made in the Neutron Standard analysis that the USU is not energy dependent [9].

We have demonstrated in the Appendix that this assumption is only valid for a one dimensional case. In other words, once the USU is estimated a new least-square fit is needed, except for the case when only a one-dimensional quantity is evaluated. Therefore, an updated Neutron Standard evaluation may be required. Further work on this particular issue is warranted, but the neutron multiplicity of 252 Cf(sf) is a one dimensional quantity. The USU of the 252 Cf(sf) GLYPH&lt;23&gt; tot estimated in the Neutron Standards [9] was equal to 0.4% as two outlier values (marked by * in Table 1) were discarded. If we consider all experimental values a larger USU of 0.6 % is obtained.

The most important consequence of the introduced USU for the 252 Cf(sf) GLYPH&lt;23&gt; tot evaluation is the fact that the USU also determines full cross-correlations between unrecognized uncertainties of di GLYPH&lt;11&gt; erent experiments. This estimate represents a conservative uncertainty assessment.

## CONCLUSIONS

The unknown systematic uncertainty (USU) for neutron multiplicity of the 252 Cf(sf) is estimated from the measured values to be 0.6% if the whole experimental database is used. This value is a conservative estimate of the achievable uncertainty. The estimated USU can be interpreted as a common (unknown) systematic uncertainty for all experiments leading to inter-experiments correlations.

## ACKNOWLEDGMENTS

Extensive discussions with V.G. Pronyaev and A. D. Carlson provided significant insight on the use of the unrecognized uncertainty method in the evaluation of Neutron Standards.

## REFERENCES

- 1. D.L. Smith, 'Probability, Statistics, and Data Uncertainties in Nuclear Science and Technology,' American Nuclear Society, LaGrange Park, IL, USA (1991).
- 2. R. Capote, D. L. Smith, A. Trkov, 'Nuclear Data Evaluation Methodology Including Estimates of Covariances,'EPJ W eb of C onf . 8 , 04001 (2010).
- 3. D.L. Smith, 'A Unified Monte Carlo Approach to Fast Neutron Cross Section Data Evaluation,' in P roceedings of the 8 th I nternational T opical M eeting on N uclear A pplications and U tilization of A ccelerators , Pocatello, ID, July 29-Aug 2, 2007, p. 736
- 4. R. Capote and D.L. Smith, 'An Investigation of the Performance of the Unified Monte Carlo Method of Neutron Cross Section Data Evaluation,'N ucl . D ata S heets 109 , 2768 (2008).
- 5. E. Bauge, P. Dossantos-Uzarralde, 'Evaluation of the covariance matrix of Pu-239 neutronic cross sections in the continuum using a Backward-Forward Monte Carlo

method,' J. K or . P hys . S oc . 59 , 1218 (2011).

- 6. R. Capote, D.L. Smith, A. Trkov, M. Meghzifene, J. ASTM I nt . 9 , 104115 (2012).
- 7. A.J. Koning, 'Bayesian Monte Carlo method for nuclear data evaluation,' EPJ A51 , 184 (2015).
- 8. A. D. Carlson, V. G. Pronyaev, D. L. Smith et al. , 'International Evaluation of Neutron Cross Section Standards,' N ucl . D ata S heets 110 , 3215-3324 (2009).
- 9. A. D. Carlson, V. G. Pronyaev, R. Capote et al. , 'Evaluation of Neutron Data Standards,' N ucl . D ata S heets 148 , 142187 (2018).
- 10. D. Neudecker, B. Hejnal, F. Tovesson, M. C. White, D. L. Smith, D. Vaughan, and R. Capote, 'Template for estimating uncertainties of measured neutron-induced fission cross-sections,'presented at Covariance workshop in Aixen-Provence, October 2017; EPJ W eb of C onf . , accepted for publication in 2018.
- 11. V. G. Pronyaev, R. Capote, A. Trkov, G. Noguere, and A. Wallner, 'New fit of thermal neutron constants (TNC) for 233 235 ; U, 239 241 ; Pu and 252 Cf(sf): Microscopic vs. Maxwellian data,' EPJ W eb of C onf . 146 , 02045 (2017).
- 12. E.J. Axton, 'Evaluation of the thermal constants of 233 U, 235 U, 239 Pu and 241 Pu, and the fission neutron yield of 252 Cf,' Report GE PH 01 86 / / / (Central Bureau for Nuclear Measurements, Geel 1986).
- 13. M. Divadeenam and J.R. Stehn, 'A least-squares evaluation of thermal data for fissile nuclei,' A nn . N ucl . E nergy 11 , 375 (1984).
- 14. D. Neudecker, R. Capote and H. Leeb 'Impact of model defect and experimental uncertainties on evaluated output,' N ucl . I nstr . M ethods A 723 , 163-172 (2013).
- 15. S.A. Badikov, E.V. Gai, M.A. Guseynov and N.S. Rabotnov, 'Nuclear data processing, evaluation, transformation and storage with Padé-approximants,'Proc. Int. Conf. Nuclear Data for Science and Technology, Jülich, Germany, 1991, ed: S.M. Qaim, 182-187 (1992) Springer-Verlag, Berlin.
- 16. S.A. Badikov, E.V. Gai, 'Some Sources of the Underestimation of Evaluated Cross-section Uncertainties,' INDC(NDS)-438 (IAEA, Vienna 2003), pp. 117129. Available online at https://www-nds.iaea.org/ publications/indc/indc-nds-0438.pdf .
- 17. E.V. Gai, 'On the Problem of Ambiguity of the Evaluated Nuclear Data Uncertainties,' V opr . A tom . N auki i T ech ., S er . N ucl . C onstants , issue 1-2, pp. 45-55 (2007); in Russian.
- 18. JCGM 100, 'Evaluation of measurement data: Guide to the expression of uncertainty in measurement,' BIPM publication available at https://www.bipm.org/utils/ common/documents/jcgm/JCGM\_100\_2008\_E.pdf (2008).
- 19. J. Sherman and W.J. Morrison, 'Adjustment of an Inverse Matrix Corresponding to a Change in One Element of a Given Matrix,'A nn . of M ath . S tatist ., 21, 124-127 (1950).

## APPENDIX

In the evaluation of Neutron Data Standards [9], the USU uncertainty was added a-posteriori to the evaluated uncertain- ties obtained by the GLSQ fit. Here, we show that adding the USU a-posteriori to the evaluated mean values rather than apriori does not change the evaluated mean value and variance if one evaluates one data point only while this does not hold true for evaluating multiple data points.

If only one observable (e.g., the 252 Cf GLYPH&lt;23&gt; tot ) is evaluated using a vector of experimental data r j and an associated covariance matrix with elements Cij , GLSQ gives an evaluated mean value GLYPH&lt;26&gt; and a variance var( GLYPH&lt;26&gt; ) by:

$$\rho & = \sum _ { i j } ( C ^ { - 1 } ) _ { i j } r _ { j } / \sum _ { i j } ( C ^ { - 1 } ) _ { i j }, \quad \quad ( 1 ) \\ \text{var} ( \rho ) & = 1. 0 / \sum _ { i j } ( C ^ { - 1 } ) _ { i j }.$$

For simplicity, we assume that the original covariance matrix (i.e., without the USU) is diagonal such that C o i j = GLYPH&lt;14&gt; i j GLYPH&lt;27&gt; 2 i with GLYPH&lt;14&gt; ii = 1 and 0 if i , j . This assumption was also made for the evaluation of Axton. If the USU variance GLYPH&lt;27&gt; 2 USU is added a-posteriori in quadrature to the variance evaluated with C o i j in Eq. (1), the a-posteriori variance and mean value read:

$$\mu _ { 0 } \quad & \nu ( \rho ) ^ { p o s t } & = 1. 0 / \sum _ { i } ( \sigma _ { i } ^ { - 2 } ) + \sigma _ { U S U } ^ { 2 } = \sigma _ { o } ^ { 2 } + \sigma _ { U S U } ^ { 2 }, \quad ( 2 ) \\ \rho ^ { p o s t } & = \sigma _ { o } ^ { 2 } \sum _ { i } r _ { i } \sigma _ { i } ^ { - 2 }. \\ \mu _ { 0 }$$

If GLYPH&lt;27&gt; 2 USU is applied a-priori to the experimental covariance matrix for Eq. (1) turns into C p i j = GLYPH&lt;14&gt; i j GLYPH&lt;27&gt; 2 i + GLYPH&lt;27&gt; 2 USU = C o i j + GLYPH&lt;27&gt; 2 USU . If one uses the Sherman-Morrison formula [19] to invert C p i j and uses Eq. (1) to obtain an evaluated mean value and variance, one obtains the same equations as in Eq. (2).

If one evaluates multiple observables (i.e., a vector # GLYPH&lt;20&gt; GLYPH&lt;26&gt; ) based on multiple experiments for each observable stored in a vector # GLYPH&lt;20&gt; r and an associated covariance matrix C , Eq. (1) turns into:

$$\vec { \rho } & = \text{Cov} ( \vec { \rho } ) S ^ { T } C ^ { - 1 } \vec { r }, \quad \quad ( 3 ) \\ \text{Cov} ( \vec { \rho } ) & = \left ( S ^ { T } C ^ { - 1 } S \right ) ^ { - 1 }.$$

For simplicity, we assume to evaluate two data points GLYPH&lt;26&gt; a and GLYPH&lt;26&gt; b based on a transposed vector # GLYPH&lt;20&gt; r T = ( ra ; 1 ; GLYPH&lt;1&gt; GLYPH&lt;1&gt; GLYPH&lt;1&gt; ; ra N ; ; rb ; 1 ; GLYPH&lt;1&gt; GLYPH&lt;1&gt; GLYPH&lt;1&gt; ; rb N ; ) and a transposed design matrix

$$\mathbf S ^ { T } = \begin{bmatrix} 1 & \cdots 1 & 0 & \cdots & 0 \\ 0 & \cdots 0 & 1 & \cdots & 1 \end{bmatrix}.$$

Again the original covariance matrix C o (i.e., without the USU) is diagonal with variances GLYPH&lt;27&gt; 2 a ; 1 ; GLYPH&lt;1&gt; GLYPH&lt;1&gt; GLYPH&lt;1&gt; ; GLYPH&lt;27&gt; 2 a N ; ; GLYPH&lt;27&gt; 2 b ; 1 ; GLYPH&lt;1&gt; GLYPH&lt;1&gt; GLYPH&lt;1&gt; ; GLYPH&lt;27&gt; 2 b N ; . If the USU variance GLYPH&lt;27&gt; 2 USU is added a-posteriori in quadrature to the covariance matrix evaluated with C o i j in Eq. (3), the a-posteriori covariance and mean values read:

$$\vec { \rho } ^ { p o s t } = \begin{bmatrix} \sigma _ { a, o } ^ { 2 } & 0 \\ 0 & \sigma _ { b, o } ^ { 2 } \end{bmatrix} \begin{bmatrix} \sum _ { i } r _ { a, i } \sigma _ { a, i } ^ { - 2 } \\ \sum _ { i } r _ { b, i } \sigma _ { b, i } ^ { - 2 } \end{bmatrix}, \quad ( 4 ) \\ \text{Cov} ( \vec { \rho } ^ { p o s t } ) = \begin{bmatrix} \sigma _ { a, o } ^ { 2 } + \sigma _ { U S U } ^ { 2 } & \sigma _ { U S U } ^ { 2 } \\ \sigma _ { U S U } & \sigma _ { b, o } ^ { 2 } + \sigma _ { U S U } ^ { 2 } \end{bmatrix}.$$

If GLYPH&lt;27&gt; 2 USU is applied a-priori to the experimental covariance matrix for Eq. (3), one adds to all elements of C o the term GLYPH&lt;27&gt; 2 USU and obtains C p . If one uses the Sherman-Morrison formula [19] to invert C p and uses Eq. (3) to obtain an evaluated mean value and variance, one obtains di GLYPH&lt;11&gt; erent mean values and covariances compared to Eq. (4), namely:

$$\vec { \rho } ^ { p } = \vec { \rho } ^ { p o s t } + \begin{bmatrix} \sigma _ { U S U } ^ { 2 } \left ( s _ { a } + s _ { b } \right ) \sigma _ { a, o } ^ { 2 } \sum _ { i } r _ { a, i } \sigma _ { a, i } ^ { - 2 } - r _ { 0 } \right ) \\ \sigma _ { U S U } ^ { 2 } \left ( ( s _ { a } + s _ { b } ) \sigma _ { b, o } ^ { 2 } \sum _ { i } r _ { b, i } \sigma _ { b, i } ^ { - 2 } - r _ { 0 } \right ) \end{bmatrix}, \\ r _ { i } \, \gamma _ { i } \, \gamma _ { i }$$

$$\text{Cov} ( \vec { \rho } ^ { p } ) = [ 1 + \sigma _ { U S U } ^ { 2 } ( s _ { a } + s _ { b } ) ] \begin{bmatrix} \sigma _ { a, o } ^ { 2 } + \sigma _ { U S U } ^ { 2 } & \sigma _ { U S U } ^ { 2 } \\ \sigma _ { U S U } ^ { 2 } & \sigma _ { b, o } ^ { 2 } + \sigma _ { U S U } ^ { 2 } \end{bmatrix},$$

with r 0 = P i ra i ; GLYPH&lt;27&gt; GLYPH&lt;0&gt; 2 a i ; + P i rb i ; GLYPH&lt;27&gt; GLYPH&lt;0&gt; 2 b i ; , sa = P i GLYPH&lt;27&gt; GLYPH&lt;0&gt; 2 a i ; and sb = P i GLYPH&lt;27&gt; GLYPH&lt;0&gt; 2 b i ; . Hence, the evaluated mean values and covariances are expected to change if GLYPH&lt;27&gt; 2 USU is applied a-priori to a Neutron Data Standard evaluation of multiple observables (e.g., a crosssection given for multiple incident energies.)
R. Capote D. Neudecker
How accurately we know the standard $^{252}$Cf(sf) neutron multiplicity?
Small uncertainties obtained for the Neutron Standards have been associated
with possible missing correlations in the input data, with an incomplete
uncertainty budget of the employed experimental database or with unrecognized
uncertainty sources common to many measurements. While further detailed studies
may improve the first two issues, the issue of potential unrecognized
uncertainties and correlations between different experiments has long been
neglected. We address this gap with a test-case study ons the evaluation of the
total neutron multiplicity of the $^{252}$Cf(sf) source, which is included in
the evaluation of the Thermal Neutron Constants within the Neutron Standards.