Calculating Cohen's Kappa in SPSS for a systematic review I'm sure there's a simple answer to this but I haven't been able to find it yet. All the explanations I've found to calculate Cohen's Kappa in SPSS use data that is formatted with cases that are listed as rows (see image below for example). Then analysing the data as a cross tabulation.

My problem is that for a systematic review, this way of formatting data is very inconvenient (I would have to list more than 1500 articles as cases). Is there a way of calculating Cohen's Kappa when the data is presented as a square matrix (see image below)? I know how to calculate the statistic manually but my problem is that SPSS generates the p-value which I do not know how to manually calculate.


You can use 'weight cases' in SPSS to tell SPSS to treat that row in the data as repeating N times.
So you make four rows (inc/inc, inc/exc, exc/inc and exc/exc) and add the number in each of these categories, then you can analyze in the usual ways.
