 Low engagement and high attrition are common challenges in web-based interventions. Typical measures of engagement reported in the literature are not meaningful for describing participant activity within the intervention and can be misleading. This research aimed to develop a more meaningful method of measuring engagement in an online cognitive rehabilitation program whilst monitoring treatment fidelity.