Yeah, I should have probably tested this more before I posted, but I’m wondering if any type of in place broadcast subtraction works?  Let alone my triple index version.
But perhaps indexing twice as you say - may be the breaking point for this.  Perhaps you’re suggesting that I get rid of the double index!?.. Let me try that…