Some faulted what they called Mr. Moore 's disorganized management in part for the narrow defeat of Representative Pat Toomey , one of the candidates the club backed most heavily , in his Republican primary challenge to Senator Arlen Specter in Pennsylvania .