Of course , if Mr. Ferrer is to win the primary this time against City Council Speaker Gifford Miller , Representative Anthony D. Weiner and the Manhattan borough president , C. Virginia Fields , he again has to make a broad appeal for votes that cut across all Democratic lines .