One difference is that "illegal but not prosecuted" is still not admissible as evidence in court.  I'll bet there are some defendants' lawyers celebrating this ruling right now, because now the FBI is going to have to prove that it got those records legally, and that just got harder.