Miller claimed the First Amendment (right to freedom of speech and association) rather than taking the Fifth (right against self-incrimination).
Taking the Fifth Amendment over the First Amendment was forgotten.