There is a very recent PR that adds a named_parameters functionality 48, so that you can select the names of the parameters that you want. You need to have the master branch of pytorch for it to work. Here is an example
for name, param in model.named_parameters():
    if 'bias' not in name:
        # do something