Yes, you can freeze the parameters of a specific layer by setting their .requires_grad attribute to False:
model = ... # model initialization
# freeze parameters of my_layer
for param in model.my_layer.parameters():
    param.requires_grad_(False)