I used the implementation of CenterCrop in transforms as a template and defined following class:
class Crop(object):

   def __init__(self, height, width):
       if isinstance(width, numbers.Number) and isinstance(height, numbers.Number):
           self.width = int(width)
           self.height = int(height)
       else:
           self.width = width
           self.height = height

   def __call__(self, img):
       width, _ = img.size
       return transforms.functional.crop(img, 0, width - self.width, self.height, self.width)

You can add this to your tranform_list by Crop(height, width)