def validation_epoch_end(self, outputs):
    	val_loss = torch.stack([x['val_loss'] for x in outputs]).mean()
    	log = {'avg_val_loss': val_loss}
    	return {'val_loss': val_loss, 'log': log}

I used it instead like this and now its working, thanks @Abhilash_Srivastava