Hi Niels,
thanks for your answer i will check this but have you any recommendation to rebuild this with transformers lib without the timm model :

  

      github.com
  

  
    roatienza/deep-text-recognition-benchmark/blob/master/modules/vitstr.py 5


    '''
Implementation of ViTSTR based on timm VisionTransformer.

TODO: 
1) distilled deit backbone
2) base deit backbone

Copyright 2021 Rowel Atienza
'''

from __future__ import absolute_import
from __future__ import division
from __future__ import print_function

import torch 
import torch.nn as nn
import logging
import torch.utils.model_zoo as model_zoo

from copy import deepcopy



  This file has been truncated. show original

  

  
    
    
  

  


?