I don’t understand if you want to have single object model or not.
For a general bbox tracking pipeline you can see:

  
      

      mediapipe
  

  
    

Box Tracking 3

  Cross-platform, customizable ML solutions for live and streaming media.


  

  
    
    
  

  


Then TF micro could run on that devices.