text: Title: end-to-end tests
  Body: Add end-to-end tests for:
  
  - [x] **dynamic Batching** - addressed by #68 
  - [x] **Dynamic batching with streaming** - addressed by #68 
  - [x] single prediction #70
  - [x] single streaming #247