The purpose of this trial is to assess the ability of CVA21, either alone (Part A) or in combination with pembrolizumab (Part B), to reach and to replicate in existing tumors (while sparing normal cells) and to establish a safe multi-dose schedule of the virus for the treatment of solid tumors where enhanced expression of ICAM-1 and/ or DAF receptor occurs.