Rather than stick his nose into the matter, Gaven simply collects what he left behind then goes and finds the others.  Instead of saying anything, he simply leans against the wall and makes small talk with his handmaiden.