By my reading, the bag would only seem empty if someone were looking at the outside of it. If someone were looking inside it, into the extradimensional space, they'd be able to see whatever is inside that space, similar to the way a portable hole would work. If it's open, the things inside are visible. If it's closed, it looks like an empty bag.