Sounds like a cache at work.  I know for a fact that WP's caching does not do anything intelligent to determine if it is invalid.  Post a comment, and code is run to invalidate the cache.  But delete a comment from the database, and it will just be served from cache.