I seem to remember that some OS’s allocator don’t return the memory back to the system to speed up later allocations if there is a lot of free memory.
I wouldn’t worry about it as long as it doesn’t cause the system to run out of memory.