Brown has tried to remake The New Yorker as an upscale newsweekly , but its 800,000 paying readers can 't match the 4 million that Time offers its advertisers .
The New Yorker has a continually growing base of subscribers .