his reputation as the playboy whittaker brother made him a favorite of the press as well as the object of more than a little ribbing from his older brothers , quentin and matt , and his younger sister , allison .