The study will evaluate the safety and tolerability and recommended dose of daily neratinib in combination with weekly paclitaxel, trastuzumab and tri-weekly pertuzumab in patients with HER2+ advanced or metastatic disease and, if successful, determine an optimal dose to move into phase II/III testing of this combination in the neoadjuvant setting.