On 21 October 2012, Cabaye scored his first goal of the 2012–13 season with a neat finish in the Tyne-Wear derby against Sunderland in a 1–1 draw. On 4 November, he scored the opening goal against Liverpool in a 1–1 draw. It was first goal scored at Anfield by a Newcastle player since 2004. Later that month, it was announced that Cabaye needed groin surgery and would be out until February 2013. On 19 January 2013, he made his return and scored the first goal in an eventual 2–1 home defeat to Reading from another trademark free kick. On his second start following his return, Cabaye scored a half-volley from outside the penalty box against Aston Villa. In two home games against Southampton and Stoke City, he converted a penalty and scored a free kick goal, respectively. On 2 March, Cabaye made his first start as captain against Swansea City, replacing the injured regular captain Fabricio Coloccini. On 19 August 2013, the eve of Newcastle's Premier League season opener against Manchester City, Arsenal made a bid of £10 million for Cabaye which was rejected. After Newcastle lost the match 4–0, manager Alan Pardew confirmed that Cabaye had been omitted from the squad that evening because his head had been turned by the bid, which he condemned as disrespectful in both value and timing. The midfielder also refused to play for the club in their following game against West Ham United on 24 August. On 19 October 2013, Cabaye scored his second goal of the season with a 30-yard strike against Liverpool at St James' Park in a 2–2 draw. On 7 December, Cabaye wrote his name into Newcastle folklore by scoring the winner in the 1–0 victory over Manchester United, their first victory at Old Trafford for 41 years. On 21 December, he scored the first goal in a comprehensive 3–0 victory at Crystal Palace, before again scoring in the 5–1 win against Stoke City on Boxing Day. In his final game, on 18 January 2014, Cabaye bagged a brace in a 3–1 win over West Ham United, equalling his 2012–13 goal tally in just half a season. His first goal was a shot from just inside the box after good skill and with his last kick for Newcastle, Cabaye scored a free-kick from the edge of the box. On 29 January 2014, Paris Saint-Germain announced that Cabaye had joined the Ligue 1 club for an undisclosed fee, estimated around £19 million plus add-ons.