Philipse also bought out his partners' stakes during this time, enticing friends from New Amsterdam and Long Island to move with him with the promise of free land and limited taxes. The manor grew to around , about (210 km²), comprising much of today's lower Westchester County, New York. The estate's boundaries were the Spuyten Duyvil Creek, the Croton River, the Hudson River, and the Bronx River. Philipse was granted a royal charter in 1693, creating the Manor of Philipsburg, and making him first lord of the manor. Along with the three other main manors of the colony—Rensselaerswyck, Cortlandt, and Livingston—Philipsburg created one of the richest and most powerful families in the colony. After swearing allegiance to the English and later being granted his manorship from them, he built in 1693 the first bridge connecting New York City with the mainland, erecting King's Bridge over the Spuyten Duyvil at Marble Hill. He also began construction of the Old Dutch Church of Sleepy Hollow. Although this project had financing, work likely progressed slowly and was completed in 1685. Philipse built a simple residence in today's Getty Square neighborhood of Yonkers, New York near the confluence of the Nepperhan River with the Hudson. Later it was expanded by his descendants into a full-fledged mansion, Philipse Manor Hall. The neighborhood of Kingsbridge, Bronx, is named for his bridge over the Harlem River. In 1685 Philipse imported about 50 slaves directly from Angola on his own ship. He was also an interloper, trading to the east of the Cape of Good Hope, and becoming a known trading partner of Madagascar pirate-merchant Adam Baldridge, employing traders like Thomas Mostyn and John Thurber to make the New York-to-Madagascar voyages. In the 1690s, Baldridge supplied many of the slaves traded and owned by the Philipse family; in return Philipse sent Baldridge guns, alcohol, and other supplies much in demand by pirates. Philipse was on the Governor's executive council from 1691 to 1698, when he was banned from government office by the British governor, Lord Bellomont, for conducting a slave trade into New York. Philipse died in 1702 and is buried with his two wives in the crypt of the Old Dutch Church of Sleepy Hollow. The Philipse family is of Bohemian origin. According to Supreme Court Justice John Jay, (whose maternal grandmother, Eva de Vries, had been adopted by Frederick Philipse upon his marriage to Margaret Hardenbroeck de Vries): "Frederick Philipse, whose family, originally of Bohemia, had been compelled by popish persecution to take refuge in Holland, from whence he had emigrated to New York."