Some areas without direct rail links to London , such as around the old county town of Buckingham and near Olney in the northeast , are much less populous .
The largest town , Milton Keynes , serves as a unitary authority separately from the rest of Buckinghamshire .