Edward's older brother was John H. Walker. Edward was referred to in a report on the 1903 tour to South Africa as the brother of "Johnny" Walker of Durban fame, which is likely a reference to John H. Walker who was caught up in the Boer War in South Africa. He was not a combatant, but gained notoriety due to his escape from the Boers after being captured. He had been surveying in Mapoch's country with the chief, under a strong guard and the chief's protection. However, he was eventually captured and taken to Middelburg. He and a fellow prisoner escaped with their horses, a dog, and a tin of biscuits on which they lived for a week, eventually making their way to the Swazi king, where they were treated well. They then walked to Delagoa Bay and caught the Union steamship SS "Natal" to Durban. In 1901, aged 25, he was living by his means and still in his mother's house. However, his father had died in 1894 and the family had left Alleyn Park Road in Dulwich and moved to the nearby Norwood. It is unclear if Edward did take up a profession, because in 1911 although he had moved to Clifton Gardens in Maida Vale, this was still the family home and he lived there with his mother and two of his sisters (as well as with a cook, parlormaid and housemaid) and stated that he was living by his own means. Walker played for a side local to where he had grown up in Dulwich, called Lennox Football Club. The team were based in Dulwich when he started playing for them, though during his time with them they did move elsewhere. With this side he gained an excellent reputation in the South of England as a three-quarter. He was selected for the 1903 tour to South Africa and was described as a consistent player and played in two of the tests. On his return to the United Kingdom he continued to play for Lennox and in 1906 was the captain of the side. The side at that point was not so strong as in previous seasons though it was said that in Blackwood who played alongside Walker they had a player that would have been selected England had he not been injured. He was also later involved in the game as a referee and in 1909 was a joint honorary secretary of the London Rugby Society of Referees.