A new tram line runs from Sirkeci, near the Galata Bridge, through Sultanahmet, past the Covered Bazaar, the hotels of Laleli and Aksaray, and on to the city walls at Topkape bus station (not to be confused with the famous palace of the same name).
There are several old trams that go to the city walls as well.  