It was a living symbol of snobbery and how the rich derided the poor, and how the powerful feared the powerless.
It became a focus for idealistic protest and was pulled down twice by the city council, for the last time in 1959. When I was there in the 1980s, the bus route still failed to recognise that the wall wasn't there any more.
I thought about it over the weekend, as the world woke up to the fact that the new American president really does want to mark his border with Mexico with a wall, and realised that - with the possible exception of Hadrian - the builders of walls are derided or forgotten by history. What gets remembered is the moment they are removed.
Trump is a symbol of the decline of the West, but - if he builds the wall - it will come to symbolise his presidency in a very specific way.
I've been wondering these last few months what tactics we should pursue against walls, whether they are Brexit walls or those built by Trump. The tactics must depend on how we found ourselves in this situation.
Here is my take on it. First, it was the fault of the free market right, for the hands-off cult. What started as an important recognition of the power of market forces became, instead, an insidious loss of belief in any kind of action at all.
Their Panglossian view of the world leeched them of a belief in government. We elected them and they became powerless custodians of the nation.
That was the father of Trump. The mother came from the left, on the back foot for the past half century, and with their very own brand of powerlessness. Instead of ideas for the future, they gave us conspiracy theories, symbolic gestures, politically correct linguistics. It was in its way another catastrophic loss of belief in their own potential - endlessly trying to emphasise the present (Blair) or remake the past (Corbyn).
Instead of opposition, they gave us 'protest', which simply acted out their own powerlessness to do anything but supplicate.
It follows that the path we liberal-minded people should follow, it seems to me, is to recognise that we need a better vision - which means no more defending the past, no more defending defunct institutions. It means looking beyond the European Union - so that we are not defending the empty symbolism of tolerance, but we promote what is most important and we reinvent these institutions most likely to make tolerance and progress real.
This is not a plea for compromise, though it may look like that. Though it is a plea for strategic withdrawal on some issues - it seems insane to me that, in a nation of pushing 70 million people, we can't recruit and train our own to populate the NHS.
It is a plea for thinking afresh, so that we can challenge Trump and Farage, and the other brutes, on the future and win. And it seems to me that we most urgently need to rethink free trade so that it becomes a genuine tool of challenging enterprise and not a hidden force for plutocracy.
See my book Cancelled! on the Southern Railways disaster, now on sale for £1.99 (10p goes to Railway Benefit Fund).
Subscribe to this blog on email; send me a message with the word blogsubscribe to email@example.com. When you want to stop, you can email me the word unsubscribe.