text: Title: Delete button remains on screen after leaving element
  Body: Happens on `/chat` and in the subchats if the chat is not active
  
  ![image](https://user-images.githubusercontent.com/24505302/236671627-0849a719-963e-4e2a-b84b-001fc54efeec.png)
  
  The code for this is here:
  https://github.com/LAION-AI/Open-Assistant/blob/9ad4062ff8e254ad554f2017810039b06c5a5893/website/src/components/Chat/ChatListItem.tsx#L155-L172