Or you could just attach it to the end of your headphones, and store it with them.  That would cover the bulk of the cases, except people that need to plug into multiple AV outputs throughout the day.