I always shower after my workouts so I just wash the strap with warm water right when I hop in and hang it out to dry.
I have used the washing machine as well but want to avoid all the tumbling around in there as it might damage the strap in the long term, plus its noisy 
4 Likes