@craigmaloney does mpd suit your needs? It's can be used as multi-user server for that need, but i'm not sure about it