To my understanding of how outside sourced audio works in gmod, is it loads it to the server first, then plays it for the client. I could be wrong, as I haven't looked too much into it, but I think I remember something like that happening to me every so often on certain songs. I can't remember though, so oh well.