I eventually found the problem/fix for this. Apparently there is a separate audio volume separate from the music volume. Download the MapMyRun watch app, it includes a built in volume setting burie...
This issue has come back for me, starting in May 2019. Anybody else? I have a series 4 watch. It works fine on the Series 2 watch my wife has.