I just remembered, that the audio seems to prefer going out through the HDMI port, see this topic: Getting no sound output from Raspberry's built in analog output
Maybe it’s the same issue in your case as well 
The solution seems to be to start the system with HDMI unplugged, then connect it.