My phone is on mute, but when i open a game there's still sound

I have my phone set on silent but when I open up a game the sound comes on even though my phone is muted. I'm able to lower the sound and mute it using the volume rockers once I'm in the app itself but there shouldn't be any sound for anything if the phone is on mute. Is this a bug? Is there a fix for this?