Notification sounds on speakerphone even when headphones plugged in topic

Hi I was wondering if there is a setting to prevent notification sounds from going through the speakers while earphones are plugged in.
Notifications sounds are only played through earphones if music is playing but through the speaker when no music is playing.

Thanks!