Background Sounds volume lowers when interacting with iPhone

I really like the background sounds and I use it to fall asleep and usually turn it on when I read before I go to sleep but when I interact with my phone and what not the sounds always get really quiet and it really annoys me so is there anyway to make them not turn down at all?