I had this exact issue. I wanted it on some but not all....and it IS possible. I believe if you go to the home you want in your Google Home app and click it's setting gear there is an option for "notifications". I disabled that and it stopped the doorbell. Granted you lose other things like broadcast I think.