If you sweep something under the rug, someone else will just have to have to clean up the mess.
At first glance, it seems as though your passivity is doing nothing. But actually it is doing quite a lot. You say a lot when you say nothing. And you do a lot when you do nothing.
So the next time when you choose to be passive, think about who you are dismissing, who you are casting aside. And most importantly, think about what problem you’re leaving for someone else to deal with.