Infamy

Infamy is a hidden modifier that is changed by -0.1/yearly. Having diplomacy ideas will change it by an additional -0.05/year. Every time you declare war you gain 1 infamy and having non-core provinces will increase it too. Having too much infamy can cause some rather nasty triggered modifiers.