But every extra mod adds 1 to the difficulty so even with the -2 different you will still start rack up the difficulty
Yes. What I said before is that granting you a success in the first mod check (the one made at P difficulty) isn't that much of an improvement, since it's the least likely to fail.