Yeah, penalties to Perception tests is generally how most systems handle it. It's the way that makes the most sense, and is easiest for the GM to deal with as well.