Regardless of who is instructed to roll the dice, the rulings so far have been consistent with the idea that the source of the modification is the ship considered. This is the same reason Zuckuss does not work against OL, Elusiveness does not work against OL, but Palpatine does (if palp is on another ship). It doesn't matter who is doing the rolling, the "you" who is acting is the ship with the modifier on board.
I admit I dislike the fact that the way these abilities are worded is inconsistent with the ruling. On the other hand, it is at least consistent (so far), which makes it easier. The source of the modification is the actor.
At least until they change their mind.