Really simple question....

When calculating adjacency for the purposes of summoning, can you only go via the arrows (all be it in either direction) or is it shared borders.

I also assume that Norsca is only adjacent to the Troll Counties...

As the rules say, shared borders. The arrows are for battle, scoring and corruption directionality not movement.