Must all the heroes be at the portal to go to the next level of the dungeon, or only one? Can the other heroes use a glyph instead of the portal?

Only one needs to go through the portal.

yes, you can find a most detail description of it at pag 18 of the rulebook.

but at least one hero have to use the portal to make this thing work