BB Shockwave is right, about 70% of the map guardians can be kited away. Just depends where the maps have been placed. For example, in the Warrior game i started last week, there was a map of Verona near the bridge on Scarlet island (the one with the biggest army). But this time through there is no map there. So no chance to sneak to Verona early. In fact with a little luck, it is possible to get the maps for almost all the islands b4 you start clearing Debir!
DG, on impossible it is much quicker to sneak at least to Rusty Anchor first because then you can defeat all the enemies on Scarlet and Bolo without losses and complete all quests so you don't need to return later.