No, just one at a time.
Looking at the map, it's a bit unclear, but two rooms to the left are worth +3 points while two rooms to the right are worth -1 points.
Again, remember, when the it's your turn and I roll the die, you only move one piece. A piece in a room is no longer able to move.