For a compass to show the direction of magnetic pole moment , they must be placed at ether of the 2 geographic poles . It is because the direction of magnetic moment is from south to north pole.
The compass therefore will be vertical at both the poles.