When an alternating current is applied to an antenna, a wave is produced.
The electromagnetic wave will leave the antenna in a certain orientation. A length of wire pointing upwards will produce a wave that oscillates up and down in a vertical direction as it moves through free space.
Other types of antennas may move up and down horizontally.
The orientation of this wave is known as the polarisation of the electromagnetic wave.