Altitude Corrections

Corrections to a Sextant Altitude

Index Error

This error can be found using the horizon. The sextant’s altitude is set to zero and then the two images of the horizon are aligned. The Index Error can then be read off.

If the sextant altitude reads high, the correction is subtractive and termed “On the Arc.” “Off the Arc” is the opposite.

After Index Error has been applied, the Sextant Altitude it is referred to as the Observed Altitude.

Dip/ Height of Eye

The True Horizon is at 90° to the Earth’s gravitational field. It coincides with the apparent horizon at sea level. However the Apparent Horizon starts to dip below the horizontal plane as the height of (the observer’s) eye increases.

Dip includes an allowance for Refraction below the horizontal plane.

The formulae are;

 Dip = 0.97 x Square Root (Ht of Eye in feet)

 Dip = 1.76 x Square Root (Ht of Eye in meters)

 

Dip is subtracted from the Observed Altitude to give Apparent Altitude.

 

Refraction

The deflection of light as it enters/ passes through the atmosphere is known as Refraction.

 

Refraction is stable and therefore predictable above about 15°, below that one needs to consider the characteristics of the atmospheric layers through which the light passes at that time. (Taking the altitude of bodies at less than 15° is usually avoided for this reason.)

 

For altitudes above 15°, a simplified formula is adequate (± 0’.02)

  Refraction = 0.96/ Tan (Altitude)

 

Refraction tables make assumptions on the layers for low altitudes and should be treated with caution. +/- 2 is not uncommon at an altitude of 2.

 

Refraction is subtracted from the Apparent Altitude to obtain the True Altitude.

 

Temperature and Pressure Correction for Refraction

The correction for Refraction assumes a temperature of 10° C and pressure of 1010mb. This may be modified for actual temperature and pressure. A temperature difference of 10° C will alter Refraction by 3% and a 10mb pressure difference will change Refraction by 1%. (0’05 and 0’.02 for an altitude of 30°)

 

The multiplier to correct for Temperature (°C) and Pressure (mb)

               = Pressure/ 1010 * 283/ (Temperature + 273)

 

Semi-Diameter

When measuring the altitudes of the Sun, Moon, Venus and Mars, it is usual to align either the top (Upper Limb) or bottom (Lower Limb) of the body with horizon. This offset must then be removed before comparison with the calculated value.

 

The angular diameter of a body depends on its distance from the Earth. Thus for the Sun the Semi-Diameter varies between 16’.3 in January, when the Sun is closest and 15’.7 in June when it is furthest away.

 

For a lower limb observation, the Semi-Diameter should be added to the True altitude.

 

Augmentation of the Moon’s Semi-Diameter

The Earth’s radius is about 1/ 60th of the distance to the Moon. The reduction in distance compared to when on the horizon, has a measurable effect on its size. In contrast the Sun’s distance is 23,000 times the Earth’s radius and the effect is negligible.

 

 Augmentation = Sin (Altitude) x Horizontal Parallax

 

Horizontal Parallax is used in the formula as the lunar distance is not provided in a Nautical Almanac.

 

This correction is typically 0’.15 and should be added to the Moon’s Semi-Diameter before applying the Semi-Diameter to the True Altitude.

 

Parallax in Altitude

The Parallax correction allows for the difference in the altitude measured on the Earth’s surface versus the altitude that would be measured at the centre of the Earth.

 

The effect of parallax reduces with altitude. It is greatest when the body is at the horizon (Horizontal Parallax) and declines to zero when the body is overhead.

 

The effect is also proportional to the distance of the body. Thus the Horizontal Parallax for the Moon is about 1° but only 0’.15 for the Sun. This correction must be included for the Moon but is usually ignored for the Sun. It can be significant for Venus and Mars, depending on their distance, but is always insignificant for Jupiter and Saturn. (< 0’.05)

 

Sin (Horizontal Parallax) = Earth’s Radius/ Distance of Body

 

After correcting for altitude, the correction is known as Parallax in Altitude.

 

Parallax in Altitude = Horizontal Parallax x Cos (Altitude)

 

Parallax in Altitude should be added to the True Altitude.

 

Reduction of the Moon’s Horizontal Parallax

Horizontal Parallax is proportional to the Earth’s radius. Therefore as the Earth’s radius declines with latitude, so does Horizontal Parallax.

 

Correction = Horizontal Parallax * [Sin (Lat) ^ 2] / 298.3

 

This should be subtracted from Horizontal Parallax before calculating Parallax in Altitude.

 

 

Examples of Corrections to a Sextant Observation

                                                           Add or Subtract

For a Star

Sextant Altitude            31° 22’.0

Index Error                           2’.0                       Depends on the error

Observed Altitude         31° 24’.0

Dip                                   -3’.0                       Subtract

Apparent Altitude        31° 21’.0

Refraction                        - 1’.6                        Subtract

True Altitude              31° 19’.4

                                90° 00’.0

True Zenith Distance   58° 40’.6

 

For the Moon

Sextant Altitude           31° 22’.0

Index Error                          2’.0                    Depends on the error

Observed Altitude         31° 24’.0

Dip                                   -3’.0                     Subtract

Apparent Altitude         31° 21’.0

Refraction                        - 1’.6                      Subtract

True Altitude                31° 19’.4

Semi-Diameter                    16’.5                     Add for Lower Limb

Parallax (in Altitude)            51’.1                     Add

True Altitude                 32° 26’.8

                                   90° 00’.0

True Zenith Distance       57° 33’.2

 

Moon’s Additional Corrections

Tabulated Horizontal Parallax       59’.9

Latitude Correction                     - 0’.1             e.g. 52° N

Horizontal Parallax                    59’.8

 

Tabulated Semi-Diameter            16’.3

Augmentation of Semi-Diameter + 0’.15

Moon’s Semi-Diameter                 16’.5

 

The Horizontal Parallax must be included but the Latitude correction is often ignored. Similarly the Semi-Diameter must be included but Augmentation is often ignored.

Next Section

NAUTICAL ALMANAC DATA