Chapter 02 of 11 · Deck OOW

Celestial Navigation

Every technique here reduces to the same trick: measure an altitude, compare it with what a known or assumed position predicts, and let the difference do the work. This chapter walks the arithmetic all the way through, correction by correction.

Worked examples3, fully stepped
Read time≈ 13 min
PrerequisiteNone

1. The intercept method, in outline

A celestial fix does not point straight at your position the way a GPS fix does — it works by comparison. You choose an assumed position (AP) close to your dead reckoning, work out what the altitude of the body would have been had you actually been standing at that AP at the instant of the sight, and set that calculated altitude against the altitude you actually measured. The gap between the two is the intercept, and it tells you how far, and in which direction, your true position lies from the AP along the line to the body.

Intercept = true altitude − calculated altitude Positive: your position is toward the body

Direction alone is not enough — you also need which way "toward" points. That comes from the azimuth (Zn), the true bearing of the body from the AP, worked from the same sight reduction. Plot the intercept distance from the AP along Zn (or its reciprocal, if the intercept is away), and draw the position line at right angles through that point. One sight gives a line; two or three bodies, sighted close together in time and reduced to the same fix, give lines that cross and bound a small "cocked hat" around your best estimate.

The key idea

Every sight actually defines a circle, not a line — a circle of position centred on the body's geographical position, with a radius equal to the zenith distance. Near your AP, over the short arc a ship covers between sights, that circle is close enough to straight to draw as a position line, which is the only reason the intercept method works with a ruler and pencil instead of a globe.

2. From sextant to true altitude: the correction chain

Almost every mark lost in celestial work is lost here, before the sight reduction even begins. The sextant gives you an angle read off a mechanical instrument, against a horizon that is not quite horizontal, of a body that is not quite where the eye perceives it — three separate errors, each corrected in turn, and each correcting a different stage of the measurement.

True alt = Sext alt ± IE − dip + main corr Each correction fixes a different stage — the order is not optional
  • Index error (IE) — the instrument's own zero error, found by observing the horizon with the arc set to zero. On the arc, the reading is inflated, so it is subtracted; off the arc, the reading is depressed, so it is added.
  • Dip — the visible sea horizon lies below the true horizontal because the observer is standing above sea level, looking down over the curve of the earth. It grows with the square root of height of eye and is always subtracted, whatever IE is doing.
  • Main correction — refraction (the atmosphere bending light from the body, always making it appear higher than it truly is, so always a negative element), semi-diameter (the sextant measures a limb, not the body's centre, for the Sun and Moon) and parallax (significant only for the Moon, negligible for Sun, stars and the outer planets) folded into one tabulated figure.

Work the chain in that order — instrument, then horizon, then physics — and each stage only ever corrects the error proper to it. Try to shortcut it, or apply dip after the main correction, and errors that should cancel start compounding instead.

3. Meridian altitude: latitude for free

At the instant a body crosses the observer's meridian — bearing due north or due south, exactly — it is at its highest altitude of the day and its bearing is not changing at all near that moment. That second fact is what makes the meridian altitude so forgiving: because altitude barely changes for a minute or two either side of the peak, a small timing error costs you almost nothing, unlike a normal sight where four seconds of clock error already costs a mile.

Latitude = 90° − true alt ± declination Zenith distance and declination, combined by name and bearing

No sight reduction tables, no assumed position, no azimuth — the body's declination for that moment (from the almanac) and the true altitude you measured are all the working requires. The zenith distance (90° minus true altitude) is added to the declination when latitude and declination share the same name and the zenith distance is the smaller of the two; when they are contrary in name the declination is subtracted from the zenith distance instead. Getting that sign right is entirely a matter of sketching which side of the equator, and which side of the observer's zenith, the body actually sits.

The key idea

A meridian altitude is not really a sight-reduction shortcut — it is a different, simpler kind of observation, and that is why it has stayed useful long after tables and calculators made ordinary sight reduction fast. It is quick, robust to timing error, and needs nothing beyond the declination for the moment of local apparent noon.

4. Amplitude and azimuth: checking the compass

A gyro or magnetic compass drifts, and the only way to know by how much is to compare its reading against a bearing you know to be true. The sky supplies that true bearing without needing a shore mark or a second vessel, which is the whole reason this branch of celestial work has survived the retreat of the rest of it — checking the gyro is still, in practice, done once a watch.

sin(amplitude) = sin(dec) / cos(lat) Valid only at the instant the body sits on the visible horizon

Amplitude applies specifically at the theoretical moment of rising or setting, when true altitude is zero, and is reckoned as an angle from the East or West point of the horizon rather than from north as a three-figure bearing. Reading it off needs no tables beyond the day's declination and your latitude, which is what makes it a fast check at sunrise or sunset and nothing else. Azimuth, worked from tables or by calculation for any time of day and any altitude, does the same job whenever a sight of the Sun, a star or a planet happens to be convenient — more work to obtain, but not tied to the horizon.

  • Amplitude — quick, rising/setting only, named from E or W toward N or S by the body's declination.
  • Azimuth — usable at any altitude, but needs a calculated or tabulated bearing from a proper sight reduction.
  • Compass error — true bearing minus compass bearing; a positive result means the compass is reading low, a negative result means it is reading high.

5. Sunrise, sunset and the twilight window

Star and planet sights need a horizon you can see and stars you can see at the same time, which only happens for a limited window either side of sunrise and sunset. Twilight is graded by how far the Sun's centre sits below the horizon: civil twilight out to 6° of depression, nautical twilight out to 12°, and astronomical twilight out to 18°, after which the sky is properly dark. Nautical twilight is the practical window for star sights — the horizon is usually still distinct enough to bring a star down to it, and enough stars are already visible to choose a good spread of bearings for the fix.

Predicting the times of sunrise, sunset and the start or end of each twilight band is a table lookup against the observer's latitude and the date, adjusted for longitude to convert from the tabulated Greenwich event to local time. The habit worth building is planning backwards from it: work out nautical twilight for the evening, and you know the short window in which the evening star sights have to be taken, which stars will be well placed, and how much time there is to get sights of three or four of them before the horizon is lost.

Every almanac entry — declination, GHA, the times themselves — is tabulated in UTC. Convert to the ship's zone time only at the very end, for briefing the watch on deck; feed zone time into a sight reduction by mistake and the whole fix comes out wrong by whole degrees of longitude, not by a forgivable mile or two.

6. Sources of error, and judging whether a sight is worth taking

A well-worked sight is only as good as the observation feeding it, and the observation is vulnerable in ways the arithmetic afterwards cannot fix. Personal error — a habitual tendency to bring a body down slightly too far or not quite far enough — is worth finding out about yourself and allowing for. A residual index error, not checked recently, quietly biases every sight taken that day in the same direction. Dip is calculated for a level ship; heavy rolling or a confused sea state makes the horizon itself unsteady under the body, and no formula corrects for that.

Timing matters more than it looks. The earth turns roughly 15 minutes of arc a minute, so four seconds of clock error already costs about a mile of position error along the line of the sight — trivial for a meridian altitude, where altitude is barely changing, but not trivial for an ordinary sight taken well away from the meridian. Abnormal refraction near the horizon, more common in cold, calm conditions than the tables assume, is the reason sights are best avoided below about 10° of altitude if a higher body is available instead.

The key idea

None of this makes celestial navigation obsolete as a backup. It works with nothing electronic at all, and the discipline of taking a sight, clearing it correctly and judging the resulting cocked hat is exactly the skill that catches a GNSS position that has quietly gone wrong.

7. Worked examples

The three examples below carry a sight all the way from a raw sextant reading to a usable result — a latitude, a plotted position line, and a compass error — with every correction shown rather than assumed.

Worked example 1

Sextant to true altitude, then latitude by meridian altitude

At local apparent noon the Second Officer takes a meridian altitude of the Sun's lower limb, bearing due south of the ship. The sextant reads 64 00.0′ with the index error and height of eye noted below. The Sun's declination at the moment of meridian passage is 15 00.0′ N. Find the ship's latitude.

Given

Sextant altitude (Hs), Sun's LL: 64° 00.0′ Index error: 2.0′ off the arc Height of eye: 16 m Main correction (Sun, LL, from the altitude correction tables): +15.0′ Declination at meridian passage: 15° 00.0′ N (Sun bears south of the observer)

Required

Find the ship's latitude

  1. Clear the index error first.

    Hs (corrected for IE)=64°00.0′ + 2.0′ =64°02.0′

    Off the arc means the error reads low on the scale, so it is added back to the sextant reading.

  2. Take out dip.

    Dip=1.76 × √h =1.76 × √16 =1.76 × 4 =7.04′, rounded 7.0′ Apparent altitude=64°02.0′ − 7.0′ =63°55.0′

    The visible sea horizon sits below the true horizontal by an amount that grows with height of eye, so dip is always subtracted, never added.

  3. Apply the main correction.

    True altitude=63°55.0′ + 15.0′ =64°10.0′

    For the Sun's lower limb this one figure folds together refraction, semi-diameter and parallax; it is positive here, so it is added.

  4. Convert to zenith distance.

    Zenith distance=90° − 64°10.0′ =25°50.0′

    This is simply the complement of the true altitude — the radius, in effect, of the position circle centred on the Sun's geographical position at that instant.

  5. Combine with declination for latitude.

    Latitude=25°50.0′ + 15°00.0′ =40°50.0′ N

    The Sun bears south of the observer and its declination is north and smaller than the latitude being sought, so latitude and zenith distance fall on the same side and the declination is added to it.

AnswerLatitude 40° 50.0′ N.

The trap: applying dip the wrong way round, or leaving it out altogether, is the single commonest way to lose marks in this correction chain — it is subtracted every time, whatever the index error is doing.

Worked example 2

Reducing a star sight to an intercept and a position line

During evening twilight the Third Officer sights a star and reduces the sight against an assumed position. The sextant altitude, the instrument errors and the sight-reduction results already worked for that assumed position are given below. Find the intercept and state how the position line is to be laid off.

Given

Sextant altitude (Hs): 35° 20.0′ Index error: 1.0′ on the arc Height of eye: 4 m Main correction (star, from the altitude correction tables): −1.5′ Calculated altitude (Hc), from the assumed position: 35° 26.0′ Calculated true azimuth (Zn): 128.0°

Required

Find the intercept and state how the position line is to be laid off

  1. Clear the index error.

    Hs (corrected for IE)=35°20.0′ − 1.0′ =35°19.0′

    On the arc, the correction reads high, so it is subtracted from the sextant reading.

  2. Take out dip for the height of eye actually in use at the pelorus or gyro repeater where the sight was taken.

    Dip=1.76 × √4 =1.76 × 2 =3.52′, rounded 3.5′ Apparent altitude=35°19.0′ − 3.5′ =35°15.5′
  3. Apply the main correction.

    True altitude (Ho)=35°15.5′ − 1.5′ =35°14.0′

    A star sight carries refraction only — no semi-diameter, negligible parallax — so the tabulated figure is smaller than a Sun sight's, and here, well clear of the horizon, it is negative.

  4. Compare true and calculated altitude.

    Intercept=Ho − Hc =35°14.0′ − 35°26.0′ =−12.0′ → 12.0′ away

    The calculated altitude is the larger of the two, which means the true position lies on the far side of the assumed position from the star, not the near side.

  5. Lay off the position line.

    Plot from the AP: 12.0 n.mile along 128.0° + 180° = 308.0°T Position line: perpendicular to 308.0°/128.0°

    'Away' is plotted along the reciprocal of the calculated azimuth, and the position line itself is drawn at right angles through that plotted point.

AnswerIntercept 12.0′ (= 12.0 n.mile) away; plotted along 308.0°T from the assumed position, with the position line perpendicular to that.

The trap: mixing up toward and away drops the position line onto the wrong side of the assumed position altogether — check the sign of the intercept before the pencil goes anywhere near the chart, not after.

Worked example 3

Amplitude at sunrise to check the gyro

At sunrise the OOW takes an amplitude of the Sun as its centre crosses the visible horizon and reads the gyro-compass bearing at the same instant. Using the observer's latitude and the Sun's declination for that morning, find the compass error and state whether the gyro is reading high or low.

Given

Observer's latitude: 45° 00.0′ N Sun's declination: 14° 00.0′ N Gyro-compass bearing of the Sun at sunrise: 076.0°

  1. Find the amplitude.

    sin(Amplitude)=sin(dec) / cos(lat) =sin 14° / cos 45° =0.2419 / 0.7071 =0.3421 Amplitude=20.0°

    At the theoretical moment of rising the body's true altitude is, by definition, zero, so amplitude links declination and latitude directly with no sight reduction at all.

  2. Name the amplitude.

    The Sun is rising, so the bearing is reckoned from the East point; the declination is north, so the bearing lies north of east — amplitude N20.0°E in quadrant notation.

  3. Convert to a three-figure true bearing.

    True bearing=090.0° − 20.0° =070.0°T

    East itself is 090.0°T, and swinging 20.0° towards north reduces that figure.

  4. Compare with the gyro reading to find the error.

    Gyro error=True bearing − Gyro bearing =070.0° − 076.0° =−6.0° → 6.0° high (west)

    The gyro read a larger bearing than the true one, so it is running fast of the truth — reading high.

AnswerGyro error 6.0° high (west); apply −6.0° to gyro bearings until the check is repeated.

The trap: taking the sight after the Sun's centre has visibly lifted clear of the horizon — amplitude only holds good at the instant of rising or setting, and a late sight quietly bakes extra error into the result.

Reference sheet
60-second recall
  1. Dip only ever subtracts — it never adds, whatever the index error does.
  2. At the moment of meridian passage, no sight reduction tables are needed at all.
  3. Amplitude is only valid at the instant a body sits on the visible horizon.
  4. A four-second timing error already moves an ordinary position line by about a mile.
  5. Civil, nautical and astronomical twilight end at 6°, 12° and 18° of solar depression.