Naval has to do with ships: "What is the naval strength of that country?" "Tess is studying naval architecture." One's navel is a mark, or depression, in the surface of the abdomen marking the point of attachment of the umbilicus. A navel orange is so called because it has a formation shaped like a navel that contains a secondary fruit.
Dictionary of problem words and expressions. Harry Shaw. 1975.