The actual name of the song is:

More (Than You'll Ever Know)

Not to be confused with another song with the identical title recorded by country music singer Travis Tritt, as well as several other sings with very similar names.

I think the original credit on the Imperials 'Follow the Man With the Music album was incorrect. A later "greatest hits" collection credited Phil Johnson for the same recording. Or maybe the latter credit was the incorrect one?