This isn't the best answer or the most reliable source, but in the Johnson chapter of his book Through Five Administrations, William H. Crook wrote, "Johnson had an amiable weakness for women, particularly for pretty women. Those of us who were on duty in corridors and anterooms saw many evidences of this fact."