From West Point in the Early Sixties (1902) by Joseph P. Farley:

Years ago, Benny Havens was a seller of contrabands to cadets, such as cakes, ale, and liquors, and this in violation of the rules of the Academy.

He was expelled from the post of West Point and later established himself in a small cottage at the base of the high cliff at Highland Falls, quite near the river.

This was a favorite resort of the cadets "after taps," but the risk of these nocturnal visits was great indeed, since the punishment was dismissal if caught on this venture.

Lieutenant O'Brien of the Eighth United States Infantry with others composed the song of "Benny Havens, Oh!" set to the tune of "Wearing of the Green." The original five verses have been added to from time to time to commemorate the dead or the heroes of wars:

Back to Benny Havens, Oh!

Benny Havens, Oh!