To record himself singing, Herman presses a single white button on the tape recorder. In order to record, though, one would have to press both a play button and a record button (usually red) at the same time.
None of the stomping noises Herman makes while singing are heard back on the tape when it is played back later on.