His father died in 1938. Two months after Germany annexed Austria, he, his mother, and a younger brother made their way to New York. He supported the family as a stock clerk, delivery boy, and switchboard operator while continuing his music studies. He graduated from the Mannes School of Music in 1942, and became an American citizen in 1944.