The Ashkenazi are Jews descended from those who lived in Jewish communities along the Rhine River in Germany in medieval times. Most of their descendants moved eastward to make up the Jewish communities in Eastern Europe prior to World War II. About 80% of the world's Jews have such descent.
Kingston is an unincorporated area on the outskirts of Princeton in New Jersey.
When House goes to Cuddy's house for a consult and realizes that her blind date is there, she says, "I like him and I like sex. Do I need to stitch a letter onto my top?" This is a reference to Nathaniel Hawthorne's The Scarlet Letter, in which the protagonist is forced to stitch a scarlet "A" into her clothes after being found guilty of adultery.
When House says, "Come on, let's go break her arm." it might be a reference to the movie "Henry Fool". The title character says "They're throwing bottles at your house. Come on. Let's go break their arms."
All of Wilson and House's talk about curiosity and cats is from the saying Curiosity killed the cat, which warns about being too curious.