When the Janitor is talking to the patient about his "drill-fork" it's placed right next to the tray closer to Janitor. Right before Janitor has to leave the drill-fork is placed on the tray closer to the patient.
The janitor intuitively knew what time it was when Dr. Kelso asked. Later in the episode, he had to ask Dr. Cox what time it was.