As of 2017, he has never been married nor had any children. Many internet sites claim he has been married since 1980 to former actress
Jere Fields only due to their convincing appearances together on
Tattletales (1974). They were never an actual couple. In 2017, Walker's private life made headlines when
Norman Lear told an interviewer that Jimmie was dating political commentator
Ann Coulter. However, Coulter later responded and clarified that they were only friends.