When Isaac Thomas Wharton was born on 6 October 1851, in Cedartown, Polk, Georgia, United States, his father, Bartlett Wharton, was 30 and his mother, Mary Susan Bentley, was 31. He married Elizabeth Hunter on 23 December 1870, in Cleburne, Cleburne, Alabama, United States. They were the parents of at least 5 sons and 5 daughters. He lived in Election Precinct 1 Huntsville, Madison, Alabama, United States in 1900 and Justice Precinct 7, Red River, Texas, United States in 1910. He died on 3 March 1913, in Broken Bow, McCurtain, Oklahoma, United States, at the age of 61, and was buried in Broken Bow, McCurtain, Oklahoma, United States.