When James Humphrey Agee was born on 17 December 1835, in Callaway, Missouri, United States, his father, William Ransom Agee, was 42 and his mother, Sarah Ann Taylor, was 25. He married Anna Isabella Reynolds on 18 November 1869. They were the parents of at least 8 sons and 5 daughters. He lived in Saline Township, Miller, Missouri, United States for about 20 years. He died on 26 August 1925, at the age of 89, and was buried in Spring Garden, Miller, Missouri, United States.