When James Taylor was born on 30 January 1804, in Sullivan, Tennessee, United States, his father, John "Westville John" Taylor, was 31 and his mother, Barbara Strickler, was 28. He married Eleanor Moody on 17 June 1824, in Champaign, Ohio, United States. They were the parents of at least 2 sons and 9 daughters. He died on 10 March 1884, in Concord Township, Champaign, Ohio, United States, at the age of 80.