When Ernest Haston Agee was born on 4 February 1882, in Botetourt, Virginia, United States, his father, Joseph Ai Agee, was 32 and his mother, Sophia Lavina Haston, was 36. He married Maude Virginia Wheeler about 1910. They were the parents of at least 2 sons and 1 daughter. He died on 28 March 1947, in Roanoke, Virginia, United States, at the age of 65, and was buried in Blue Ridge, Botetourt, Virginia, United States.