When Edward Castle was born in 1824, in Virginia, United States, his father, Benjamin Castle, was 41 and his mother, Elizabeth Salyer, was 33. He married Mary Elizabeth Wiley on 11 February 1847, in Johnson, Kentucky, United States. They were the parents of at least 7 sons and 4 daughters. He lived in Ohio, United States in 1870 and Magisterial District 6 Sycamore, Johnson, Kentucky, United States in 1880. He died on 19 February 1914, in Kentucky, United States, at the age of 90.