When Charlotte Oliver was born on 28 November 1811, in Northampton, North Carolina, United States, her father, Joseph Oliver, was 26 and her mother, Sarah Nelson, was 21. She married Drewry Fergason on 17 March 1836, in Clinton, Ohio, United States. They were the parents of at least 8 sons and 6 daughters. She lived in Richland MM, Clinton, Ohio, United States in 1850 and Center Township, Grant, Indiana, United States in 1860. She died on 17 March 1868, in Grant, Indiana, United States, at the age of 56, and was buried in Oak Chapel, Monroe Township, Grant, Indiana, United States.