Archaeologists in Colonial Williamsburg believe they have uncovered history. First Baptist Church in Williamsburg is one of the oldest known Black churches in America, and this week, experts confirmed the discovery of the congregation's first permanent structure in the early 1800s. "We can confirm this foundation was built in the early 19th century," said Colonial Williamsburg Director of Archaeology Jack Gary.