How Slavery Really Ended in America - NYTimes.com: On May 23, 1861, little more than a month into the Civil War, three young black men rowed across the James River in Virginia and claimed asylum in a Union-held citadel. Fort Monroe, Va., a fishhook-shaped spit of land near the mouth of the Chesapeake Bay, had been a military post since the time of the first Jamestown settlers. This spot where the slaves took refuge was also, by remarkable coincidence, the spot where slavery first took root, one summer day in 1619, when a Dutch ship landed with some 20 African captives for the fledgling Virginia Colony.