Columbus is a city in Columbia and Dodge Counties in the south-central part of the U.S. state of Wisconsin. The population was 4,479 at the 2000 census. Columbus is located about 28 miles northeast of Madison on the Crawfish River. It is part of the Madison Metropolitan Statistical Area. Nearly all of the city is located within the Town of Columbus in Columbia County, though a small portion lies the Town of Elba in Dodge County. Columbus has the closest Amtrak station to the city of Madison.