The Pea River is an essential component of the history of Elba. The river was originally called the Talakatchee River by the Creek Indians. (In the Creek language, talak means "pea", and hatchee means "small river".) The Pea River frequently flooded, causing great damage to the town.
The worst flood ever recorded in Elba occurred in 1990, with a river crest of 48 feet (15 m). The levee broke and Whitewater Creek overflowed into the town. Elba was completely flooded for four days, and the town was nearly destroyed. More floods struck Elba in 1994 and 1998.
According to the Köppen Climate Classification system, Elba has a humid subtropical climate, abbreviated "Cfa" on climate maps.
U.S. Route 84 runs from west to east as a northern bypass of the city, leading east 9 mi (14 km) to New Brockton and southwest 16 mi (26 km) to Opp. Many state highways run through the city as well, namely Alabama State Routes 87, 125, 189, and 203. AL-203 forms the western bypass of the city.
Elba became the county seat of Coffee County in 1852.
The Seaboard System Railroad ceased all railroad service to Elba, including freight service, on November 27, 1984. The Pea River is an essential component of the history of Elba.
AL-189 runs to the west of the city from south to north, leading northwest 16 mi (26 km) to U.S. Route 331 near Brantley and southwest 17 mi (27 km) to Kinston. AL-125 runs northeast from the city 13 mi (21 km) to the community of Victoria.