Named for the waterfalls on the east branch of the Chippewa River, the village was founded in 1866 by J. M. Danelz, a Swedish immigrant. Danelz built a flour mill using the river to power its water wheel. Swift Falls was the home of Earl B. Olson, the founder of Jennie-O who started by raising turkeys in the area.