Story soon became the largest settlement in the area. In its heyday (1880-1929) the village supported two general stores, a nondenominational church, a one-room schoolhouse, a grain mill, a sawmill, a slaughterhouse, a blacksmith’s forge and a post office.
Story never recovered from the Great Depression (1929-1933), as families abandoned farms in search of work elsewhere. Brown County lost half of its population between 1930 and 1940. This exodus of people created an opportunity for the State of Indiana to begin the purchase of 16,000 acres of wooded hills that are now the Brown County State Park, the largest in the state. As years passed, thousands of additional acres were acquired to form the Hoosier National Forest, Yellowwood State Forest and the Lake Monroe impoundment lands. These vast tracts of public lands now surround Story on three sides.