The mountains that you are describing are the Appalachians, which are the oldest mountains in North America that are present today. Due to millions of years of erosion from glaciers, wind, water and seismic activity, the Appalachians were rendered into hilly and rounded mountains, with the rough, rocky, and thin soil being mostly of sedimentary rock that was eroded from the mountains.