He and his family (now with another son, James, born in 1921) moved from Oklahoma to Orlando, Florida. There they moved from one small town to another for several years. While attending eighth grade in Shelbina, Missouri, Sam became the youngest Eagle Scout in the state's history.[6] In adult life, Walton became a recipient of the Distinguished Eagle Scout Award from the Boy Scouts of America.[7]
Eventually the family moved to Columbia, Missouri. Growing up during the Great Depression, Walton had numerous chores to help make financial ends meet for his family as was common at the time. He milked the family cow, bottled the surplus, and drove it to customers. Afterwards, he would deliver Columbia Daily Tribune newspapers on a paper route. In addition, he also sold magazine subscriptions.[8] Upon graduating from David H. Hickman High School in Columbia, he was voted "Most Versatile Boy".
After high school, Walton decided to attend college, hoping to find a better way to help support his family. He attended the University of Missouri as an ROTC cadet. During this time, he worked various odd jobs, including waiting tables in exchange for meals. Also during his time in college, Walton joined the Zeta Phi chapter of Beta Theta Pi fraternity. He was also tapped by QEBH, the well-known secret society on campus honoring the top senior men, and the national military honor society Scabbard and Blade. Additionally, Walton served as President of Burall Bible Class, a large class of students from the