Raff was born in Lachen in Switzerland. His father, a teacher, had fled there from Württemberg in 1810 to escape forced recruitment into the military of that southwestern German state that had to fight for Napoleon in Russia. Joachim was largely self-taught in music, studying the subject while working as a schoolmaster in Schmerikon, Schwyz and Rapperswil. He sent some of his piano compositions to Felix Mendelssohn who recommended them to Breitkopf & Härtel for publication. They were published in 1844 and received a favourable review in Robert Schumann's journal, the Neue Zeitschrift für Musik, which prompted Raff to go to Zürich and take up composition full-time.