Upon leaving The Leftovers in 2010 after approximately 8 years with the band that he founded, he went solo and created the power pop group The Kurt Baker Band. The first material he released as part of The Leftovers came in 2003 and was an EP titled Mitton Street Special.