Off With Their Heads is a punk rock band formed in 2002 from Minneapolis, MN. Their music has often been compared to that of fellow Minnesota punk band Dillinger Four, and Paddy Costello of Dillinger Four previously served as a bassist for Off With Their Heads.