The Cautions were formed in late 1999 in Boston, MA by Jeff Caglarcan, Eric Barao and Chris Newbern, all of which have played in the Boston band January. After auditioning several bassists, The Cautions added Matt Boynton to the lineup. Their music has been described as The Cars versus Weezer in a fight to the death over Elvis Costello tickets.