We introduce a family of codes which are a generalisation of the Bacon-Shor code using the quantum double models introduced by Kitaev. In particular, we show that such codes are possible for non-Abelian quantum double models, as well as three-dimensional quantum double models. Our codes possess a structure which generalises the gauge subsystem of the Bacon-Shor code to non-Abelian models. This means that we retain the ability to infer error syndromes using two body measurements, as well as a generalised subsystem error correction procedure.