Always Judge a Book by its Cover?