Earliest references to this idiom appear in the works of Sir Walter Scott in the early 19th century.

It is generally considered to refer to the custom of serving a tasty, hot dinner to welcome guests while presenting unwelcome visitors, or those who had stayed too long, with slices from a cold shoulder of beef or mutton, probably leftovers from dinner the night before.