The present Luffness House has at its core a much earlier structure, Luffness Castle, which may date back to the 13th century.

Before 1498 Kentigern Hepburn of Waughton and Luffness married Margaret Lauder, daughter of Sir Robert Lauder of the Bass.

Luffness Castle was sacked in 1548 and rebuilt as a T-plan tower house in 1584. A large beehive doocot survives from the late 16th century.

Several major additions were made in the 18th and 19th centuries, with Scots Baronial details.