The Triplett family was close, personal friends of Robert E. Lee. The story is told how Mary met Lee on his return from Appomattox, took a button from his coat and made a brooch which she always wore.

The brick structure served as a residential unit until 1952, when the property was sold to the Robert E. Lee Council of the Boy Scouts of America.

From 1963 to 1984, the structure again served as a residence.

This property was used by Gov. Douglas Wilder, first black governor of the nation, as his 1989 campaign headquarters.