The house was built around 1840 by Col. Jehiel Brooks, a veteran of the War of 1812 who married Ann Margaret Queen, daughter of One of the largest landowners in the District of Columbia. After returning from the Red River Indian Agency, they lived on a 246-acre plantation that they dubbed Bellair.[2]
In 1887, the house and land were sold to an Ida U. Marshall, who sold to Benjamin F. Leighton and Richard E. Pairo. They subdivided Bellair, and developed the suburb of Brookland. The mansion house and 2 acres were sold to Elizabeth Varney, who operated a boarding house.
In 1891, the Marist Brothers bought the Brooks mansion.[2] Three years later, they added a wing to the house. Eventually, they sold the house to the Benedictine Sisters.[3]
In 1905, the Benedictine Sisters of Elizabeth, New Jersey moved to the Brooks Mansion. In 1906, they founded St. Anthony's Academy for young children, and operated a shelter for women.