Quarles Harris was established in 1680. The house became a subsidiary of Warre in 18th century, when the name became simply a brand. The Symingtons became associated with Quarles Harris son after A.J. Symington became a partner in Warre. Quarles Harris has continued making good Ports under the Symington's ownership ever since.

Peter Symington, the director of production for the Symington group, has a simple philosophy about Quarles Harris: "Unless they are good we don't bottle them. They are Ports that are sold on sample (meaning merchants want to taste them before buying) and don't sell simply on reputation".