The town has whitewashed houses with thatched roofs. Ashford Castle lies next to the town. It is built in the shape of a triangle. It has round towers at each point, thirty feet tall. Between the towers run thick crenellated walls.
During Robert's Rebellion, some time in the year 282 AC, Ashford is the site of an inconclusive victory by Lord Tyrell against Lord Robert Baratheon, in truth Randyll Tarly's vanguard forced Robert to retreat before Mace Tyrell's main force arrived.