When the seventy-three years old Corlys Velaryon fell ill in 126 AC and maesters feared for his life, the issue of succession of Driftmark arose. The old Sea Snake had outlived both of his children, Laena and Laenor Velaryon, by law Laenor's eldest son Jacaerys stood to inherit after Corlys. However, Jacaerys also stood to inherit the Iron Throne one day after his mother, Rhaenyra Targaryen, the Princess of Dragonstone. Rhaenyra urged Corlys to named her second son, Lucerys, his heir instead. This did not sit well with Corlys's six nephews who considered their claims to be superior to those of Rhaenyra's sons on the ground that they were in fact bastards sired by Ser Harwin Strong. Rhaenyra sent her husband, Prince Daemon Targaryen after Ser Vaemond Velaryon, the eldest of Corlys's nephews, and he beheaded him. In response, Vaemond's five cousins, his wife and his two sons, Daemion and Daeron Velaryon sailed to King's Landing to put their claims forward directly in front of King Viserys I Targaryen. The king did listen to them but when the five brothers repeated the rumors regarding the paternity of Rhaenyra's sons, Viserys had their tongues removed. Thereafter the five brothers were know as the "silent five".
The silent five, still resentful towards Rhaenyra and Daemon, chose to fight for Aegon II Targaryen and the greens in the Dance of the Dragons, despite the fact that House Velaryon had declared for Rhaenyra and the blacks. Three of them died during the war.
When Lord Corlys died in 132 AC, he was succeeded as Lord of the Tides by his bastard grandson, Alyn of Hull. The two remaining silent five, Ser Malentine and Ser Rhogar, yet again took their own claims to the small council in King's Landing. When the Hand of the King and the regents ruled against them, Malentine and Rhogar refused to accept the decision and plotted to assassinate Alyn. Malentine was slain during the attempt, and Rhogar captured and later sent to the Night's Watch.
Daemion and Daeron also advanced their own claims to Driftmark but they reconciled with Alyn after the regents ruled against them.