Reed pipes are a woodwind instrument. It is presumably similar to bagpipes.
A Clash of Kings
When Ser Edmure Tully returns to Riverrun after the Battle of the Fords, the castle is celebrating. Rymund the Rhymer plays his harp, accompanied by a pair of drummers and a youth with a set of reed pipes.