A glass candle is a candle made of obsidian. Historically they burned, but they have not been reported to burn in recent memory.
The glass candles of the Citadel give off an unpleasantly bright light and does strange things to colors (white was bright as fresh fallen snow, yellow shone like gold , reds turned to flame, and shadows were so black that they looked like holes in the world). It is unknown if all glass candles are alike, but the ones found at the Citadel are tall and twisted with sharp edges. It is claimed that when the glass candles burn the sorcerers could see across mountains, seas and deserts, give men visions and dreams and communicate with one another half a world apart. 
The night before an acolyte of the Citadel says his vows, he must stand a vigil in a vault with nothing but the three black candles and no other light permitted. They must spend the night in darkness unless they can light the candle. According to the maesters, it is to show that even with all the knowledge one has acquired, there are still some things that are impossible. 
A Clash of Kings
A Feast for Crows
Leo Tyrell reports that the green glass candle is burning in Marwyn's study. There is a black glass candle burning in Marwyn's study on the Isle of Ravens when Samwell Tarly arrives there. When Sam asks Alleras how they knew he was coming, Alleras nods at the glass candle.
A Dance with Dragons
One night in the apex of the Great Pyramid of Meereen Daenerys Targaryen is unable to sleep. She leaves her private chambers and heads for the terrace garden where she decides to take a bath alone in the terrace pool.
As she is bathing Daenerys hears a noise and sees Quaithe standing under a persimmon tree, clad in a hooded robe long enough to touch the grass at her feet. Daenerys wonders how an intruder could get past her guards. Quaithe replies that she "came another way", and that the guards never saw her.
Quaithe then delivers to Daenerys another cryptic warning that starts with "The glass candles are burning. . ." 
”It is said that the glass candles are burning in the house of Urrathon Night-Walker, that have not burned in a hundred years.”
"The glass candles are burning . . . ”