You should be able to see a "remove quote" button when you go to "insert quotes".
More specifically, the insert button appears below the text box, and will call up a window of all the quotes you've collected. Above each quote will be a "remove" button.