Gargoyles, sometimes called grotesques, are thought to date back to the 12th century. The gargoyles on this page are specifically from Notre Dame in Paris. However, you will find gargoyles on buildings all over Europe as a means of directing water away from the building – water spouts. During the Middle Ages gargoyles became the popular form of these water spouts.
In French, the word gargoyle is gargouille which is derived from the Latin word gargula or throat is also connected to the French verb gargariser or to gargle.
When it comes to Paris places, I think it is hard to beat the top of Notre Dame Cathedral for the views of the city and of the gargoyles.