Special escape characters which if entered literally will break you app.config or web.config
I will add more as I find more
en.wikipedia.org/.../List_of_XML_and_HTML_character_entity_references
Using an XMLWriter will prevent that sort of thing from happening.