HOWTO: Load Really Big XML Files

Sometimes you will want to load data from huge XML files into the database. So how do you achieve this?

There are more then one ways to achieve this, but most of the time a “SAX parser” is used. The term on Wikipedia for SAX is:

A Simple API for XML (SAX) is a serial access parser API for XML. SAX provides a mechanism for reading data from an XML document. It is a popular alternative to the Document Object Model (DOM).

The disadvantage sometimes of using DOM is that it uses to much resources in the sense of CPU and memory and for really huge files this method simply will not work in terms of performance. Parsing an XML document with DOM acquires the whole document to be loaded into memory before processing can be started. Via SAX only a small memory footprint is needed.

Read More