性能批量加载从XML文件到MySQL的数据(Performance bulk-loading data from an XML file to MySQL)

 有一件事有助于提供更多的事情，而不是每次一次。 我建议从每几百行开始一次提交，然后从那里调整。 
 
 此外，你正在做的事情，你做存在检查 - 转储; 它大大增加了您需要运行的查询数量。 相反，使用ON DUPLICATE KEY UPDATE （MySQL扩展，而不是标准兼容）来使重复INSERT自动执行正确的操作。 
 
 最后，考虑构建工具以将XML转换为适合与mysqlimport工具一起使用的文本形式，并使用该批量加载器。 这将干净地将XML解析所需的时间与数据库摄取所需的时间分开，并且还通过使用为此目的设计的工具来加速数据库导入本身（而不是INSERT或UPDATE命令， mysqlimport使用专门的LOAD DATA INFILE扩展）。 

One thing which will help a great deal is to commit less frequently, rather than once-per-row. I would suggest starting with one commit per several hundred rows, and tuning from there.
 
Also, the thing you're doing right now where you do an existence check -- dump that; it's greatly increasing the number of queries you need to run. Instead, use ON DUPLICATE KEY UPDATE (a MySQL extension, not standards-compliant) to make a duplicate INSERT automatically do the right thing.
 
Finally, consider building your tool to convert from XML into a textual form suitable for use with the mysqlimport tool, and using that bulk loader instead. This will cleanly separate the time needed for XML parsing from the time needed for database ingestion, and also speed the database import itself by using tools designed for the purpose (rather than INSERT or UPDATE commands, mysqlimport uses a specialized LOAD DATA INFILE extension).