News Feed
Sections




News Archive
Looking for more information on how to do PHP the right way? Check out PHP: The Right Way

Rob Young's Blog:
Chunking Large Queries with Iterators in PHP
October 07, 2009 @ 10:42:02

Since sometimes you just don't want all of the results of a query back at once, Rob Young has posted a solution of his own using the Iterators included with PHP as a part of the SPL. His solution is to wrap it in a ChunkedQueryIterator that handles the work behind the scenes.

When executing large queries it's usually best not to load the whole result set in one go. Memory isn't infinite and PHP isn't renowned for handling it very well. So the obvious answer is to chunk the large query in to lots of smaller queries. [...] We want something to which we can just provide a PDO object, an SQL query and the chunk size. We should then be able to iterate over the resulting object as though it were a single result set.

He includes two code snippets of it in action, but asks the question of his readers - "How do you handle large database queries?" - to get some feedback on other alternatives.

0 comments voice your opinion now!
chunk large query iterator pdo


blog comments powered by Disqus

Similar Posts

Havard Eide's Blog: Iterators

Hasin Hayer's Blog: Converting standard wordpress into a SQLite powered multi user blogging platform

Christian Weiske's Blog: Importing huge XML files using PHP5 - efficiently and conveniently

Stuart Herbert's Blog: Investigating A PDO Segfault

Rob Young's Blog: Chunking Large Queries with Iterators in PHP


Community Events





Don't see your event here?
Let us know!


release package deployment framework api laravel install interview voicesoftheelephpant community tips introduction library list symfony podcast series bugfix language opinion

All content copyright, 2014 PHPDeveloper.org :: info@phpdeveloper.org - Powered by the Solar PHP Framework