24 Million entries and I need to what?

Ed Felt edfelt at gmail.com
Fri Dec 27 09:22:51 MST 2013


MySQL in memory table with full indexes is probably about as fast as you
can get.
On Dec 27, 2013 9:16 AM, "Lonnie Olson" <lists at kittypee.com> wrote:

> On Fri, Dec 27, 2013 at 1:59 AM, S. Dale Morrey <sdalemorrey at gmail.com>
> wrote:
> > Just wondering, what would be the fastest way to do this?
>
> grep will have to scan the entire file every time.  Not a good idea.
> You either need to store it all in memory, or use some kind of index.
>
> Memory options: Memcached, Redis, Custom data structure (PHP array,
> Ruby Hash, Python dictionary, etc)
> Indexed options: Postgres, MySQL, SQLite, BDB, etc.
>
> /*
> PLUG: http://plug.org, #utah on irc.freenode.net
> Unsubscribe: http://plug.org/mailman/options/plug
> Don't fear the penguin.
> */
>


More information about the PLUG mailing list