Huge Data Undertaking

chris.kent
chris.kent
@chriskent-NBm5rz • Oct 21, 2024

Ok so I need suggestions on how to handle a set of data that has over 260,000 individual values in it. I don't need to do anything really fancy with it. Basically the hang-up is how to store it, and in what format. The world's largest array? or a db? Also ideas as to how to actually go about doing it, obviously it will need to be automated. Thoughts or suggestions would be appreciated.

Like 0 Replies 1

Replies

Welcome, guest

Join CrazyEngineers to reply, ask questions, and participate in conversations.

Sign up Log in

CrazyEngineers powered by Jatra Community Platform

  • Kaustubh Katdare
    Kaustubh Katdare

    @thebigk • Aug 20, 2012

    Any regular db (MySQL) can handle that amount of data easily on decent sized hardware. However, there are several factors you'll have to consider -

    1. Is the data static?
    2. Is the size fixed?
    3. Overall operations you will perform [updating values, adding/deleting values etc.]
    4. Desired speed of access

    I'm curious to know if something like Access can be used. Never used it myself.

    0