CrazyEngineers
CrazyEngineers

  • Problems Associated With Very Large Databases

    Kaustubh Katdare

    Kaustubh Katdare

    @thebigk
    Updated: Oct 21, 2024
    Views: 984
    I'm looking for few inputs on typical problems associated with very large database systems. My knowledge of databases is very limited and that makes me feel that as the database systems grow from 1000s of records to millions and billions of records, there must be few common problems associated with maintaining and operating these databases.

    Is that true? If yes, what are those problems?
    0
    Replies
Howdy guest!
Dear guest, you must be logged-in to participate on CrazyEngineers. We would love to have you as a member of our community. Consider creating an account or login.
Replies

  • PraveenKumar Purushothaman

    Member • Mar 7, 2011

    Problems in the sense, it depends on the server and hardware in which it is running. Database generally is encountered with indexing problem and accessing problem. It is also directly proportional to the performance of the hardware. No way redundancy or ambiguity occurs in any point of database. Due to heavy traffic and large number of connections, the DB Server may go down at the worst case. 😔
    Are you sure? This action cannot be undone.
    Cancel

  • Kaustubh Katdare

    Administrator • Mar 7, 2011

    Well hardware troubles will always be there. Maybe we should only talk about the problems that arise only because of the size of the databases.
    Are you sure? This action cannot be undone.
    Cancel

  • PraveenKumar Purushothaman

    Member • Mar 7, 2011

    Only performance issue and indexing issue will be occurring... 😀
    Are you sure? This action cannot be undone.
    Cancel

  • slashfear

    Member • Mar 7, 2011

    Hey biggie,

    Yeah since we are dealing with Very large databases (VLDB) for sure the maintenance really matters and is not maintained properly it can lead to less performance and yeah as praveen said indexing is the solution but make sure that you index the tables which are not updated on regular basics because when using index the select statement will work fine but the update and insert will be really slow!! 😔 and to achieve performance we can go for partitioning the table which is the most effective way to solve the performance issue as it creates a logical split of the table and not a physical split but when you do so it will reduce the number of input and output device as well as the scan device used by the query 😉 which lead to performance 😁

    And yeah if you need to know how to partition a table in mysql (I have done partition in SYBASE only 😔 ) follow this link buddy: #-Link-Snipped-#


    Hope it helps!!

    -Arvind
    Are you sure? This action cannot be undone.
    Cancel

  • PraveenKumar Purushothaman

    Member • Mar 7, 2011

    slashfear
    Hey biggie,

    Yeah since we are dealing with Very large databases (VLDB) for sure the maintenance really matters and is not maintained properly it can lead to less performance and yeah as praveen said indexing is the solution but make sure that you index the tables which are not updated on regular basics because when using index the select statement will work fine but the update and insert will be really slow!! 😔 and to achieve performance we can go for partitioning the table which is the most effective way to solve the performance issue as it creates a logical split of the table and physical split but when you do so it will reduce the number of input and output device as well as the scan device 😉

    And yeah if you need to know how to partition a table in mysql (I have done partition in SYBASE only 😔 ) follow this link buddy: #-Link-Snipped-#


    Hope it helps!!

    -Arvind
    MySQL partitioning in Portable Server is a mess. I tried once and ended up crashing the server files. All my frm files became corrupted. 😔But in the normal installation, the performance boosted upto 12% - 15%! 😀 Arvind, any idea to partition in Portable Servers?
    Are you sure? This action cannot be undone.
    Cancel

  • slashfear

    Member • Mar 8, 2011

    praveenscience
    MySQL partitioning in Portable Server is a mess. I tried once and ended up crashing the server files. All my frm files became corrupted. 😔But in the normal installation, the performance boosted upto 12% - 15%! 😀 Arvind, any idea to partition in Portable Servers?
    Sorry dude I dont have any idea about portable server 😔

    -Arvind
    Are you sure? This action cannot be undone.
    Cancel
Home Channels Search Login Register