Migrating 'huge' database to ModX Revo. Howto?

10 Posts

kjartan Reply #1, 16 years, 2 months ago

Dear ModX Community.

I am to migrate a desktop application that holds records of Artists, Artwork, Where the artwork is displayed, Producer, Project manager, etc. (Basically, a huge database with 5000 artists and 15000 artworks. The database is made in Foxpro.

Example of record for artworks:

N2003_0809_0101,Meeting Yellow II,Veggteppe,Ull,Tekstil - Andre teknikker,Tekstil/fiber,100,460,10,,Beret Aksnes 2005 bak nth,2005,90000,N2003-0809,,Fondsvegg i kantine.,,,,,,,,\\UFOBFIL\PUBLIC\KV-DB\UTFOND\FOTO\N2003_0809_0101_DB.JPG,,,,,,1,,,,1,1,,5,2,,,Vegar Moen,Beret Aksnes,,,1,1,,,,
N1998_0819 _0101,3 delt Obelisk,,,,Skulptur / 3Darbeid / objekt,540,90,90,90,Ikke signert. Ikke datert.,2004,160000,N1998-0819,,Utenfor grensestasjonen.,,,,,,,,\\UFOBFIL\PUBLIC\KV-DB\UTFOND\FOTO\N1998_0819_0101_DB.JPG,,,,,,1,,,,1,1,,27,,,,Arvid Sveen,,,,1,,,,,
L2003_0611_0101,Ikonclust, Micky Mousing,Veggmaleri / veggtegning,,Maleri - Akryl,Maleri,240,840,,,Per Jonas 2004 ntv,2004,110000,L2003-0611,,Entre/korridor,,,,,14 baderomspanel plater montert sammen,,,\\UFOBFIL\PUBLIC\KV-DB\UTFOND\FOTO\L2003_0611_0101_DB.JPG,God,,,,,1,,,,1,1,,10,,,,,,,,1,,,,,

I enjoy the versatility ModX provides and would like to ’proof’ that ModX is capable of handling huge sets of data. Currently I have no idea how to grasp the task at hand. My ModX skills is limited to production of 20-30 websites, great knowledge of TV’s, Chunks and Ditto calls.

Feedback would be highly appreciated at this point.

cheers !

☆ A M B ☆
24,524 Posts

sottwell Reply #2, 16 years, 2 months ago

If it’s comma separated values, you can create a custom table with the appropriate fields, and use phpMyAdmin to import it as a csv file. That many records may take a while and could time-out; you can break it up into separate files.

Then a module for managing it, and snippets for displaying as desired.

Studying MODX in the desert - http://sottwell.com
Tips and Tricks from the MODX Forums and Slack Channels - http://modxcookbook.com
Join the Slack Community - http://modx.org

3 Posts

vortsg Reply #3, 16 years, 2 months ago

It is my impression that you would initially need to complete a conceptual design. This is, how do expect the 5,000 artists and 15,000 drawings to be represented in MODx. After that is determined, then you would conduct a mapping exercise to determine how the information in the Foxpro database tables would moved to the MODx database tables. Once that is determined then you could use a number of methods, such as the CSV approach sottwell mentioned, to move the data from one system to another.

Vortsg