Advice : Large Look-up Tables

RSellens · Post by **RSellens** » 27 May 2013 20:14

Hi all,
I am after some advice on a new feature that i am looking to include in the next version of my 'CWCG Build from CSV' plugin.
One of the areas i want to improve is the details on the Cemetaries/Memorials, initially getting a full place/address for them, and prehaps later other details to prehaps include in a note (like number of casualties, etc). I initially for testing just built an internal table to search, but then realised that 16,000 entries is a bit much to 'hardcode', so thought about reading the data from another CSV. However, i am still concern that a table that size will need a large amount memory and could cause issues. Does anybody have any thoughts about another way i could acheive the result i want ?

Richard

P.S. Does anybody have a good example of a simple 'window' that i could look at as a front end, which would make the plugin more straight forwards for selecting the files to be processed ?

ID:6964

YouTube · Post by **Jane** » 30 May 2013 16:30

Probably the best way is using the SQL lite module, so you can have a 'full' database. You can easily download files/databases using http when the plugin is installed.

See
http://www.fhug.org.uk/wiki/doku.php?id ... mple_usage

and

http://www.fhug.org.uk/wiki/doku.php?id ... _with_load

For some examples of both. You csn host the populated database here once you have it, just send me the file.

RSellens · Post by **RSellens** » 30 May 2013 20:00

Thanks Jane
I'll have a look at this over the weekend

Richard

RSellens · Post by **RSellens** » 02 Jun 2013 18:20

Thanks for the advice Jane, that SQL Lite looks like its going to do what i amlooking for after playing with a test file.

Richard

Family Historian User Group