Page 3 of 3

Find Duplicate Individuals Version 2.3+

Posted: 30 Oct 2012 13:27
by tatewise
That is very odd, and appears to be caused by missing Record Id data in the Non-Duplicates file.
I can only reproduce that error if I manually edit the Find Duplicate Individuals.nondups file.

What is the history of that file in the reduced dataset project?

Find Duplicate Individuals Version 2.3+

Posted: 30 Oct 2012 15:05
by johnmorrisoniom
Hi Mike,
I copied my entire project (using Copy Project).
Attached a flag to everyone not in pool 1, then used split tree helper to removed the records without the flag. I have not modified the original record ID's in any way (Should I try renumbering them?)
There is a .nondups file of 3kb in the folder, but there don't appear to be any records in it, and I can't add to it as I get an error message.

The contents of the existing .nondups file are:

Code: Select all

return {
-- Table: {1}
{
   {2},
   {3},
   {4},
   {5},
},
-- Table: {2}
{
   -0,
   -0,
},
-- Table: {3}
{
   1,
   1,
},
-- Table: {4}
{
   ['D_B_Span']='btw 31 Dec 1829 and 30 Dec 1930  Synth',
   ['ChildGend']=-0,
   ['FathMarry']=-0,
   ['IndiScore']=23,
   ['SpouNames']=-0,
   ['FamGenGap']=-0,
   ['IndiBirth']=10,
   ['SpouMarry']=-0,
   ['M_B_Span']='10 Sep 1852  Actual',
   ['SpouDeath']=-0,
   ['ChilNames']=-0,
   ['MothScore']=7,
   ['IndiMarry']=-0,
   ['IndiNames']=13,
   ['B_B_Span']='btw 31 Dec 1829 and 30 Dec 1830  Actual',
   ['M_A_Span']=' ',
   ['FathDeath']=-0,
   ['GendScore']=-0,
   ['IndiBapCh']=-0,
   ['IndivGend']=-0,
   ['C_B_Span']=' ',
   ['FathNames']=7,
   ['FathBapCh']=-0,
   ['SpouScore']=-0,
   ['MothMarry']=-0,
   ['RecordIdA']=7967,
   ['MothDeath']=-0,
   ['FullScore']=45,
   ['SpouBirth']=-0,
   ['FathScore']=15,
   ['FamGensUp']='',
   ['RecordIdB']=7941,
   ['DateChron']=-0,
   ['SpouBapCh']=-0,
   ['ChilScore']=-0,
   ['FathBirth']=8,
   ['ChilBapCh']=-0,
   ['FamGensDn']='',
   ['ChilMarry']=-0,
   ['ChilDeath']=-0,
   ['C_A_Span']=' ',
   ['D_A_Span']='btw 31 Dec 1829 and 29 Dec 1940  Synth',
   ['IndiDeath']=-0,
   ['ChilBirth']=-0,
   ['MothNames']=7,
   ['MothBapCh']=-0,
   ['MothBirth']=-0,
   ['B_A_Span']='btw 31 Dec 1829 and 29 Dec 1840  Actual',
},
-- Table: {5}
{
   ['D_B_Span']='btw 1 Jan 1860 and 30 Dec 1970  Synth',
   ['ChildGend']=0,
   ['FathMarry']=0,
   ['IndiScore']=19,
   ['SpouNames']=0,
   ['FamGenGap']=0,
   ['IndiBirth']=7,
   ['SpouMarry']=0,
   ['M_B_Span']=' ',
   ['SpouDeath']=0,
   ['ChilNames']=0,
   ['MothScore']=12,
   ['IndiMarry']=0,
   ['IndiNames']=12,
   ['B_B_Span']='btw 1 Jan 1860 and 30 Dec 1870  Actual',
   ['M_A_Span']=' ',
   ['FathDeath']=0,
   ['GendScore']=0,
   ['IndiBapCh']=0,
   ['IndivGend']=0,
   ['C_B_Span']=' ',
   ['FathNames']=6,
   ['FathBapCh']=0,
   ['SpouScore']=0,
   ['MothMarry']=0,
   ['RecordIdA']=24243,
   ['MothDeath']=0,
   ['FullScore']=42,
   ['SpouBirth']=0,
   ['FathScore']=11,
   ['FamGensUp']='',
   ['RecordIdB']=21980,
   ['DateChron']=0,
   ['SpouBapCh']=0,
   ['ChilScore']=0,
   ['FathBirth']=5,
   ['ChilBapCh']=0,
   ['FamGensDn']='',
   ['ChilMarry']=0,
   ['ChilDeath']=0,
   ['C_A_Span']='27 Feb 1870  Actual',
   ['D_A_Span']='btw 31 Dec 1869 and 30 Dec 1970  Synth',
   ['IndiDeath']=0,
   ['ChilBirth']=0,
   ['MothNames']=7,
   ['MothBapCh']=0,
   ['MothBirth']=5,
   ['B_A_Span']='btw 31 Dec 1869 and 30 Dec 1870  Actual',
},
}

Find Duplicate Individuals Version 2.3+

Posted: 30 Oct 2012 15:23
by tatewise
That .nondups file is the problem.
The -- Table: {2} and -- Table: {3} entries should look similar to -- Table: {4} and -- Table: {5}.
Delete that .nondups file to fix the problem.

What is in the .nondups file of the Project you copied from?
Does that Project run the Plugin Omit Non-Duplicates tab and Show the previous Result Set OK?

Renumbering Records will not help.

Copy Project will copy the Plugin Data folder and its Find Duplicate Individuals files, but I do not understand how it would corrupt the .nondups file like that.
Try repeating the Copy Project and check the copied  .nondups file before and after running the Plugin.

Find Duplicate Individuals Version 2.3+

Posted: 30 Oct 2012 16:21
by johnmorrisoniom
Hi Mike,
I think FH froze just after running the plugin (I am having problems with my XP machine). That was likely the cause of the corruption.
I have deleted all the plugin data files.
I have now re-run the plugin and all is OK.

Find Duplicate Individuals Version 2.3+

Posted: 01 Nov 2012 14:33
by tatewise
The Find Duplicate Individuals Version 3.0 is available from the FH Plugin Store.

It has comprehensive Help & Advice pages.

The option to use the FH Named List of Non-Duplicates has been removed.
The Erase the entire Non-Duplicates list button has a confirmation popup to avoid accidental erasure.
If no duplicates are found, it presents a popup message instead of an empty Result Set.
An Erase Soundex Cache button has been added, to allow the cache to be purged of Names no longer in the database.