* Retaining TMG Source ID on Import

Importing from another genealogy program? This is the place to ask. Questions about Exporting should go in the Exporting sub-forum of the General Usage forum.
Post Reply
avatar
jbtapscott
Superstar
Posts: 483
Joined: 19 Nov 2014 17:52
Family Historian: V7
Location: Corfu, Greece
Contact:

Retaining TMG Source ID on Import

Post by jbtapscott » 19 Nov 2014 19:04

I have tried importing my TMG Project into FH and have seen some good results, but is (was) there a way to force FH to use the same Source ID as I have on the sources in TMG?.

By way of explanation, I record the TMG Source ID on each piece of "source" paperwork in my filing system as well as also recording it within the name of copies of sources stored on my laptop (eg as "S0005 Smith, John - Birth record", so would not want to renumber everything. I should perhaps add that, whilst TMG has recorded sources sequentially, I have over time deleted Source references so the record set numbering within TMG is not sequential now (viz there are gaps in the numbers).
Brent Tapscott ~ researching the Tapscott and Wallace family history
Tapscott & Wallace family tree

User avatar
tatewise
Megastar
Posts: 27088
Joined: 25 May 2010 11:00
Family Historian: V7
Location: Torbay, Devon, UK
Contact:

Re: Retaining TMG Source ID on Import

Post by tatewise » 19 Nov 2014 20:58

Usually, when importing GEDCOM files, FH does retain the Record Id of all record types where possible. (Sometimes they are too large or non-numeric.)

Presumably, you are using the recommended direct import method. I am not aware of an option to retain Record Id and a little surprised FH does not do it.

Perhaps it should be reported to Calico Pie.
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry

User avatar
LornaCraig
Megastar
Posts: 2996
Joined: 11 Jan 2005 17:36
Family Historian: V7
Location: Oxfordshire, UK

Re: Retaining TMG Source ID on Import

Post by LornaCraig » 19 Nov 2014 21:20

tatewise wrote: (Sometimes they are too large or non-numeric.).
That's probably the answer. The example given contains S0005, so I imagine the TMG source IDs are non-numeric. Assuming all the source IDs start with 'S', what is needed is some way of removing the S from them all in TMG before exporting. Even so, I don't know whether FH would retain leading zeros in the numbers.
Lorna

User avatar
mjashby
Megastar
Posts: 692
Joined: 23 Oct 2004 10:45
Family Historian: V7
Location: Yorkshire

Re: Retaining TMG Source ID on Import

Post by mjashby » 20 Nov 2014 09:28

Not sure about this. FH Source Record ID's are also preceded by an 'S' marker (in the Gedcom File), they just don't display on screen. So, if the direct import from TMG is working correctly it should, presumably, be importing these ID's properly but 'failing' to display the 'S' on screen.

Is it possible that the lack of a visible 'S' in Family Historian is the 'problem', or are the numeric elements of ID's also being changed on import because it is seeing the TMG ID's as text?

Mervyn

User avatar
tatewise
Megastar
Posts: 27088
Joined: 25 May 2010 11:00
Family Historian: V7
Location: Torbay, Devon, UK
Contact:

Re: Retaining TMG Source ID on Import

Post by tatewise » 20 Nov 2014 09:33

Those explanations only really hold water for GEDCOM import.

For direct TMG database import, FH knows the database structure. So should know every Source record id starts with 'S', and that every other record type id also starts with a known letter. Thus those initial letters should be removed to form the numerical Rec Id.

The user cannot remove the letters, because they are automatically assigned by TMG in its database, in the same way similar initial letters are automatically added to Rec Id in GEDCOM files, and automatically removed when FH imports/opens GEDCOM files.
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry

User avatar
NickWalker
Megastar
Posts: 2401
Joined: 02 Jan 2004 17:39
Family Historian: V7
Location: Lancashire, UK
Contact:

Re: Retaining TMG Source ID on Import

Post by NickWalker » 20 Nov 2014 12:59

Presumably FH ought to at least offer to retain the original IDs as custom IDs? Personally I think the IDs in a GEDCOM file are really there largely for technical reasons to link data together and should therefore be considered changeable whereas the custom IDs are there if you want to rely on them always staying the same.

The custom ID is referred to as a 'user reference number' in the GEDCOM standard and the description of this field matches what I thought:
A user-defined number or text that the submitter uses to identify this record. For instance, it may be a record number within the submitter's automated or manual system, or it may be a page and position number on a pedigree chart.
Nick Walker
Ancestral Sources Developer

https://fhug.org.uk/kb/kb-article/ancestral-sources/

avatar
jbtapscott
Superstar
Posts: 483
Joined: 19 Nov 2014 17:52
Family Historian: V7
Location: Corfu, Greece
Contact:

Re: Retaining TMG Source ID on Import

Post by jbtapscott » 20 Nov 2014 16:15

Sorry, should have said - the "S" in my file name was just my indicator to show it was a source record file. My TMG just uses the "standard" record identifier which is, on the face of it, numeric. My import was done using the recommended direct import method - I'm not a great fan of the Gedcom approach as, even with (in my opinion) my relatively basic use of TMG, I have found in the past that quite a bit of my data did not get exported when I have created Gedcom file from my project.

I think I'll drop Calicoe Pie a line to get their view on this. Many thanks though for responses to date.
Brent Tapscott ~ researching the Tapscott and Wallace family history
Tapscott & Wallace family tree

User avatar
tatewise
Megastar
Posts: 27088
Joined: 25 May 2010 11:00
Family Historian: V7
Location: Torbay, Devon, UK
Contact:

Re: Retaining TMG Source ID on Import

Post by tatewise » 20 Nov 2014 16:28

I guess I should have asked originally, and maybe you have checked, but I presume you are saying that FH definitely does NOT use the same Rec Id as TNG, and renumbers the Source Records is some arbitrary way?
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry

avatar
jbtapscott
Superstar
Posts: 483
Joined: 19 Nov 2014 17:52
Family Historian: V7
Location: Corfu, Greece
Contact:

Re: Retaining TMG Source ID on Import

Post by jbtapscott » 20 Nov 2014 17:08

Looking at the Sources Record List on FH, the "Record ID" field starts at 1 and runs on sequentially from there, whereas within TMG, the "Source #" (on my data) runs 1,2,3,4,7,8........ (the missing 5 and 6 representing Sources that I subsequently removed from TMG some years ago). I am assuming "Record ID" and "Source #" represent the same thing - viz. the record identifier for a given source record.
Brent Tapscott ~ researching the Tapscott and Wallace family history
Tapscott & Wallace family tree

User avatar
tatewise
Megastar
Posts: 27088
Joined: 25 May 2010 11:00
Family Historian: V7
Location: Torbay, Devon, UK
Contact:

Re: Retaining TMG Source ID on Import

Post by tatewise » 20 Nov 2014 21:43

Yes, you obviously had checked, and I am sorry to have doubted you.
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry

avatar
jbtapscott
Superstar
Posts: 483
Joined: 19 Nov 2014 17:52
Family Historian: V7
Location: Corfu, Greece
Contact:

Re: Retaining TMG Source ID on Import

Post by jbtapscott » 21 Nov 2014 10:21

I have now gone a step further and tried a Gedcom import from the same TMG project. This resulted in FH recording the same Source ID as the TMG records, and also the same Repository ID as the TMG records (the original direct import renumbered Repository but as I don't have many I was not too worried about that!). So it looks as if my problem was with the direct import process.

As a side issue, I also found that the Gedcom import also brought in to FH more of the information stored on the TMG Source record (by way of explanation - my source record also had things like, for a Census record, the PRO Ref, the Registered Address, Date I found the data, etc).

I'll now start having another look at FH (Gedcom Import) and see what my other data looks like!
Brent Tapscott ~ researching the Tapscott and Wallace family history
Tapscott & Wallace family tree

User avatar
tatewise
Megastar
Posts: 27088
Joined: 25 May 2010 11:00
Family Historian: V7
Location: Torbay, Devon, UK
Contact:

Re: Retaining TMG Source ID on Import

Post by tatewise » 21 Nov 2014 11:44

I know it is not ideal, but if you use both import modes, you could then merge the two Projects and pick the best parts from each.
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry

avatar
jbtapscott
Superstar
Posts: 483
Joined: 19 Nov 2014 17:52
Family Historian: V7
Location: Corfu, Greece
Contact:

Re: Retaining TMG Source ID on Import

Post by jbtapscott » 22 Nov 2014 15:20

Thanks for the feedback / suggestions Mike - I'll carry on looking at different options / formats within FH (so far, I am generally liking what I see!), and will then try a project merge.
Brent Tapscott ~ researching the Tapscott and Wallace family history
Tapscott & Wallace family tree

User avatar
JohnLiddle
Platinum
Posts: 44
Joined: 24 May 2006 21:48
Family Historian: V7
Location: Backwell, North Somerset

Re: Retaining TMG Source ID on Import

Post by JohnLiddle » 24 Nov 2014 10:59

I think that FH should really be configured to honour what it finds in a TMG file when it does a direct import. This is something Calico Pie need to address.

However, in the absence of rapid progress on that front, it should be eminently possible to fill the gaps in source numbering in TMG.

Go to Master Source List, select any source, copy it and then amend its title to "Blank Source" or something similar. The source does not need to have any information in it.

Select (highlight) the source in the master source list.

Select "Renumber" from the buttons on the RHS of the Source list window.

A dialogue pops up allowing you to renumber the source - using the "Renumber one source" option, position the cursor in the "To" box. Press F2 to bring up a list of unused source numbers - your gaps will show here. Select one of the gap numbers. Select OK and you have filled one gap.

Repeat copying and renumbering this blank source until your gaps are filled.

Then when you import the project, you can just select and delete the blank sources, thus retaining your numbering.

Hope this helps,
John Liddle
Backwell, North Somerset - "Where the cider apples grow"

avatar
jbtapscott
Superstar
Posts: 483
Joined: 19 Nov 2014 17:52
Family Historian: V7
Location: Corfu, Greece
Contact:

Re: Retaining TMG Source ID on Import

Post by jbtapscott » 28 Nov 2014 15:42

Thanks for that John - I was thinking about something similar myself, but then when I started looking further I found that, after a direct import, and although I thought FH had numbered the sources sequentially, I subsequently found a number of gaps in the numbering (eg a jump from Source ID 361 to 375 within FH). Within TMG, the two sources had sequential numbers so I don't really know what is going on.

That said, I am leaning towards stepping back even further and removing the Source ID element within the names of my file copies so I don't have to worry about renumbering. I can use the Attach Multimedia options to then incorporate the files (as links) to Sources and let FH rename the files to match the Source Title within FH. I am also considering re-entering some source data using Ancestral Sources, particularly some of the "bigger" census pieces, and let AS / FH overwrite the data imported from TMG. That way, the layout (in terms of what data is in what field within FH) would be consistent and I think the amount of manual cut & paste would be reduced.

A by-product of this approach is that, while very time consuming, it will force me to review something approaching fifteen years worth of collected source data as I go along.
Brent Tapscott ~ researching the Tapscott and Wallace family history
Tapscott & Wallace family tree

User avatar
JohnLiddle
Platinum
Posts: 44
Joined: 24 May 2006 21:48
Family Historian: V7
Location: Backwell, North Somerset

Re: Retaining TMG Source ID on Import

Post by JohnLiddle » 01 Dec 2014 20:00

"I subsequently found a number of gaps in the numbering (eg a jump from Source ID 361 to 375 within FH). Within TMG, the two sources had sequential numbers so I don't really know what is going on"

That is weird - presumably you had run the Optimise - VFI - Optimise routine in TMG before attempting the direct import?
John Liddle
Backwell, North Somerset - "Where the cider apples grow"

avatar
jbtapscott
Superstar
Posts: 483
Joined: 19 Nov 2014 17:52
Family Historian: V7
Location: Corfu, Greece
Contact:

Re: Retaining TMG Source ID on Import

Post by jbtapscott » 06 Dec 2014 15:26

Yes, I ran all the maintenance options within TMG (although I know some duplicate the work done by others!). I'll wait for V6 before really starting in earnest, but at the moment the Gedcom option seems to carry more of my TMG data over to FH than the direct import approach.
Brent Tapscott ~ researching the Tapscott and Wallace family history
Tapscott & Wallace family tree

avatar
rjbawden
Silver
Posts: 5
Joined: 02 Jan 2015 16:21
Family Historian: V6
Location: Guildford

Re: Retaining TMG Source ID on Import

Post by rjbawden » 04 Jan 2015 17:47

Just to note I have the same problem with my direct import (Santa didn't bring me a version of FH so I downloaded the trial version the other day and have only just started playing). I have emailed a description to FH Support so they know that there's at least one more TMG user looking for an answer!

Post Reply