Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
how_to:import_from_tmg [2017/02/08 12:06]
tatewise [Import Guide]
how_to:import_from_tmg [2020/06/09 10:29]
tatewise [Import Guide]
Line 1: Line 1:
 +====== Import from The Master Genealogist (TMG) ======
 +
 +===== Introduction =====
 +
 +Importing from [[http://​www.whollygenes.com/​|The Master Genealogist]] (TMG) to [[Glossary:​Family Historian]] ({{fh}}) is often quite straight forward. The {{fh}} website [[fhcalico>​support/​faq-tmg|Frequently Asked Questions – for TMG Users]] gives an overview.
 +
 +The two methods for migrating from **TMG** to {{fh}} are [[#Import TMG Project]] and [[#Import GEDCOM File]]. However, [[#Import TMG Project]] does not support **TMG V7** or earlier, so install the **TMG V9** for **US** or **UK** below. See also posting [[topic>​t=13185|Import TMG project failure]].
 +
 +  * **[[http://​www.fhug.org.uk/​programs/​tmg9setup.exe|tmg9setup.exe]]** TMG Version 9.3.0.0 **US** ​
 +
 +  * **[[http://​www.fhug.org.uk/​programs/​tmg905uksetup.exe|tmg905uksetup.exe]]** TMG Version 9.5.0.0 **UK**
 +
 +===== TMG Tips =====
 +
 +Apply these tips to your **TMG Project** before migration to {{fh}}.
 +
 +If details such as **Memos** are not imported to {{fh}} then in **TMG** run all **File > Maintenance** options and try again (e.g. **Reindex**,​ **Optimise**,​ **Validate File Integrity**).
 +
 +If some **Citations** are not imported to {{fh}} (other than as noted below) then this technique may help. Create a __blank__ **TMG Project** and merge it with your __main__ **TMG Project**, then all expected **Citations** should be imported.
 +
 +TMG backups have a SQZ extension and can't be used directly, but if you copy the file to a name with a .zip extension you can use the Windows option to extract the files to a folder and then follow the instructions below to import the data to {{fh}}
 +
 +FIXME Add details about TMG data sets, projects, and merging, plus how to copy **TMG Projects** for Direct Import to {{fh}} on another PC. See Forum postings [[topic>​t=12901|Merging 2 trees]].
 +
 +===== Import TMG Project =====
 +
 +Ensure **TMG** is not running.
 +
 +Use **File > Project Window** and the **New Project** button, select **Import from other family tree file** and browse to the TMG (**.tmg** or **.pjc**) Project file. In {{fh}} **Version 6.0** click **Next>​** and review the **TMG Import Options** using the **Help** button to obtain advice. Click **Next>​** to complete the dialogue.
 +
 +This works well with most **TMG** versions and includes **Witness** details, **BUT** please ensure you are using the [[fhugdownloads:​contents:​family historian 5.x.y upgrade]] or [[fhugdownloads:​contents:​family historian 6.x.y upgrade]]. You can check this by selecting **Help > About Family Historian** on the menu.
 +
 +[[Glossary:​Calico Pie]] recommend using the **TMG** direct import as this includes **Witnesses**. {{fh}} **Version 6.0** imports them as **Fact Witnesses**. {{fh}} **Version 5.0.11** imports them in a **Note** against the **Fact**, allowing them to be processed later using [[plugins:​index|Plugins]] in {{fh}} **Version 6.0** if required. They ask that any problems are reported to them directly via the [[http://​support.calico-pie.com/​open.php|support@family-historian.co.uk]] if possible including a small sample database showing the problem.
 +
 +==== Import Guide ====
 +
 +The **TMG** items are imported as the following {{fh}} items by the [[fhugdownloads:​contents:​family historian 6.x.y upgrade]]. The import is similar using {{fh}} **Version 5.0.11**, but not so comprehensive as explained later.
 +
 +  * Every **Person** becomes an **Individual Record**
 +  * Every **Relationship Tag** becomes a **Family Record** link between parent & child
 +  * Every **Source** becomes a **Source Record** with **Title**, **Short Title** & **Type** but other fields in labelled **Notes**
 +  * Every **Repository** becomes a **Repository Record** with **Name**, **Address** & **Note** fields (but not Name-Other) ​
 +  * Every **Exhibit** becomes a **Media Record**
 +  * Every **Name Tag** becomes an **Individual Name** instance
 +  * Every **Tag** with 1 **Principal Person** becomes an **Individual Fact** (Event/​Attribute) e.g. **Birth** & **Death**
 +  * Every **Tag** with 2 **Principal Persons** as spouses/​partners becomes a **Family Fact** (Event/​Attribute)
 +  * Every **Tag** with 2 **Principal Persons** not spouses/​partners becomes an **Individual Fact** of 1st with 2nd as **Witness**
 +  * Every **Witness** becomes a **Witness** of the associated **Fact**
 +  * Every **Citation** on every item above becomes a **Citation** except :
 +    * Every **Citation** on a **Relationship Tag** is omitted
 +    * Every **Citation** linking a **Source** to a **Source** is omitted
 +    * The lowest of the five **Surety** values becomes just one **Assessment** value :
 +      * **3** -> **Primary evidence**
 +      * **2** -> **Secondary evidence**
 +      * **1** -> **Questionable**
 +      * **0** -> **Unreliable**
 +      * **--** -> **Unreliable** (TMG Negative Surety)
 +    * The **Reference** field is omitted
 +  * Every **Flag** is handled according to whether **Standard** or **Custom** and its **Value**:
 +    * **Standard Flags** :
 +      * **Sex** becomes the **Individual ~ Sex** field
 +      * **Multiple Birth** with value **> 1** imports as a **Multibirth** Flag
 +      * **Ancestor**/​**Descendant Interest** with value **> 0** import as a similarly named Flag
 +      * **Living** and **Adopted** import the same as a **Custom Flag**
 +    * **Custom Flags** :
 +      * For values **N** or **?** or **blank** the **Flag** is NOT imported
 +      * For value **Y** a **Flag** with a similar **Name** is imported
 +      * For other values a **Flag** with a similar **Name** suffixed by its **Value** is imported
 +      * Generally the **Name** will be similar, but the underlying **Tag** will be all upper-case, with punctuation symbols discarded, each space replaced by underscore, and truncated to **13** characters after the leading double underscore\\ e.g. **Is Related-by** with value **C** becomes **Is Related-by_C** and **__IS_RELATEDBYC** respectively
 +  * The **Sort Date** for every **Fact** is omitted, but see [[#Import GEDCOM File]] below.
 +  * The **Repository** of the first **Source Record** is omitted
 +  * Every link from a **Place**, **Citation**,​ or **Repository** to its **Media** is omitted
 +  * All **Bookmarks** are omitted.
 +  * The sentence definitions associated with **Tags** are omitted.
 +
 +==== Known FH V5+ Problems ====
 +
 +It seems that the {{fh}} **V5 TMG** direct import may not be working on **Windows XP** and **Vista**. If no data is imported on these OS please ensure you are running with an **Administrator** level user, this is not needed for normal operation, but may be needed when importing the TMG Foxpro database. The {{fh}} **V6 TMG** direct import is believed to be OK.
 +
 +All the following cases exist in the **sample** database of the **TMG Trial V9** at least for the [Record Id] listed.
 +
 +  * In {{fh}} **V5**, the **Witnesses** are in **Notes**, so **Citations** only exist for the **Fact** of the **Principal Person(s)**,​ which is similar to TMG, and mostly just affects:
 +    * **<color grey/​grey>​[</​color><​color yellow/​grey>​Census </​color><​color grey/​grey>​ ] ]</​color>​ ** Tag Types where **<color aqua/​aqua>​[</​color><​color black/​aqua>​ (w); </​color><​color aqua/​aqua>​]</​color>​ ** appears in **Name/​Place** with the **Principal Person**. [I1]
 +    * **<color grey/​grey>​[</​color><​color yellow/​grey>​Witness </​color><​color grey/​grey>​ ]</​color>​ ** Tag Types where **<color aqua/​aqua>​[</​color><​color black/​aqua>​ Marriage: </​color><​color aqua/​aqua>​]</​color>​ ** is in **Name/​Place** with two **Principal Persons**. [I1] in [F23]
 +
 +  * Any TMG **Note Tag** becomes a **Record Note** but its **Date** & **Citations** are omitted. [I32] & [I33]
 +
 +  * Any TMG Tag with 2 **Principal Persons** who are not parents becomes a **Fact** for both **Principal Persons**, but any **Citations** are omitted for **Principal Person 2**. Occupation of [I10]
 +
 +  * The **Sort Date** of every **Fact** is omitted, but see [[#Import GEDCOM File]] below.
 +
 +  * All **Citations** linking a **Source** to a **Source** are omitted. [S27] to [S11]
 +
 +  * The **Repository** of the first **Source Record** is omitted. [S1] & [R1]
 +
 +  * In {{fh}} **V5**, the **E-mail Message** and **Electronic Web Site** URL are omitted from **Source Records**. ​
 +
 +  * All links from any **Place** or **Citation** or **Repository** to their **Multimedia** are omitted.
 +
 +Thus there will often be a different set of **Facts** and far fewer **Citations** in {{fh}} than in **TMG**. The above Tag Types are listed in TMG **Tools > Master Events List** and **Tools > Master Tag Type List**.
 +
 +The [[topic>​t=11462|Import from TMG - Missing Some Citations]] Forum thread has prototype [[plugins:​index|Plugins]] that fix some problems.
 +
 +===== Import GEDCOM File =====
 +
 +First use the [[http://​www.whollygenes.com/​tmg.htm|TMG]] **File > Export > Gedcom (*.ged)** option to export its database in a [[Glossary:​GEDCOM]] file format.
 +
 +In the **Wizard** dialogue at **Step 5: Option screen 1** set **Version:​** to **GEDCOM 5.5** from drop-list.
 +
 +**TMG** does NOT appear to export any **Witness** associations into the [[Glossary:​GEDCOM]] file.
 +
 +**TMG** does NOT export any sentence definitions associated with fact **Tags**. ​
 +
 +The [[fhugdownloads:​contents:​tmg_to_fh_gedcom_converter]] will help convert this [[Glossary:​Gedcom]] file before importing into {{fh}}. This may correctly report **PAGE text too long in SOUR for record I99** but can be ignored because {{fh}} tolerates such over long text.
 +
 +Use **File > Project Window** and the **New Project** button, and select **Import a GEDCOM file**. The dialogue is uncomplicated,​ but in the **Check for word-wrapping errors** window, select **Each row contains 1 word with a hyphen in the middle**.
 +
 +{{  :​how_to:​importing:​checkwordwrapping.png?​300 ​ |Check for word-wrapping errors}}
 +
 +===== Import Fact Sort Dates =====
 +
 +Perform this step immediately after the **New Project** was created by the direct [[#Import TMG Project]] method above in order to migrate all **TMG Sort Dates** into the {{fh}} **Project**. This process assumes that when creating the **New Project** you **Use Default TMG Import Options**.
 +
 +In **TMG** use **Tools > Master Tag Type List** and for certain facts click the **View** button, and on its **Other** tab ensure **GEDCOM export as:** has **Tag:** set to **EVEN**. This applies to tags such as **Address**,​ **Misc**, **New Para**, **Note**, **Research Notes** & **Telephone**,​ but the [[Plugins:​Help:​Order Facts by Sort Date:Order Facts by Sort Date]] will identify those that need changing. This allows such **TMG** facts to be matched against {{fh}} facts.
 +
 +Then in **TMG** use **File > Export > Gedcom (*.ged)** to export its database in a [[Glossary:​GEDCOM]] file format.
 +
 +In the **Wizard** dialogue at **Step 5: Option screen 1** set **Version:​** to **GEDCOM 5.5**, tick the **Enhanced GEDCOM tag export** option, and untick **Suppress details for living people** to include everyone. Then at **Step 7: Option screen 3** ensure **Place Levels** has every item ticked that your project uses, such as **Addressee**,​ **Detail**, **Postal Code** & **Phone**, but NOT **Commas When Missing**. It may be necessary to create a new customised Export. DO NOT IMPORT this **GEDCOM** into {{fh}}.
 +
 +Run the [[Plugins:​Help:​Order Facts by Sort Date:Order Facts by Sort Date]] and choose the exported **GEDCOM File** to import its **_SDATE Sort Dates** into **LMO Sort Dates** for each fact.
 +
 +===== Correcting Problems =====
 +
 +Many of these issues only apply to a GEDCOM import, but some also apply to a direct import.
 +
 +If [[Glossary:​UDF]] are reported then follow the advice for [[handling_unrecognised_data_fields]].
 +
 +Any **Multimedia** record file **Format** fields with trailing space characters are treated as **Other Multimedia** that prevents images being displayed. These fields can be globally changed using the [[fhcalico>​pluginstore/​plugin-entry?​id=117|Search and Replace]] Plugin and its **Multimedia Format & Linked File fields** option.
 +
 +If a married **Individual** has no link to their **Family**, then in **TMG** ensure that the **Marriage** tag is ticked as **Primary**.
 +
 +The **UK** variant of **TMG** offers special event tags such as **Census 1841**, **Census 1851**, etc, which when exported become GEDCOM Custom Events. To change these in **TMG** use **Tools > Master Tag Type List**, select the event tag name, click **Edit** and on the **Other** tab set GEDCOM export as Tag: **CENS** or whatever standard GEDCOM tag is appropriate. Alternatively,​ the [[fhcalico>​pluginstore/​plugin-entry?​id=172|Change Any Fact Tag]] Plugin can be used in {{fh}}.
 +
 +**TMG** formatting codes within Template Sentences and Memos will appear in {{fh}} **Notes** as plain text such as **[BOLD:​]**,​ **[:​BOLD]**,​ **[UND:]**, **[:UND]**, **[ITAL:​]**,​ **[:​ITAL]**,​ etc. They may be removed using the [[fhcalico>​pluginstore/​plugin-entry?​id=117|Search and Replace]] Plugin in **LUA Pattern Mode** with **Search** string **%[.-%]** on **Note fields** only.
 +
 +In **Citations** the five TMG **Surety** values become just one **Assessment** value. In TMG the five values relate to Principal-1,​ Principal-2,​ Date, Place, and Memo fields. To get nearer to those TMG values for different fields, the same **Citation** can be added to **Fact Witnesses**,​ and the **Place** and **Note** field of each Fact, and each **Assessment** can take a different value.
 +
 +===== Quick Fix Plugins =====
 +
 +The following **Plugins** have been found beneficial by users importing from TMG. They usually produce a **Result Set** of changed items, and double-clicking any item should open its **Property Box** for review. To cancel the **Plugin** changes, use **Edit > Undo Plugin Updates** before closing {{fh}}. ​
 +
 +==== Move Death Event local Note to Cause field ====
 +
 +**{{pushfile>:​how_to:​importing:​copy_death_note_to_cause.fh_lua|Copy Death Note to Cause}}** Plugin used in Forum thread [[topic>​t=12293|TMG Import - Cause of Death​]] Feb 2015.
 +
 +If any **Death** local **Note** has more than one paragraph, then only the first is copied, and the whole **Note** retained.
 +
 +==== Move Lat,Long in Place Name to Lat/Long field ====
 +
 +**{{pushfile>:​how_to:​importing:​copy_latlong_in_name_to_latlong.fh_lua|Copy LatLong in Name to LatLong}}** used in Forum thread [[topic>​t=12297|TMG import following 6.0.2​]] Feb 2015.
 +
 +If after moving the **Lat,​Long** value to the **Lat/​Long** field, the **Place** name clashes with another **Place** record, then the **Plugin** attempts to **Merge** them. If unsuccessful,​ the **Lat,​Long** value is retained in the **Place** name as listed in the **Result Set**, and the two records must be **Merged** by hand.
 +
 +==== Import Relationship Citations ====
 +
 +The [[topic>​t=11462|Import from TMG - Missing Some Citations]] Forum thread has prototype [[plugins:​index|Plugins]] that help with parent-child relationship citations not imported to {{fh}}.
 +
 +==== Give Witnesses Their Own Facts ====
 +{{  how_to:​importing:​give_witnesses_their_own_facts.png?​210|Give Witnesses Their Own Facts}}
 +
 +The [[topic>​t=12237|Witnesses when entering Census data]] Forum thread discusses techniques for recording **Census Events** that are summarised in [[how_to:​recording_census_records|Recording Census Records]]. **TMG** typically uses one **Census Event** or one **Census (family) Event** with multiple **Witnesses**,​ whereas {{fh}} offers better support for multiple **Census Events** with a common **Source Citation**.
 +
 +The Plugin [[fhcalico>​pluginstore/​plugin-entry?​id=759|Give Witnesses Their Own Facts]] offers to convert multiple **Census Witnesses** to multiple **Census Events**.
 +
 +Then Plugin [[fhcalico>​pluginstore/​plugin-entry?​id=1871|Migrate Census Family to Individual Events]] splits each **Census (family) Event** into two **Census Events**.
 +
 +Ensure you have a recovery backup, just in case the results are not as expected!
 +
 +===== Import Discussions =====
 +
 +See the Forum threads:
 +  * [[topic>​t=5841|Migrating to FH from TMG​]] September 2011 ~ Problems due to Multimedia > Format trailing spaces
 +  * [[topic>​t=11123|Migration from TMG to FH5​]] March 2014 ~ OK
 +  * [[topic>​t=11173|Gedcom errors​]] April 2014 ~ Minor errors all corrected OK
 +  * [[topic>​t=11176|Census details import to Family Historian 5 from TMG]] April 2014 ~ Witness and UK Census problems
 +  * [[topic>​t=11350|The Master Genealogist to be Discontinued]] July 2014
 +  * [[topic>​t=11441|Selected TMG Source field not migrating to FH]] Sep/Oct 2014
 +  * [[topic>​t=11462|Import from TMG - Missing Some Citations]] Sep/Oct 2014
 +  * [[topic>​t=11612|TMG to FH - Missing source citations - Potential solution]] Oct 2014
 +  * [[topic>​t=12372|TMG Import & extra code]] Feb 2015 ~ TMG formatting codes
 +  * [[topic>​t=12416|Truncation of Media filenames on import from TMG]] Mar 2015
 +  * [[topic>​t=12745|Importing citation details]] Jul 2015 & Feb 2017 
 +  * [[topic>​t=14645|TMG to FH import of Flags]] Jan/Feb 2017 ~ TMG Flag adjustment techniques
 +
 +===== Links =====
 +
 +[[http://​www.whollygenes.com/​forums201/​index.php?/​topic/​15798-tmg-to-be-discontinued/​|TMG to be discontinued]]
 +
 +===== Related Pages =====
 +
 +  * [[Handling Renumbered Record Id]]
 +  * [[Handling Unrecognised Data Fields]]
 +  * [[:​Glossary:​Work with Fact Sets|Defining Imported Custom Facts]]
 +  * [[Fixing Dates & Date Phrases]]
 +  * [[Convert Note Records to Local Notes]]
 +  * [[Check Project Statistics & Exceptions]]
 +{{backlinks>​.}}