Differences

This shows you the differences between two versions of the page.

--- how_to:import_from_tmg [2017/02/06 23:00]
tatewise [Import Guide]
+++ how_to:import_from_tmg [2020/06/09 10:29]
tatewise [Import Guide]
@@ Line 1: / Line 1: @@
+====== Import from The Master Genealogist (TMG) ======
+===== Introduction =====
+Importing from [[http://www.whollygenes.com/|The Master Genealogist]] (TMG) to [[Glossary:Family Historian]] ({{fh}}) is often quite straight forward. The {{fh}} website [[fhcalico>support/faq-tmg|Frequently Asked Questions – for TMG Users]] gives an overview.
+The two methods for migrating from **TMG** to {{fh}} are [[#Import TMG Project]] and [[#Import GEDCOM File]]. However, [[#Import TMG Project]] does not support **TMG V7** or earlier, so install the **TMG V9** for **US** or **UK** below. See also posting [[topic>t=13185|Import TMG project failure]].
+  * **[[http://www.fhug.org.uk/programs/tmg9setup.exe|tmg9setup.exe]]** TMG Version 9.3.0.0 **US**
+  * **[[http://www.fhug.org.uk/programs/tmg905uksetup.exe|tmg905uksetup.exe]]** TMG Version 9.5.0.0 **UK**
+===== TMG Tips =====
+Apply these tips to your **TMG Project** before migration to {{fh}}.
+If details such as **Memos** are not imported to {{fh}} then in **TMG** run all **File > Maintenance** options and try again (e.g. **Reindex**, **Optimise**, **Validate File Integrity**).
+If some **Citations** are not imported to {{fh}} (other than as noted below) then this technique may help. Create a __blank__ **TMG Project** and merge it with your __main__ **TMG Project**, then all expected **Citations** should be imported.
+TMG backups have a SQZ extension and can't be used directly, but if you copy the file to a name with a .zip extension you can use the Windows option to extract the files to a folder and then follow the instructions below to import the data to {{fh}}
+FIXME Add details about TMG data sets, projects, and merging, plus how to copy **TMG Projects** for Direct Import to {{fh}} on another PC. See Forum postings [[topic>t=12901|Merging 2 trees]].
+===== Import TMG Project =====
+Ensure **TMG** is not running.
+Use **File > Project Window** and the **New Project** button, select **Import from other family tree file** and browse to the TMG (**.tmg** or **.pjc**) Project file. In {{fh}} **Version 6.0** click **Next>** and review the **TMG Import Options** using the **Help** button to obtain advice. Click **Next>** to complete the dialogue.
+This works well with most **TMG** versions and includes **Witness** details, **BUT** please ensure you are using the [[fhugdownloads:contents:family historian 5.x.y upgrade]] or [[fhugdownloads:contents:family historian 6.x.y upgrade]]. You can check this by selecting **Help > About Family Historian** on the menu.
+[[Glossary:Calico Pie]] recommend using the **TMG** direct import as this includes **Witnesses**. {{fh}} **Version 6.0** imports them as **Fact Witnesses**. {{fh}} **Version 5.0.11** imports them in a **Note** against the **Fact**, allowing them to be processed later using [[plugins:index|Plugins]] in {{fh}} **Version 6.0** if required. They ask that any problems are reported to them directly via the [[http://support.calico-pie.com/open.php|support@family-historian.co.uk]] if possible including a small sample database showing the problem.
+==== Import Guide ====
+The **TMG** items are imported as the following {{fh}} items by the [[fhugdownloads:contents:family historian 6.x.y upgrade]]. The import is similar using {{fh}} **Version 5.0.11**, but not so comprehensive as explained later.
+  * Every **Person** becomes an **Individual Record**
+  * Every **Relationship Tag** becomes a **Family Record** link between parent & child
+  * Every **Source** becomes a **Source Record** with **Title**, **Short Title** & **Type** but other fields in labelled **Notes**
+  * Every **Repository** becomes a **Repository Record** with **Name**, **Address** & **Note** fields (but not Name-Other)
+  * Every **Exhibit** becomes a **Media Record**
+  * Every **Name Tag** becomes an **Individual Name** instance
+  * Every **Tag** with 1 **Principal Person** becomes an **Individual Fact** (Event/Attribute) e.g. **Birth** & **Death**
+  * Every **Tag** with 2 **Principal Persons** as spouses/partners becomes a **Family Fact** (Event/Attribute)
+  * Every **Tag** with 2 **Principal Persons** not spouses/partners becomes an **Individual Fact** of 1st with 2nd as **Witness**
+  * Every **Witness** becomes a **Witness** of the associated **Fact**
+  * Every **Citation** on every item above becomes a **Citation** except :
+    * Every **Citation** on a **Relationship Tag** is omitted
+    * Every **Citation** linking a **Source** to a **Source** is omitted
+    * The lowest of the five **Surety** values becomes just one **Assessment** value :
+      * **3** -> **Primary evidence**
+      * **2** -> **Secondary evidence**
+      * **1** -> **Questionable**
+      * **0** -> **Unreliable**
+      * **--** -> **Unreliable** (TMG Negative Surety)
+    * The **Reference** field is omitted
+  * Every **Flag** is handled according to whether **Standard** or **Custom** and its **Value**:
+    * **Standard Flags** :
+      * **Sex** becomes the **Individual ~ Sex** field
+      * **Multiple Birth** with value **> 1** imports as a **Multibirth** Flag
+      * **Ancestor**/**Descendant Interest** with value **> 0** import as a similarly named Flag
+      * **Living** and **Adopted** import the same as a **Custom Flag**
+    * **Custom Flags** :
+      * For values **N** or **?** or **blank** the **Flag** is NOT imported
+      * For value **Y** a **Flag** with a similar **Name** is imported
+      * For other values a **Flag** with a similar **Name** suffixed by its **Value** is imported
+      * Generally the **Name** will be similar, but the underlying **Tag** will be all upper-case, with punctuation symbols discarded, each space replaced by underscore, and truncated to **13** characters after the leading double underscore\\ e.g. **Is Related-by** with value **C** becomes **Is Related-by_C** and **__IS_RELATEDBYC** respectively
+  * The **Sort Date** for every **Fact** is omitted, but see [[#Import GEDCOM File]] below.
+  * The **Repository** of the first **Source Record** is omitted
+  * Every link from a **Place**, **Citation**, or **Repository** to its **Media** is omitted
+  * All **Bookmarks** are omitted.
+  * The sentence definitions associated with **Tags** are omitted.
+==== Known FH V5+ Problems ====
+It seems that the {{fh}} **V5 TMG** direct import may not be working on **Windows XP** and **Vista**. If no data is imported on these OS please ensure you are running with an **Administrator** level user, this is not needed for normal operation, but may be needed when importing the TMG Foxpro database. The {{fh}} **V6 TMG** direct import is believed to be OK.
+All the following cases exist in the **sample** database of the **TMG Trial V9** at least for the [Record Id] listed.
+  * In {{fh}} **V5**, the **Witnesses** are in **Notes**, so **Citations** only exist for the **Fact** of the **Principal Person(s)**, which is similar to TMG, and mostly just affects:
+    * **<color grey/grey>[</color><color yellow/grey>Census </color><color grey/grey> ] ]</color> ** Tag Types where **<color aqua/aqua>[</color><color black/aqua> (w); </color><color aqua/aqua>]</color> ** appears in **Name/Place** with the **Principal Person**. [I1]
+    * **<color grey/grey>[</color><color yellow/grey>Witness </color><color grey/grey> ]</color> ** Tag Types where **<color aqua/aqua>[</color><color black/aqua> Marriage: </color><color aqua/aqua>]</color> ** is in **Name/Place** with two **Principal Persons**. [I1] in [F23]
+  * Any TMG **Note Tag** becomes a **Record Note** but its **Date** & **Citations** are omitted. [I32] & [I33]
+  * Any TMG Tag with 2 **Principal Persons** who are not parents becomes a **Fact** for both **Principal Persons**, but any **Citations** are omitted for **Principal Person 2**. Occupation of [I10]
+  * The **Sort Date** of every **Fact** is omitted, but see [[#Import GEDCOM File]] below.
+  * All **Citations** linking a **Source** to a **Source** are omitted. [S27] to [S11]
+  * The **Repository** of the first **Source Record** is omitted. [S1] & [R1]
+  * In {{fh}} **V5**, the **E-mail Message** and **Electronic Web Site** URL are omitted from **Source Records**.
+  * All links from any **Place** or **Citation** or **Repository** to their **Multimedia** are omitted.
+Thus there will often be a different set of **Facts** and far fewer **Citations** in {{fh}} than in **TMG**. The above Tag Types are listed in TMG **Tools > Master Events List** and **Tools > Master Tag Type List**.
+The [[topic>t=11462|Import from TMG - Missing Some Citations]] Forum thread has prototype [[plugins:index|Plugins]] that fix some problems.
+===== Import GEDCOM File =====
+First use the [[http://www.whollygenes.com/tmg.htm|TMG]] **File > Export > Gedcom (*.ged)** option to export its database in a [[Glossary:GEDCOM]] file format.
+In the **Wizard** dialogue at **Step 5: Option screen 1** set **Version:** to **GEDCOM 5.5** from drop-list.
+**TMG** does NOT appear to export any **Witness** associations into the [[Glossary:GEDCOM]] file.
+**TMG** does NOT export any sentence definitions associated with fact **Tags**.
+The [[fhugdownloads:contents:tmg_to_fh_gedcom_converter]] will help convert this [[Glossary:Gedcom]] file before importing into {{fh}}. This may correctly report **PAGE text too long in SOUR for record I99** but can be ignored because {{fh}} tolerates such over long text.
+Use **File > Project Window** and the **New Project** button, and select **Import a GEDCOM file**. The dialogue is uncomplicated, but in the **Check for word-wrapping errors** window, select **Each row contains 1 word with a hyphen in the middle**.
+{{  :how_to:importing:checkwordwrapping.png?300  |Check for word-wrapping errors}}
+===== Import Fact Sort Dates =====
+Perform this step immediately after the **New Project** was created by the direct [[#Import TMG Project]] method above in order to migrate all **TMG Sort Dates** into the {{fh}} **Project**. This process assumes that when creating the **New Project** you **Use Default TMG Import Options**.
+In **TMG** use **Tools > Master Tag Type List** and for certain facts click the **View** button, and on its **Other** tab ensure **GEDCOM export as:** has **Tag:** set to **EVEN**. This applies to tags such as **Address**, **Misc**, **New Para**, **Note**, **Research Notes** & **Telephone**, but the [[Plugins:Help:Order Facts by Sort Date:Order Facts by Sort Date]] will identify those that need changing. This allows such **TMG** facts to be matched against {{fh}} facts.
+Then in **TMG** use **File > Export > Gedcom (*.ged)** to export its database in a [[Glossary:GEDCOM]] file format.
+In the **Wizard** dialogue at **Step 5: Option screen 1** set **Version:** to **GEDCOM 5.5**, tick the **Enhanced GEDCOM tag export** option, and untick **Suppress details for living people** to include everyone. Then at **Step 7: Option screen 3** ensure **Place Levels** has every item ticked that your project uses, such as **Addressee**, **Detail**, **Postal Code** & **Phone**, but NOT **Commas When Missing**. It may be necessary to create a new customised Export. DO NOT IMPORT this **GEDCOM** into {{fh}}.
+Run the [[Plugins:Help:Order Facts by Sort Date:Order Facts by Sort Date]] and choose the exported **GEDCOM File** to import its **_SDATE Sort Dates** into **LMO Sort Dates** for each fact.
+===== Correcting Problems =====
+Many of these issues only apply to a GEDCOM import, but some also apply to a direct import.
+If [[Glossary:UDF]] are reported then follow the advice for [[handling_unrecognised_data_fields]].
+Any **Multimedia** record file **Format** fields with trailing space characters are treated as **Other Multimedia** that prevents images being displayed. These fields can be globally changed using the [[fhcalico>pluginstore/plugin-entry?id=117|Search and Replace]] Plugin and its **Multimedia Format & Linked File fields** option.
+If a married **Individual** has no link to their **Family**, then in **TMG** ensure that the **Marriage** tag is ticked as **Primary**.
+The **UK** variant of **TMG** offers special event tags such as **Census 1841**, **Census 1851**, etc, which when exported become GEDCOM Custom Events. To change these in **TMG** use **Tools > Master Tag Type List**, select the event tag name, click **Edit** and on the **Other** tab set GEDCOM export as Tag: **CENS** or whatever standard GEDCOM tag is appropriate. Alternatively, the [[fhcalico>pluginstore/plugin-entry?id=172|Change Any Fact Tag]] Plugin can be used in {{fh}}.
+**TMG** formatting codes within Template Sentences and Memos will appear in {{fh}} **Notes** as plain text such as **[BOLD:]**, **[:BOLD]**, **[UND:]**, **[:UND]**, **[ITAL:]**, **[:ITAL]**, etc. They may be removed using the [[fhcalico>pluginstore/plugin-entry?id=117|Search and Replace]] Plugin in **LUA Pattern Mode** with **Search** string **%[.-%]** on **Note fields** only.
+In **Citations** the five TMG **Surety** values become just one **Assessment** value. In TMG the five values relate to Principal-1, Principal-2, Date, Place, and Memo fields. To get nearer to those TMG values for different fields, the same **Citation** can be added to **Fact Witnesses**, and the **Place** and **Note** field of each Fact, and each **Assessment** can take a different value.
+===== Quick Fix Plugins =====
+The following **Plugins** have been found beneficial by users importing from TMG. They usually produce a **Result Set** of changed items, and double-clicking any item should open its **Property Box** for review. To cancel the **Plugin** changes, use **Edit > Undo Plugin Updates** before closing {{fh}}.
+==== Move Death Event local Note to Cause field ====
+**{{pushfile>:how_to:importing:copy_death_note_to_cause.fh_lua|Copy Death Note to Cause}}** Plugin used in Forum thread [[topic>t=12293|TMG Import - Cause of Death]] Feb 2015.
+If any **Death** local **Note** has more than one paragraph, then only the first is copied, and the whole **Note** retained.
+==== Move Lat,Long in Place Name to Lat/Long field ====
+**{{pushfile>:how_to:importing:copy_latlong_in_name_to_latlong.fh_lua|Copy LatLong in Name to LatLong}}** used in Forum thread [[topic>t=12297|TMG import following 6.0.2]] Feb 2015.
+If after moving the **Lat,Long** value to the **Lat/Long** field, the **Place** name clashes with another **Place** record, then the **Plugin** attempts to **Merge** them. If unsuccessful, the **Lat,Long** value is retained in the **Place** name as listed in the **Result Set**, and the two records must be **Merged** by hand.
+==== Import Relationship Citations ====
+The [[topic>t=11462|Import from TMG - Missing Some Citations]] Forum thread has prototype [[plugins:index|Plugins]] that help with parent-child relationship citations not imported to {{fh}}.
+==== Give Witnesses Their Own Facts ====
+{{  how_to:importing:give_witnesses_their_own_facts.png?210|Give Witnesses Their Own Facts}}
+The [[topic>t=12237|Witnesses when entering Census data]] Forum thread discusses techniques for recording **Census Events** that are summarised in [[how_to:recording_census_records|Recording Census Records]]. **TMG** typically uses one **Census Event** or one **Census (family) Event** with multiple **Witnesses**, whereas {{fh}} offers better support for multiple **Census Events** with a common **Source Citation**.
+The Plugin [[fhcalico>pluginstore/plugin-entry?id=759|Give Witnesses Their Own Facts]] offers to convert multiple **Census Witnesses** to multiple **Census Events**.
+Then Plugin [[fhcalico>pluginstore/plugin-entry?id=1871|Migrate Census Family to Individual Events]] splits each **Census (family) Event** into two **Census Events**.
+Ensure you have a recovery backup, just in case the results are not as expected!
+===== Import Discussions =====
+See the Forum threads:
+  * [[topic>t=5841|Migrating to FH from TMG]] September 2011 ~ Problems due to Multimedia > Format trailing spaces
+  * [[topic>t=11123|Migration from TMG to FH5]] March 2014 ~ OK
+  * [[topic>t=11173|Gedcom errors]] April 2014 ~ Minor errors all corrected OK
+  * [[topic>t=11176|Census details import to Family Historian 5 from TMG]] April 2014 ~ Witness and UK Census problems
+  * [[topic>t=11350|The Master Genealogist to be Discontinued]] July 2014
+  * [[topic>t=11441|Selected TMG Source field not migrating to FH]] Sep/Oct 2014
+  * [[topic>t=11462|Import from TMG - Missing Some Citations]] Sep/Oct 2014
+  * [[topic>t=11612|TMG to FH - Missing source citations - Potential solution]] Oct 2014
+  * [[topic>t=12372|TMG Import & extra code]] Feb 2015 ~ TMG formatting codes
+  * [[topic>t=12416|Truncation of Media filenames on import from TMG]] Mar 2015
+  * [[topic>t=12745|Importing citation details]] Jul 2015 & Feb 2017
+  * [[topic>t=14645|TMG to FH import of Flags]] Jan/Feb 2017 ~ TMG Flag adjustment techniques
+===== Links =====
+[[http://www.whollygenes.com/forums201/index.php?/topic/15798-tmg-to-be-discontinued/|TMG to be discontinued]]
+===== Related Pages =====
+  * [[Handling Renumbered Record Id]]
+  * [[Handling Unrecognised Data Fields]]
+  * [[:Glossary:Work with Fact Sets|Defining Imported Custom Facts]]
+  * [[Fixing Dates & Date Phrases]]
+  * [[Convert Note Records to Local Notes]]
+  * [[Check Project Statistics & Exceptions]]
+{{backlinks>.}}