* Export gedcom file

[kcuypers]

Hello (Tatawise),
In version 6.2.7, I always use the Export Gedcom plugin. In version 7 the plugin does not work anymore. Is it possible, in the future? , that we will have this plugin again for version 7?
I know that you have a lot of work now with version 7, so I can wait.
Greetings

Koenraad

[tatewise]

Yes, it is in the pipeline awaiting Plugin Store approval.

[ColeValleyGirl]

It's been released, Mike.

[kcuypers]

Thanks Tatawise and ColevalleyGirl

Greetings

Koenraad

[ronk]

Testing Export Gedcom v4 for TNG, I ensured my plugin settings matched v6 and now I am comparing the imported data on TNG. Most noticeable is the loss of all my media link notes. They are not in the exported ged file. Did I miss a setting?

Also, perhaps more important, my media count should be 3562, but now is 3030. So media counts have dropped proportionately for photos,documents,headstones, and censuses. Not sure why missing media links.

If I use the standard FH 7 export, all the media links are present. Also, the FH 7 misc Statistics report indicates the proper media count of 3562. Interestingly, that new report doesn't indicate the 4044 notes in my database (TNG's count).

Ron

[tatewise]

I apologise for those problems. The FH v7 Media structure has radically changed and poses a challenge.
The limited testing that has been done did not find significant problems, but I don't have TNG so rely on others for feedback.

The plugin does now reduce the number of Media where duplicate Media would have been produced before.
However, it sounds like you are exporting entirely full-frame Media if the number in FH should equal the number in TNG.
I guess you are using File > File Statistics... in FH to get the numbers.

Where exactly do you have Media link Notes?
Is that on the Edit Media Item dialogue Link Note box and do you enable Use Link Note as Caption?

Please post screenshots of your plugin settings on the Basic Options and Extra Options tabs so I can recreate your scenario.

[ronk]

Hi Mike,
Thanks for the quick response. The notes are link notes, and the box , use link note as caption is unchecked (as I had it in FH v6 plugin v3.9 setting). Yes the media statistics are from FH v7 statistics report.

2020-12-12 A.jpg (135.34 KiB) Viewed 5742 times

2020-12-12 B.jpg (241.72 KiB) Viewed 5742 times

2020-12-12 C.jpg (159.93 KiB) Viewed 5742 times

I tried to add a 4th image, but was unable to do so in this message.

Ron

[tatewise]

Thank you, Ron. The Labels Set A/B tabs are unimportant in this context.
Let me investigate and see what is different between V3.9 and V4.0.

[ronk]

Mike,

If it helps, here's my FH 6 plugin v3.9 screen grabs:

2020-12-12_FH6 A.jpg (117.18 KiB) Viewed 5721 times

2020-12-12_FH6 B.jpg (217.04 KiB) Viewed 5721 times

2020-12-12_FH6 C.jpg (163.29 KiB) Viewed 5721 times

Have a question. Are plugin settings stored for each plugin version? Since Export Gedcom v4 is supported on FH6, can (or should) I run it there without losing my settings for v3.9?

Update: Checking past posts, I see that I should copy and rename the Export Gedcom File.dat for v3.9 before running v4 since, other than project backups, there is only one set of plugin settings (next to media folder) retained per plugin version.

Ron

[ronk]

This test was on my FH6 laptop. Since supported on FH6, I renamed the Export Gedcom File plugin .dat file for v3.9, then loaded and ran v4. The results, with brief review, look good. All the media links and media link notes are present after import to TNG.

You must have a check of FH versions for the plugin to have worked on FH 6. However, inspecting the .dat files for v3.9 and v4.0 indicates many differences with 'BeyondCompare' tool.

Outwardly though, the only setting I had to change to match plugin v3.9 was to set (File~Rel) Multimedia via Relative Link Records.

Ron

[tatewise]

Yes, there are many changes between FH v6.2 and FH v7.0 and the plugin has many new settings for all the new features.
If the Project has been 'inherited' by FH v7.0 then it has all the v3.9 plugin settings preserved as usual, but some may not be appropriate for the v4.0 plugin. Yes, all my updated plugins detect the FH version and adapt as necessary.

I have not had time to publish an updated set of Help & Advice pages for this plugin yet, but thought it worthwhile publishing the plugin itself as it used by so many.

What that help will say is assuming you've been using default settings in v3.9 then in v4.0 you must click the Reset these TNG+ Options on the first three tabs to ensure the same defaults apply, and then make any custom changes that may be necessary.

I am glad that the plugin is now working satisfactorily for you.

[ronk]

Mike,

Perhaps you misunderstood my last post. The plugin is *not* yet working properly on FH7. My last post was with the v4.0 plugin, but on FH 6. So I am still left with the missing media links, and missing link notes before I can even consider moving to FH7. The conversion did not detect the (File~Rel) setting as noted.

I will run the tests again on FH7 to confirm my findings.

Ron

[tatewise]

Sorry. My bad. I will investigate over the weekend I hope.

[ronk]

Mike,

No urgency on any of this.

I just confirmed my earlier tests with FH 7. TNG has a mod/plugin which indicates 918 media items remain unlinked. Meaning the physical images (jpgs) are present in their respective folders, but TNG has nothing in its database linking to them. Will look to see if any meaningful pattern of those skipped.

I checked the gedcom file, and the "FILE" statements are indeed missing for the missing links. The count matches the 3030 that were imported to TNG. With the default FH 7 Export function, there are 3560 "FILE" statements. Not sure on the discrepancy of 918 vs. 530, but nonetheless, a significant number of media links are skipped.

Also, confirmed there are no media link notes exporting either.

Thanks for looking into this.

Edit:Update
I found that the TNG 'mod/plugin' was actually doubling up the number of missing items, so actually 459 is closer to the count, but I expected 530 difference.

Ron

[tatewise]

I have reviewed the plugin and found some errors that I hope account for your missing media and captions.

There is still one scenario that may be an additional problem.
Do you have record level local Note fields with Source Citations and those Citations have local Media?
I don't mean Media attached to the Source record but attached directly to the Citation.
GEDCOM 5.5.1 format that I am using for TNG does not allow such Note Citations nor the attached Media, so they get converted to an extension to the Note as plain text and thus the Media link is missing.

Please try the attached Export Gedcom File plugin Version 4.0.1 Date 13 Dec 2020 and let me know if it improves things.
Due to size constraints, it is a ZIP file that will need right-click Extract All... to obtain the plugin file.
[ EDIT Attachment deleted as in Plugin Store ]

[ronk]

Mike,

This is looking really good now. I compared many TNG screens imported from FH6 to those from FH7, and media and data compares exactly. All media counts are dead on. All media link notes appear to be there. I don't have media attached to citations, so no worries there.

The only minor discrepancy, of 4044 notes, 43 appear missing. That's 1%...miniscule issue.

Nice work! Will continue running parallel for awhile, 'til other bugs shake out in the core product. But this was a huge step for me (and to the others importing to TNG from FH7).

Out of curiosity, were the captions (link notes) and missing media issues related in any way? Before your response, I had gone through the 400+ missing media, trying to see some pattern, but didn't see it. I see you added quite a few lines of code to the plugin that appear related to captions (not that I know anything about lua code).

Thanks again!

Ron

[tatewise]

Not sure why there is a discrepancy in Notes, and will keep that in mind.
Exactly what Notes are you counting and comparing?

The only significant connection between the bugs is the new Media structure, which is a challenge
One bug was a fundamental logical coding error that led to random data being discarded, not just Media links.
The other is associated with Link/Notes that are now attached to the Media links instead of the Media record.

Those will probably not be the last bugs. Thank you for your help.

[ronk]

Exactly what Notes are you counting and comparing?

It's a note link count that TNG presents in its statistics page. Not sure how it relates to the type of notes in FH. I just know if the TNG statistics match between imports from 2 versions of FH, and all screen pages match also, the export is quite good.
FH 7 introduced a statistics page (somewhat buried in Publish/Misc reports) but I didn't see notes counted, and even if it did, FH 6 didn't have a statistics report.

Even within TNG itself, I have no reliable way to know which notes are missing, particularly since they came into TNG in a slightly different order in FH7 (I believe), and thus were assigned different internal 'note IDs' , which is the way TNG notes pages are sorted. So I can't go through the pages side by side to compare.

I shouldn't be too concerned about it with such a small discrepancy. However, I will be doing more comparing to make sure the Note content is all there. I did some comparison of counts of the NOTE records in the gedcoms from FH7 and FH6 and there is quite a difference, yet the TNG statistics speak otherwise.

Thanks again for your help.

Ron

[ronk]

A difference noted in TNG from FH7 export: Notes that had single spaces between paragraphs are now double spaces. Is there a setting in FH to avoid this extra spacing?

Ron

[tatewise]

FH v6.2 and FH v7.0 both have File > File Statistics... commands that list record numbers.
The File Statistics report is very similar, with a few fact-based statistics similar to my Show Project Statistics plugin.

Please provide some examples/screenshots of the Notes spacing problem.
I don't recall an FH setting for anything like that.
It is probably the way I have coded the plugin which handles multi-line long text fields completely differently.
However, that will apply to both FH v6.2 and FH v7.0 when using plugin v4.0 or are you comparing with plugin v3.9?

[ronk]

Mike,

Thanks for the statistics references, but those FH reports don't seem to recognize notes, at least not the way TNG does. FH indicates 14 notes, TNG over 4000. That said, the File:File Statistics for FH6 and FH7 do match exactly. The Project File Statistics isn't ready for V7.

Yes, the TNG counts are compared from the import of gedcoms created by the FH 6 plugin v3.9 and FH7 plugin 4.01. Also, the 4.01 plugin yields the same TNG note counts (4001) whether run on FH6 or FH7.

Inspecting the gedcom, an observation is that the number of 'NOTE' records created in the gedcom with the plugins:
FH7 4.01 plugin --- 5802
FH6 3.9 plugin -- 5845
That difference, as perhaps expected, is the same as the discrepancy in TNG's count of notes.

Thankfully, I appear to have been mistaken about the spacing. May have mixed up gedcoms and/or plugin versions. Easy to do when working with 2 laptops side by side. Will continue to do comparisons on the TNG sides, while reviewing FH screens as well.

Thanks,

Ron

[tatewise]

I thought you said you found the File Statistics report under Publish > Miscellaneous Reports which is where it is in my FH v7.0 beta.

I think I may have found the missing NOTE items.
Do you have local Note boxes with Source Citations where the Citations (not the Source record) have local Note boxes?
In GEDCOM 5.5.1 such Source Citations on Notes are not allowed so the plugin converts them to text appended to the Note.
Therefore those Citation NOTE tags vanish.
At one stage I believed that TNG preferred the GEDCOM 5.5.1 format but that proved false and I've been undoing the associated settings for TNG ever since, and those Source Citations on Notes is one I've missed.

You may say why not simply have a GEDCOM 5.5 versus 5.5.1 switch in the plugin?
Unfortunately, some products have a novel mixture of 5.5 and 5.5.1 features, so each must be dealt with independently.

[ronk]

I think I may have found the missing NOTE items.
Do you have local Note boxes with Source Citations where the Citations (not the Source record) have local Note boxes?

Perhaps, I don't know. How would I find them? Search the FH database gedcom itself?

Ron

[tatewise]

You would need a Query that searched for INDI.NOTE2.SOUR.NOTE2 for record level Individual local Notes.
Similarly, FAM.NOTE2.SOUR.NOTE2 for Family record local Notes, and INDI.BIRT.NOTE.SOUR.NOTE and so on for fact local Notes, which would be easier in a Fact Query using FACT.NOTE2.SOUR.NOTE2.

[ronk]

OK Mike.

Thanks. But it may be a bit more than I can chew on. My work has been more on the TNG programming side (html,php, and a bit of SQL). I need to read up on the FH query function which I know is very powerful but one needs also familiarity with the record types as you have listed.

Ron