* Cleanup Notes 1.2

For users to report plugin bugs and request plugin enhancements; and for authors to test new/new versions of plugins, and to discuss plugin development (in the Programming Technicalities sub-forum). If you want advice on choosing or using a plugin, please ask in General Usage or an appropriate sub-forum.
Post Reply
User avatar
ronk
Superstar
Posts: 428
Joined: 19 Feb 2016 22:50
Family Historian: V7
Location: MN, USA
Contact:

Cleanup Notes 1.2

Post by ronk » 02 Feb 2021 02:48

I did a a test of Cleanup Notes 1.2 just released for FH 7. and did an export immediately after. I then compared a gedcom exported before and after running the plugin. The results were identical, except, several source citations to local notes were inexplicably removed from the output, so I have reverted to a backup. It did correctly remove a couple blank lines at front end of some local notes.

Brings up a simple question. In FH, how to I quickly see all citations for a given source? In TNG, I merely click on the source and links are displayed. I click on Source tab, and it shows how many citations, but no list link.
Last edited by ronk on 02 Feb 2021 12:22, edited 1 time in total.
Ron Krzmarzick~~ FH 7.0.20 TNG 14.0.2 website Roots & Relatives Remembered, Laragon 5.0, Win 11 pro

avatar
jbtapscott
Superstar
Posts: 483
Joined: 19 Nov 2014 17:52
Family Historian: V7
Location: Corfu, Greece
Contact:

Re: Cleanup Notes 1.2

Post by jbtapscott » 02 Feb 2021 06:37

Select your Source record and then, on the menu, select View / Citations to Source Record
Brent Tapscott ~ researching the Tapscott and Wallace family history
Tapscott & Wallace family tree

User avatar
Jane
Site Admin
Posts: 8441
Joined: 01 Nov 2002 15:00
Family Historian: V7
Location: Somerset, England
Contact:

Re: Cleanup Notes 1.2

Post by Jane » 02 Feb 2021 09:17

If possible to send me a copy of the file before you ran it with details of which notes were lost.
Jane
My Family History : My Photography "Knowledge is knowing that a tomato is a fruit. Wisdom is not putting it in a fruit salad."

User avatar
ronk
Superstar
Posts: 428
Joined: 19 Feb 2016 22:50
Family Historian: V7
Location: MN, USA
Contact:

Re: Cleanup Notes 1.2

Post by ronk » 02 Feb 2021 12:44

Hi Jane,

It wasn't notes that were lost, but a few citations to notes. I wasn't sure how to send files to you on FHUG. Clicking email doesn't seem to permit it. I have inserted an image of all differences from BeyondCompare of both exported gedcoms, which isn't of much use without the actual files, but just to show types of records altered before/after. The right side is an export before running Cleanup Notes, the left after. Note that two of the changes are mine: addition of children, and the prefix 'I' to 'P' change in the four urls. Also included is a blowup of detail around the lost citation.

***removed since another plugin involved***

Are you asking for the full FH data ged file?
Last edited by ronk on 03 Feb 2021 00:47, edited 3 times in total.
Ron Krzmarzick~~ FH 7.0.20 TNG 14.0.2 website Roots & Relatives Remembered, Laragon 5.0, Win 11 pro

User avatar
tatewise
Megastar
Posts: 27079
Joined: 25 May 2010 11:00
Family Historian: V7
Location: Torbay, Devon, UK
Contact:

Re: Cleanup Notes 1.2

Post by tatewise » 02 Feb 2021 13:18

Ron, what manner of export are you using? Export Gedcom File plugin? What target product?

GEDCOM 5.5.1 does not allow Notes to have Citations so the plugin often 'adjusts' them for some products.
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry

User avatar
ronk
Superstar
Posts: 428
Joined: 19 Feb 2016 22:50
Family Historian: V7
Location: MN, USA
Contact:

Re: Cleanup Notes 1.2

Post by ronk » 02 Feb 2021 18:29

Sorry, you're right; I should have included that information. Target was TNG, and the snapshots were showing differences in output using the lastest Export Gedcom File V4.3, before and after the installation and run of Cleanup Notes. 1.2. I could run again to confirm if necessary.
Ron Krzmarzick~~ FH 7.0.20 TNG 14.0.2 website Roots & Relatives Remembered, Laragon 5.0, Win 11 pro

User avatar
tatewise
Megastar
Posts: 27079
Joined: 25 May 2010 11:00
Family Historian: V7
Location: Torbay, Devon, UK
Contact:

Re: Cleanup Notes 1.2

Post by tatewise » 02 Feb 2021 20:29

To see the effect of the Cleanup Notes plugin you need to compare the Project GEDCOM before and after, not any export.

Export Gedcom File makes significant changes the GEDCOM to suit the target product as I'm sure you know.
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry

User avatar
ronk
Superstar
Posts: 428
Joined: 19 Feb 2016 22:50
Family Historian: V7
Location: MN, USA
Contact:

Re: Cleanup Notes 1.2

Post by ronk » 02 Feb 2021 21:53

Thanks Mike, yes I took that route to see TNG impact. And if nothing else has changed but the running of Cleanup Notes 1.2, wouldn't the export comparision of changes be caused by that?

I will compare the project gedcom, but I expect the same or similar results.
Ron Krzmarzick~~ FH 7.0.20 TNG 14.0.2 website Roots & Relatives Remembered, Laragon 5.0, Win 11 pro

User avatar
tatewise
Megastar
Posts: 27079
Joined: 25 May 2010 11:00
Family Historian: V7
Location: Torbay, Devon, UK
Contact:

Re: Cleanup Notes 1.2

Post by tatewise » 02 Feb 2021 22:37

I take your point, but some of the Export Gedcom File settings have changed recently to accommodate the nuances of Notes with Citations. You have also had some issues with those plugin settings recently. The Plugin tends to remember settings in Projects where it has been used before unless you use the Reset buttons. That can inhibit the corrected settings from taking effect. Whereas, when the Plugin is used in a new Project only the latest settings are applied. So there is some doubt in my mind about whether your two sample exported TNG GEDCOM were created using the same rules.

Comparing the Project GEDCOM can never be in doubt.
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry

User avatar
ronk
Superstar
Posts: 428
Joined: 19 Feb 2016 22:50
Family Historian: V7
Location: MN, USA
Contact:

Re: Cleanup Notes 1.2

Post by ronk » 03 Feb 2021 00:43

OK, so I compared the Project Gedcoms, doing a Gedcom backup before the Cleanup Notes 1.2 execution. The results are essentially the same, with several citations to notes being dropped. The changes otherwise so minor, that I will likely not use this plugin if it has this peculiar result. The BEF is on the left in both snaps.
snap1.jpg
snap1.jpg (268.22 KiB) Viewed 3268 times
snap1.jpg
snap1.jpg (268.22 KiB) Viewed 3268 times
I wasn't sure how to send the project file for inspection privately. It seemed like private messages to Jane wouldn't permit it.
Attachments
snap2.jpg
snap2.jpg (79.64 KiB) Viewed 3268 times
Ron Krzmarzick~~ FH 7.0.20 TNG 14.0.2 website Roots & Relatives Remembered, Laragon 5.0, Win 11 pro

User avatar
tatewise
Megastar
Posts: 27079
Joined: 25 May 2010 11:00
Family Historian: V7
Location: Torbay, Devon, UK
Contact:

Re: Cleanup Notes 1.2

Post by tatewise » 03 Feb 2021 11:28

I have checked the Clean Up Notes plugin and, Ron, you are absolutely correct.
1) It removes all Citations from local Notes!
2) It removes rich text formatting from Notes too!
3) Possible CopyChildBranch needs updating to Copy Child Branch Fields

1) seems to be a bug in the FH API when using fhSetValueAsText(...) to save the Note it removes the Citations.
(This may be a side-effect of Note Citations not strictly being allowed in GEDCOM 5.5.1 but FH does not enforce that.)
I have reported it to CP.

2) is because the plugin is treating Note fields as plain text instead of richtext.

3) may be needed if Note records have templated Citation fields or are rich text.
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry

User avatar
Jane
Site Admin
Posts: 8441
Joined: 01 Nov 2002 15:00
Family Historian: V7
Location: Somerset, England
Contact:

Re: Cleanup Notes 1.2

Post by Jane » 03 Feb 2021 13:02

I will withdraw the plugin for now until I have time to fix it.
Jane
My Family History : My Photography "Knowledge is knowing that a tomato is a fruit. Wisdom is not putting it in a fruit salad."

User avatar
ronk
Superstar
Posts: 428
Joined: 19 Feb 2016 22:50
Family Historian: V7
Location: MN, USA
Contact:

Re: Cleanup Notes 1.2

Post by ronk » 03 Feb 2021 14:36

Glad I could be of help debugging; sorry I took an indirect approach to show results first time. ;)
Ron Krzmarzick~~ FH 7.0.20 TNG 14.0.2 website Roots & Relatives Remembered, Laragon 5.0, Win 11 pro

Post Reply