* Resolving multiple duplicate media.
Resolving multiple duplicate media.
Hello Folks,
Without going into the how and why it happened I have over 500 duplicate media files in one project. Found by running the "Check for Possible Duplicate Media" plugin. ( Thank you to all the geniuses who write plugins) The next recommended stage is ... "By selecting each pair in turn, just drag over both cells, you can then select Edit>Merge Compare Records from the menu and merge the records together. Once the process is complete, it is recommended to use the "Check for Unlinked Media" plugin to clean up any duplicate files."
I was wondering now that FH Version 7.0.17.1 includes the file name heading on a media list can I just delete the duplicate file without further consequences. By clicking on the "file heading" I can see the duplicates , links if any , when updated and the actual image. Thanks for your time.
Without going into the how and why it happened I have over 500 duplicate media files in one project. Found by running the "Check for Possible Duplicate Media" plugin. ( Thank you to all the geniuses who write plugins) The next recommended stage is ... "By selecting each pair in turn, just drag over both cells, you can then select Edit>Merge Compare Records from the menu and merge the records together. Once the process is complete, it is recommended to use the "Check for Unlinked Media" plugin to clean up any duplicate files."
I was wondering now that FH Version 7.0.17.1 includes the file name heading on a media list can I just delete the duplicate file without further consequences. By clicking on the "file heading" I can see the duplicates , links if any , when updated and the actual image. Thanks for your time.
Re: Resolving multiple duplicate media.
Welcome to FHUG
Can I just clarify, are you talking about duplicate media files (i.e. jpegs etc.) or duplicate media records in FH. The latter are like index cards for the actual files. (Duplicate files will be recognisable by filename(1).jpeg, filename(2).jpeg etc.)
If a media record is not linked to anything you can probably delete the media record (which will leave the file on disk). I say "probably" because sometimes you might download a file, attach it to the media record, meaning to then attach it to some source or fact or person etc - but then never get round to it. If that is not the case, unlinked media records can be deleted.
Hope this helps - others may provide more detail
Can I just clarify, are you talking about duplicate media files (i.e. jpegs etc.) or duplicate media records in FH. The latter are like index cards for the actual files. (Duplicate files will be recognisable by filename(1).jpeg, filename(2).jpeg etc.)
If a media record is not linked to anything you can probably delete the media record (which will leave the file on disk). I say "probably" because sometimes you might download a file, attach it to the media record, meaning to then attach it to some source or fact or person etc - but then never get round to it. If that is not the case, unlinked media records can be deleted.
Hope this helps - others may provide more detail
David
Running FH 6.2.7. Under Wine on Linux (Ubuntu 22.04 LTS + LXDE 11)
Running FH 6.2.7. Under Wine on Linux (Ubuntu 22.04 LTS + LXDE 11)
- tatewise
- Megastar
- Posts: 27088
- Joined: 25 May 2010 11:00
- Family Historian: V7
- Location: Torbay, Devon, UK
- Contact:
Re: Resolving multiple duplicate media.
It rather depends on exactly what form of duplications you have.
They may be files with the same filename & contents but in different folders.
They may be files with a different filename but with the same contents.
There may also be files with the same filename in different folders but with different content so are NOT duplicates.
See Check for Possible Duplicated Media (19256) that has an attached plugin which not only detects the duplicates but offers to automatically merge them.
They may be files with the same filename & contents but in different folders.
They may be files with a different filename but with the same contents.
There may also be files with the same filename in different folders but with different content so are NOT duplicates.
See Check for Possible Duplicated Media (19256) that has an attached plugin which not only detects the duplicates but offers to automatically merge them.
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry
Re: Resolving multiple duplicate media.
Just composed a long reply....must remember to "Save Draft". Got logged out.
Short version.
Thanks.
Is that the guinea pig version April 2021? Any benefit compared to the method below. (500 files to sort)
Media files all in one media folder (The KISS method)
All jpg. format.
100% duplicates.
Do I avoid the "X" in a box missing file by deleting from the "Media list" ?
Thanks again.
Short version.
Thanks.
Is that the guinea pig version April 2021? Any benefit compared to the method below. (500 files to sort)
Media files all in one media folder (The KISS method)
All jpg. format.
100% duplicates.
Do I avoid the "X" in a box missing file by deleting from the "Media list" ?
Thanks again.
- tatewise
- Megastar
- Posts: 27088
- Joined: 25 May 2010 11:00
- Family Historian: V7
- Location: Torbay, Devon, UK
- Contact:
Re: Resolving multiple duplicate media.
Yes, attachment Check for Possible Duplicated Media plugin Version 1.3.4 Date 09 Apr 2021.
I'm not sure what the "method below" involves. Do your mean "just delete the duplicate file"? That is not advisable.
Just deleting Media files and Media records is not wise.
Deleting the Media files will lead to broken file links indicated by "X".
Deleting the Media records will lose their links from your database Media tabs, etc.
The plugin will automatically merge the duplicates, but only if both the Media file and the Media record are identical, and it will preserve the database links from Media tabs, etc.
The "X" means the link from the Media record to the Media file has been broken.Do I avoid the "X" in a box missing file by deleting from the "Media list" ?
i.e. The File link path in the Media record is not the same as the Media file path because the file has been moved, deleted or renamed.
Ideally, the broken link should be mended rather than just delete the "problem".
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry
Re: Resolving multiple duplicate media.
Thanks tatewise,
I'm not sure what the "method below" involves. Do your mean "just delete the duplicate file"? That is not advisable.
Yes that's the one. So not advisable.
Deleting the Media files will lead to broken file links indicated by "X".
Is what I'm trying to avoid.
So plan A is Check for Possible Duplicated Media plugin Version 1.3.4 Date 09 Apr 2021 and plan B is there is no plan B.
Thanks again.
I'm not sure what the "method below" involves. Do your mean "just delete the duplicate file"? That is not advisable.
Yes that's the one. So not advisable.
Deleting the Media files will lead to broken file links indicated by "X".
Is what I'm trying to avoid.
So plan A is Check for Possible Duplicated Media plugin Version 1.3.4 Date 09 Apr 2021 and plan B is there is no plan B.
Thanks again.
- tatewise
- Megastar
- Posts: 27088
- Joined: 25 May 2010 11:00
- Family Historian: V7
- Location: Torbay, Devon, UK
- Contact:
Re: Resolving multiple duplicate media.
Plan B is to use Edit > Merge Compare Records... manually on pairs of duplicate Media records/files.
Plan C is to write a custom Plugin that automates whatever strategy you require.
Plan C is to write a custom Plugin that automates whatever strategy you require.
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry
Re: Resolving multiple duplicate media.
Tried plan A & B. I'd learn Sanskrit quicker than plan C.
All "records" merged.
Still left with over 500 duplicate media files ie. photos on the media list. Hesitantly deleted one media file from the media list. Ran the "Check for broken media links" and there are none. No "X" in a box.
But I'm puzzled. Where has that deleted file gone ? I've checked X tree.fh_data>Media and it's gone but it's not in the bin.
The reason for this whole post is because my laptop is dying and doing odd things. I'm about to move everything over to a new one. I'll go ahead and look into this on the new 'puter. I maybe awhile.
Thanks again for your time.
All "records" merged.
Still left with over 500 duplicate media files ie. photos on the media list. Hesitantly deleted one media file from the media list. Ran the "Check for broken media links" and there are none. No "X" in a box.
But I'm puzzled. Where has that deleted file gone ? I've checked X tree.fh_data>Media and it's gone but it's not in the bin.
The reason for this whole post is because my laptop is dying and doing odd things. I'm about to move everything over to a new one. I'll go ahead and look into this on the new 'puter. I maybe awhile.
Thanks again for your time.
- tatewise
- Megastar
- Posts: 27088
- Joined: 25 May 2010 11:00
- Family Historian: V7
- Location: Torbay, Devon, UK
- Contact:
Re: Resolving multiple duplicate media.
OK, I'll wait until you have moved over to the new laptop.
See FHUG Knowledge Base Family Historian Copy and Migration Guide for advice on copying to another PC.
The Check for Possible Duplicated Media plugin may need to be run more than once if there are multiple duplicates of the same file.
Once complete, it is recommended to use the Check for Unlinked Media plugin to clean up any unused duplicate files.
It is likely that you deleted one of those duplicates that was no longer linked to a Media record, so did not break a link.
See FHUG Knowledge Base Family Historian Copy and Migration Guide for advice on copying to another PC.
The Check for Possible Duplicated Media plugin may need to be run more than once if there are multiple duplicates of the same file.
Once complete, it is recommended to use the Check for Unlinked Media plugin to clean up any unused duplicate files.
It is likely that you deleted one of those duplicates that was no longer linked to a Media record, so did not break a link.
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry