* FTP Website Manager

For users to report plugin bugs and request plugin enhancements; and for authors to test new/new versions of plugins, and to discuss plugin development (in the Programming Technicalities sub-forum). If you want advice on choosing or using a plugin, please ask in General Usage or an appropriate sub-forum.
avatar
Bill Deverell
Diamond
Posts: 89
Joined: 19 Dec 2013 21:10
Family Historian: V6

FTP Website Manager

Post by Bill Deverell » 28 Jan 2015 15:14

I reloaded my tree today using IPSWITCH.
I was going to use the PLUGIN instead but couldn't work out my settings.
I'm only doing the reload infrequently but would do it more often if I could work out how to use it.
I attach 2 snips from IPSWITCH and a snip of part of the PLUGIN settings I tried.

It goes on to Build a Transfer List which seems to hang - is it because there is a big site already there?.
I've tried it with and without a folder name.
I've tried Reset Page History

Bill
Attachments
PLUGIN settings.JPG
PLUGIN settings.JPG (20.6 KiB) Viewed 9567 times
IPSWITCH window.JPG
IPSWITCH window.JPG (25.82 KiB) Viewed 9567 times
IPSWITCH connection.JPG
IPSWITCH connection.JPG (37.04 KiB) Viewed 9567 times

User avatar
Jane
Site Admin
Posts: 8441
Joined: 01 Nov 2002 15:00
Family Historian: V7
Location: Somerset, England
Contact:

Re: FTP Website Manager

Post by Jane » 28 Jan 2015 17:39

The folder should be the one shown on the RootsWeb screen shot, you might need to put %20 for the spaces, as you would not normally include spaces in folder names for web sites.
Jane
My Family History : My Photography "Knowledge is knowing that a tomato is a fruit. Wisdom is not putting it in a fruit salad."

avatar
Bill Deverell
Diamond
Posts: 89
Joined: 19 Dec 2013 21:10
Family Historian: V6

Re: FTP Website Manager

Post by Bill Deverell » 28 Jan 2015 22:36

Jane

I give up. Whatever I try eventually gives a failure to connect.
I think I'll have to stick with a 6 hour upload every time.

Bill

User avatar
Jane
Site Admin
Posts: 8441
Joined: 01 Nov 2002 15:00
Family Historian: V7
Location: Somerset, England
Contact:

Re: FTP Website Manager

Post by Jane » 29 Jan 2015 08:11

Bill, it might be possible to modify the script to move the changed files into another folder and then you can upload them separately. Unfortunately it's not something I can do at the moment. If you wanted to look at the script it does a compare to last run to see which files need to move and you could simply replace the upload routine with a copy to another folder for upload.
Jane
My Family History : My Photography "Knowledge is knowing that a tomato is a fruit. Wisdom is not putting it in a fruit salad."

avatar
Bill Deverell
Diamond
Posts: 89
Joined: 19 Dec 2013 21:10
Family Historian: V6

Re: FTP Website Manager

Post by Bill Deverell » 29 Jan 2015 09:07

Jane

How do I look at the script?

The FTP logon in Internet Explorer or any browser should look like
ftp://[accountname]:[password]@users.freepages.rootsweb.com
I've tried this and it takes me to the root directory from which I would navigate (for example) to Genealogy_html/test

I'll try to copy the IPSWITCH Log to see if would help you.
I'll also try a temporary disable to the McAfee Firewall.

Bill

avatar
Bill Deverell
Diamond
Posts: 89
Joined: 19 Dec 2013 21:10
Family Historian: V6

Re: FTP Website Manager

Post by Bill Deverell » 29 Jan 2015 09:12

Jane

Here is the IPSWITCH connection log
The original is multi-coloured indicating direction etc.

Finding Host users.freepages.rootsweb.com ...
Connecting to 66.43.28.143:21
Connected to 66.43.28.143:21 in 0.171866 seconds, Waiting for Server Response
220 (vsFTPd 2.0.5)
Host type (1): AUTO
USER billdeverell
331 Please specify the password.
PASS (hidden)
230 Login successful.
SYST
215 UNIX Type: L8
Host type (2): Unix (Standard)
Sending "FEAT" command to determine what features this server supports.
FEAT
211-Features:
EPRT
EPSV
MDTM
PASV
REST STREAM
SIZE
TVFS
211 End
Finished interpreting "FEAT" response.
Sending the FEAT command is optional. You can disable it in the site options of the profile.
PWD
257 "/"
CWD /genealogy_html/Test
250 Directory successfully changed.
PWD
257 "/genealogy_html/Test"
TYPE A
200 Switching to ASCII mode.
PASV
227 Entering Passive Mode (66,43,28,143,175,72)
connecting data channel to 66.43.28.143:175,72(44872)
data channel connected to 66.43.28.143:175,72(44872)
LIST
150 Here comes the directory listing.
# transferred 68 bytes in < 0.001 seconds, 544.000 kbps ( 68.000 kBps), transfer succeeded.
226 Directory send OK.
QUIT
221 Goodbye.
Connection closed. Ready for next connection.

Bill

User avatar
Jane
Site Admin
Posts: 8441
Joined: 01 Nov 2002 15:00
Family Historian: V7
Location: Somerset, England
Contact:

Re: FTP Website Manager

Post by Jane » 29 Jan 2015 09:42

To look at the script, just select it in the Plugin and click the more button and then Edit
Jane
My Family History : My Photography "Knowledge is knowing that a tomato is a fruit. Wisdom is not putting it in a fruit salad."

avatar
Bill Deverell
Diamond
Posts: 89
Joined: 19 Dec 2013 21:10
Family Historian: V6

Re: FTP Website Manager

Post by Bill Deverell » 29 Jan 2015 09:52

OK I'll try and understand the script.

NB Disabling Firewall had no effect.

Bill

avatar
Bill Deverell
Diamond
Posts: 89
Joined: 19 Dec 2013 21:10
Family Historian: V6

Re: FTP Website Manager

Post by Bill Deverell » 29 Jan 2015 10:24

Jane

This where it stops after appearing to hang

ProgressDisplay.Start('Building Transfer List',100)
ProgressDisplay.SetMessage('Retrieving List From FTP Server')

ftplist,e = getFTPList(setting)

if e then
fhMessageBox('Error Occured Connecting to FTP site. Please check your settings\n'..e)
ProgressDisplay.Reset()
ProgressDisplay.Close()
return
end

Couldn't get my head round what getFTPList was doing. There was no progress display other than the text above.
My sequence of Button pushes was
CHANGE SETTINGS (just to confirm)
CLEAR PAGE HISTORY
UPDATE SITE

Not sure how the Debug facility works - can it create a log?

Bill

User avatar
tatewise
Megastar
Posts: 27082
Joined: 25 May 2010 11:00
Family Historian: V7
Location: Torbay, Devon, UK
Contact:

Re: FTP Website Manager

Post by tatewise » 29 Jan 2015 21:24

Jane, quite independent of the above scenario, some changes are needed to fix the Help dialogue, partially due to FH V6 IUP changes.

All the updates are in the function GUI_HelpDialogue().

About line 555 the following code is needed to correct expandchildren attribute:

Code: Select all

	local strExpChild = "NO"
	local iupVersion = iup.GetGlobal("VERSION")
	if iupVersion == "3.5" then strExpChild = "YES" end	-- for IUP 3.11.2
	local dialogHelp = iup.dialog { title=StrPlugin.." Help & Advice", background=StrWhite, startfocus=btnClose, rastersize="1000x700",
				iup.vbox { alignment="ACENTER", gap=StrGap, margin=StrBigMargin, expandchildren=strExpChild,
					oleControl,
					HboxHelp,
				},
				close_cb=function() doActivateMainHelpButton() end,
			}
and a few lines further on:

Code: Select all

		[btnClose]= { StrRed	, false				, function() dialogHelp:destroy() doActivateMainHelpButton() return iup.CLOSE end },
the change is the added return iup.CLOSE in the action function().
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry

avatar
Bill Deverell
Diamond
Posts: 89
Joined: 19 Dec 2013 21:10
Family Historian: V6

Re: FTP Website Manager

Post by Bill Deverell » 31 Jan 2015 09:53

Jane

I don't know LUA so correct me if I have misunderstood.
The following looks wrong

function getFTPList(setting)
local t = {}
_,e = ftp.get( {
host = setting.host,
sink = ltn12.sink.table(t),
user = setting.userid,
password = setting.password,
command = 'NLST '..setting.folder,
type = 'a'

I would expect a similar syntax to the use of ftp.put a few lines earlier
Certainly (Using Google) it appears both should have

argument = or path = as mandatory input

(http://w3.impa.br/~diego/software/luaso ... a/ftp.html)

Could this be the cause of the plugin hanging at this point?

I don't know LUA so I haven't tried to amend the code.

Bill

User avatar
tatewise
Megastar
Posts: 27082
Joined: 25 May 2010 11:00
Family Historian: V7
Location: Torbay, Devon, UK
Contact:

Re: FTP Website Manager

Post by tatewise » 31 Jan 2015 11:58

I have looked at that Bill.
The argument or path has effectively been incorporated into the NLST command.
So:
command = 'NLST '..setting.folder,
is the same as:
argument = setting.folder,
command = 'NLST',
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry

avatar
Bill Deverell
Diamond
Posts: 89
Joined: 19 Dec 2013 21:10
Family Historian: V6

Re: FTP Website Manager

Post by Bill Deverell » 31 Jan 2015 12:11

Mike/Jane

The actual error I get is on the second line of the error display - it says "closed".
This is value of "e" after the ftp.get command when I ran the debug.

Can't find what that means.

Bill

User avatar
tatewise
Megastar
Posts: 27082
Joined: 25 May 2010 11:00
Family Historian: V7
Location: Torbay, Devon, UK
Contact:

Re: FTP Website Manager

Post by tatewise » 31 Jan 2015 12:20

At that break point, when e = closed, double click on the Variable t lower right to display the returned directory listing.
Does that look like what you might expect?

Have you set the settings as FTP Folder: genealogy_html/Test ?

I have been experimenting with my website, and when I specify an FTP Folder like that, the Plugin fails due to what I think is a coding error.

Try the attached variant of the Plugin and a little debugging.
Open it in the Lua Editor and set a break point a little after that ftp.get on about line 146 return t3.
Run the Plugin and use Update Site, then at the break point double click on t3 in the Variable list lower right.
Does it give a directory listing for the genealogy_html/Test folder?
If so, then let the Plugin run on, and see if it works OK.
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry

avatar
Bill Deverell
Diamond
Posts: 89
Joined: 19 Dec 2013 21:10
Family Historian: V6

Re: FTP Website Manager

Post by Bill Deverell » 31 Jan 2015 15:03

Mike

I set Breaks before and after ftp.get in both original and modified scripts
stepped it from 1st to 2nd break and then a couple more
t is empty before and after and e contain "closed"

In both scripts it returns before the statements

else
local t2 = table.concat(t)
local t3 = split(t2,'\r\n')
return t3

your modified script was similar to one I'd tried.

only other things to play with might be Type and possibly Passive

The folder Test has just 1 file on Host and Server.

If you look at the IPSwitch Log it breaks down the LIST / NLIST process into steps
Login to the root directory
Change the current active directory
Issues LIST command to get list of contents

Bill

User avatar
tatewise
Megastar
Posts: 27082
Joined: 25 May 2010 11:00
Family Historian: V7
Location: Torbay, Devon, UK
Contact:

Re: FTP Website Manager

Post by tatewise » 31 Jan 2015 15:15

Is that IPSWITCH connection log above derived from a manual dialogue or from the Plugin ftp.get dialogue?
If the former, can you get the latter?
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry

avatar
Bill Deverell
Diamond
Posts: 89
Joined: 19 Dec 2013 21:10
Family Historian: V6

Re: FTP Website Manager

Post by Bill Deverell » 31 Jan 2015 15:24

Mike

It is the IPSWITCH connection log that it maintains for every session.
I don't know how to get a log from the plugin.

Bill

User avatar
tatewise
Megastar
Posts: 27082
Joined: 25 May 2010 11:00
Family Historian: V7
Location: Torbay, Devon, UK
Contact:

Re: FTP Website Manager

Post by tatewise » 31 Jan 2015 16:03

OK, try these two things:

1) Manually via IPSwitch use the NLST command instead of LIST to see how it responds.

2) In Plugin edit the NLST to be LIST, and also try changing the type from 'a' to 'i' or even delete the type line altogether. Then click Go, with break points as before, to see if anything gets returned in table t.

I suggest you are NOT logged in via IPSwitch while running Plugin.

Also if it fails, what exactly is the contents of e which should start with a 3-digit number?

When you view your rootsweb website what is the full URL?
On the rootsweb FAQ it talks about having public_html as your root folder (which is the norm).

So maybe your FTP Folder should be more like public_html/genealogy_html/Test?
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry

avatar
Bill Deverell
Diamond
Posts: 89
Joined: 19 Dec 2013 21:10
Family Historian: V6

Re: FTP Website Manager

Post by Bill Deverell » 31 Jan 2015 17:53

1 I've no access to the internals of IPSwitch

2 I've changed NLST to LIST - no effect
Removed type - no effect

In all cases e contains the word closed - no number

I attach 2 files
The Connection Log from IPSwitch and a snip of the IPSwitch Window
The log is displayed in real time in the Information window. The Main Window is 2 panels with usual L/R arrows plus explorer type buttons
The log is also written to disk in real time

The Rootsweb settings are correct for Freepages
I did find a table on Rootsweb explaining it all but can't resurrect it

The viewing URL is different from the upload.
In the case of my tree it is
http://freepages.genealogy.rootsweb.anc ... wc_toc.htm

Bill
Attachments
IPSSwitch Window.JPG
IPSSwitch Window.JPG (100.03 KiB) Viewed 9298 times
Rootsweb20150131171127_5400.rtf
(1.97 KiB) Downloaded 143 times

avatar
Bill Deverell
Diamond
Posts: 89
Joined: 19 Dec 2013 21:10
Family Historian: V6

Re: FTP Website Manager

Post by Bill Deverell » 31 Jan 2015 18:25

Mike

I have at last found the FAQ I wanted
http://rootsweb.custhelp.com/app/answer ... eXlDZG0%3D

Bill

User avatar
tatewise
Megastar
Posts: 27082
Joined: 25 May 2010 11:00
Family Historian: V7
Location: Torbay, Devon, UK
Contact:

Re: FTP Website Manager

Post by tatewise » 31 Jan 2015 19:47

There is an odd inconsistency in that FAQ.
In the table, each Host/Server name is identical to the above URL following @ except for Freepages Accounts that gain users.
So perhaps try freepages.rootsweb.com as the Plugin FTP Host although I suspect a typo in the FAQ is a more likely explanation.

Have you tried the Plugin with FTP Folder either blank, or with just genealogy_html (without any / before or after)?

When the Plugin gets to the break point as before, check t and e but then use Debug > Stop Debugging to prevent it proceeding, just in case using a live folder causes any damage.

Another thing to try is just to check the Plugin runs OK in your PC configuration:
FTP Settings:
FTP Host: ftp.microsoft.com
FTP Folder:
FTP Username: anonymous
FTP Password:

With usual break point, t should contain a list of folders:
t => (table #1)
[1] => "bussys
deskapps
developr
KBHelp
MISC
MISC1
peropsys
Products
PSS
ResKit
Services
Softlib
"
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry

avatar
Bill Deverell
Diamond
Posts: 89
Joined: 19 Dec 2013 21:10
Family Historian: V6

Re: FTP Website Manager

Post by Bill Deverell » 31 Jan 2015 21:59

Mike

I did all the following with stop debugging at the if after ftp.get

1 Removing users. made no difference
2 Removing /Test made no difference
3 Tried the folder in quotes - no change
4 Tried the folder blank - no change

5 Got your expected result with the Microsoft site
I did that test from the Sample Project

6 Tried the Microsoft site with my folder as source
That also works

So it's something to do with the destination.

Bill

User avatar
tatewise
Megastar
Posts: 27082
Joined: 25 May 2010 11:00
Family Historian: V7
Location: Torbay, Devon, UK
Contact:

Re: FTP Website Manager

Post by tatewise » 31 Jan 2015 22:24

It is looking that way.

I have another couple of inconsistencies that might offer a way forward.

1) See http://freepages.rootsweb.ancestry.com/helpftp.html Freepages at RootsWeb: FTP Instructions
There it says if you use the genealogy_html directory, you will see your files at the following URL:
http://freepages.genealogy.rootsweb.com/~username/
But your files are at the following URL:
http://freepages.genealogy.rootsweb.anc ... ldeverell/
So where does the extra .ancestry part fit in?

2) See http://freepages.computers.rootsweb.anc ... er/ftp.htm Getting Started with FTP
In the table for Fetch (Mac) it says Host: users.freepages.rootsweb.ancestry.com
That format also appears in other places too.
So perhaps give that host a go?
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry

avatar
Bill Deverell
Diamond
Posts: 89
Joined: 19 Dec 2013 21:10
Family Historian: V6

Re: FTP Website Manager

Post by Bill Deverell » 31 Jan 2015 22:37

Mike

Tried using anonymous and no password.
Got immediate message about needing to login so it must have got to the site.

So suggests that with my settings it must be logging in OK
and suggests problem must be associated with the Folder.

I think I might try Email to Rootsweb for advice and see if they can do a trace for me.

Bill

User avatar
tatewise
Megastar
Posts: 27082
Joined: 25 May 2010 11:00
Family Historian: V7
Location: Torbay, Devon, UK
Contact:

Re: FTP Website Manager

Post by tatewise » 31 Jan 2015 22:45

Try FTP Host: users.freepages.rootsweb.ancestry.com

It figures in loads of FTP host configurations for various FTP programs.
Mike Tate ~ researching the Tate and Scott family history ~ tatewise ancestry

Post Reply