Page 1 of 3

FTP Website Manager

Posted: 28 Jan 2015 15:14
by Bill Deverell
I reloaded my tree today using IPSWITCH.
I was going to use the PLUGIN instead but couldn't work out my settings.
I'm only doing the reload infrequently but would do it more often if I could work out how to use it.
I attach 2 snips from IPSWITCH and a snip of part of the PLUGIN settings I tried.

It goes on to Build a Transfer List which seems to hang - is it because there is a big site already there?.
I've tried it with and without a folder name.
I've tried Reset Page History

Bill

Re: FTP Website Manager

Posted: 28 Jan 2015 17:39
by Jane
The folder should be the one shown on the RootsWeb screen shot, you might need to put %20 for the spaces, as you would not normally include spaces in folder names for web sites.

Re: FTP Website Manager

Posted: 28 Jan 2015 22:36
by Bill Deverell
Jane

I give up. Whatever I try eventually gives a failure to connect.
I think I'll have to stick with a 6 hour upload every time.

Bill

Re: FTP Website Manager

Posted: 29 Jan 2015 08:11
by Jane
Bill, it might be possible to modify the script to move the changed files into another folder and then you can upload them separately. Unfortunately it's not something I can do at the moment. If you wanted to look at the script it does a compare to last run to see which files need to move and you could simply replace the upload routine with a copy to another folder for upload.

Re: FTP Website Manager

Posted: 29 Jan 2015 09:07
by Bill Deverell
Jane

How do I look at the script?

The FTP logon in Internet Explorer or any browser should look like
ftp://[accountname]:[password]@users.freepages.rootsweb.com
I've tried this and it takes me to the root directory from which I would navigate (for example) to Genealogy_html/test

I'll try to copy the IPSWITCH Log to see if would help you.
I'll also try a temporary disable to the McAfee Firewall.

Bill

Re: FTP Website Manager

Posted: 29 Jan 2015 09:12
by Bill Deverell
Jane

Here is the IPSWITCH connection log
The original is multi-coloured indicating direction etc.

Finding Host users.freepages.rootsweb.com ...
Connecting to 66.43.28.143:21
Connected to 66.43.28.143:21 in 0.171866 seconds, Waiting for Server Response
220 (vsFTPd 2.0.5)
Host type (1): AUTO
USER billdeverell
331 Please specify the password.
PASS (hidden)
230 Login successful.
SYST
215 UNIX Type: L8
Host type (2): Unix (Standard)
Sending "FEAT" command to determine what features this server supports.
FEAT
211-Features:
EPRT
EPSV
MDTM
PASV
REST STREAM
SIZE
TVFS
211 End
Finished interpreting "FEAT" response.
Sending the FEAT command is optional. You can disable it in the site options of the profile.
PWD
257 "/"
CWD /genealogy_html/Test
250 Directory successfully changed.
PWD
257 "/genealogy_html/Test"
TYPE A
200 Switching to ASCII mode.
PASV
227 Entering Passive Mode (66,43,28,143,175,72)
connecting data channel to 66.43.28.143:175,72(44872)
data channel connected to 66.43.28.143:175,72(44872)
LIST
150 Here comes the directory listing.
# transferred 68 bytes in < 0.001 seconds, 544.000 kbps ( 68.000 kBps), transfer succeeded.
226 Directory send OK.
QUIT
221 Goodbye.
Connection closed. Ready for next connection.

Bill

Re: FTP Website Manager

Posted: 29 Jan 2015 09:42
by Jane
To look at the script, just select it in the Plugin and click the more button and then Edit

Re: FTP Website Manager

Posted: 29 Jan 2015 09:52
by Bill Deverell
OK I'll try and understand the script.

NB Disabling Firewall had no effect.

Bill

Re: FTP Website Manager

Posted: 29 Jan 2015 10:24
by Bill Deverell
Jane

This where it stops after appearing to hang

ProgressDisplay.Start('Building Transfer List',100)
ProgressDisplay.SetMessage('Retrieving List From FTP Server')

ftplist,e = getFTPList(setting)

if e then
fhMessageBox('Error Occured Connecting to FTP site. Please check your settings\n'..e)
ProgressDisplay.Reset()
ProgressDisplay.Close()
return
end

Couldn't get my head round what getFTPList was doing. There was no progress display other than the text above.
My sequence of Button pushes was
CHANGE SETTINGS (just to confirm)
CLEAR PAGE HISTORY
UPDATE SITE

Not sure how the Debug facility works - can it create a log?

Bill

Re: FTP Website Manager

Posted: 29 Jan 2015 21:24
by tatewise
Jane, quite independent of the above scenario, some changes are needed to fix the Help dialogue, partially due to FH V6 IUP changes.

All the updates are in the function GUI_HelpDialogue().

About line 555 the following code is needed to correct expandchildren attribute:

Code: Select all

	local strExpChild = "NO"
	local iupVersion = iup.GetGlobal("VERSION")
	if iupVersion == "3.5" then strExpChild = "YES" end	-- for IUP 3.11.2
	local dialogHelp = iup.dialog { title=StrPlugin.." Help & Advice", background=StrWhite, startfocus=btnClose, rastersize="1000x700",
				iup.vbox { alignment="ACENTER", gap=StrGap, margin=StrBigMargin, expandchildren=strExpChild,
					oleControl,
					HboxHelp,
				},
				close_cb=function() doActivateMainHelpButton() end,
			}
and a few lines further on:

Code: Select all

		[btnClose]= { StrRed	, false				, function() dialogHelp:destroy() doActivateMainHelpButton() return iup.CLOSE end },
the change is the added return iup.CLOSE in the action function().

Re: FTP Website Manager

Posted: 31 Jan 2015 09:53
by Bill Deverell
Jane

I don't know LUA so correct me if I have misunderstood.
The following looks wrong

function getFTPList(setting)
local t = {}
_,e = ftp.get( {
host = setting.host,
sink = ltn12.sink.table(t),
user = setting.userid,
password = setting.password,
command = 'NLST '..setting.folder,
type = 'a'

I would expect a similar syntax to the use of ftp.put a few lines earlier
Certainly (Using Google) it appears both should have

argument = or path = as mandatory input

(http://w3.impa.br/~diego/software/luaso ... a/ftp.html)

Could this be the cause of the plugin hanging at this point?

I don't know LUA so I haven't tried to amend the code.

Bill

Re: FTP Website Manager

Posted: 31 Jan 2015 11:58
by tatewise
I have looked at that Bill.
The argument or path has effectively been incorporated into the NLST command.
So:
command = 'NLST '..setting.folder,
is the same as:
argument = setting.folder,
command = 'NLST',

Re: FTP Website Manager

Posted: 31 Jan 2015 12:11
by Bill Deverell
Mike/Jane

The actual error I get is on the second line of the error display - it says "closed".
This is value of "e" after the ftp.get command when I ran the debug.

Can't find what that means.

Bill

Re: FTP Website Manager

Posted: 31 Jan 2015 12:20
by tatewise
At that break point, when e = closed, double click on the Variable t lower right to display the returned directory listing.
Does that look like what you might expect?

Have you set the settings as FTP Folder: genealogy_html/Test ?

I have been experimenting with my website, and when I specify an FTP Folder like that, the Plugin fails due to what I think is a coding error.

Try the attached variant of the Plugin and a little debugging.
Open it in the Lua Editor and set a break point a little after that ftp.get on about line 146 return t3.
Run the Plugin and use Update Site, then at the break point double click on t3 in the Variable list lower right.
Does it give a directory listing for the genealogy_html/Test folder?
If so, then let the Plugin run on, and see if it works OK.

Re: FTP Website Manager

Posted: 31 Jan 2015 15:03
by Bill Deverell
Mike

I set Breaks before and after ftp.get in both original and modified scripts
stepped it from 1st to 2nd break and then a couple more
t is empty before and after and e contain "closed"

In both scripts it returns before the statements

else
local t2 = table.concat(t)
local t3 = split(t2,'\r\n')
return t3

your modified script was similar to one I'd tried.

only other things to play with might be Type and possibly Passive

The folder Test has just 1 file on Host and Server.

If you look at the IPSwitch Log it breaks down the LIST / NLIST process into steps
Login to the root directory
Change the current active directory
Issues LIST command to get list of contents

Bill

Re: FTP Website Manager

Posted: 31 Jan 2015 15:15
by tatewise
Is that IPSWITCH connection log above derived from a manual dialogue or from the Plugin ftp.get dialogue?
If the former, can you get the latter?

Re: FTP Website Manager

Posted: 31 Jan 2015 15:24
by Bill Deverell
Mike

It is the IPSWITCH connection log that it maintains for every session.
I don't know how to get a log from the plugin.

Bill

Re: FTP Website Manager

Posted: 31 Jan 2015 16:03
by tatewise
OK, try these two things:

1) Manually via IPSwitch use the NLST command instead of LIST to see how it responds.

2) In Plugin edit the NLST to be LIST, and also try changing the type from 'a' to 'i' or even delete the type line altogether. Then click Go, with break points as before, to see if anything gets returned in table t.

I suggest you are NOT logged in via IPSwitch while running Plugin.

Also if it fails, what exactly is the contents of e which should start with a 3-digit number?

When you view your rootsweb website what is the full URL?
On the rootsweb FAQ it talks about having public_html as your root folder (which is the norm).

So maybe your FTP Folder should be more like public_html/genealogy_html/Test?

Re: FTP Website Manager

Posted: 31 Jan 2015 17:53
by Bill Deverell
1 I've no access to the internals of IPSwitch

2 I've changed NLST to LIST - no effect
Removed type - no effect

In all cases e contains the word closed - no number

I attach 2 files
The Connection Log from IPSwitch and a snip of the IPSwitch Window
The log is displayed in real time in the Information window. The Main Window is 2 panels with usual L/R arrows plus explorer type buttons
The log is also written to disk in real time

The Rootsweb settings are correct for Freepages
I did find a table on Rootsweb explaining it all but can't resurrect it

The viewing URL is different from the upload.
In the case of my tree it is
http://freepages.genealogy.rootsweb.anc ... wc_toc.htm

Bill

Re: FTP Website Manager

Posted: 31 Jan 2015 18:25
by Bill Deverell
Mike

I have at last found the FAQ I wanted
http://rootsweb.custhelp.com/app/answer ... eXlDZG0%3D

Bill

Re: FTP Website Manager

Posted: 31 Jan 2015 19:47
by tatewise
There is an odd inconsistency in that FAQ.
In the table, each Host/Server name is identical to the above URL following @ except for Freepages Accounts that gain users.
So perhaps try freepages.rootsweb.com as the Plugin FTP Host although I suspect a typo in the FAQ is a more likely explanation.

Have you tried the Plugin with FTP Folder either blank, or with just genealogy_html (without any / before or after)?

When the Plugin gets to the break point as before, check t and e but then use Debug > Stop Debugging to prevent it proceeding, just in case using a live folder causes any damage.

Another thing to try is just to check the Plugin runs OK in your PC configuration:
FTP Settings:
FTP Host: ftp.microsoft.com
FTP Folder:
FTP Username: anonymous
FTP Password:

With usual break point, t should contain a list of folders:
t => (table #1)
[1] => "bussys
deskapps
developr
KBHelp
MISC
MISC1
peropsys
Products
PSS
ResKit
Services
Softlib
"

Re: FTP Website Manager

Posted: 31 Jan 2015 21:59
by Bill Deverell
Mike

I did all the following with stop debugging at the if after ftp.get

1 Removing users. made no difference
2 Removing /Test made no difference
3 Tried the folder in quotes - no change
4 Tried the folder blank - no change

5 Got your expected result with the Microsoft site
I did that test from the Sample Project

6 Tried the Microsoft site with my folder as source
That also works

So it's something to do with the destination.

Bill

Re: FTP Website Manager

Posted: 31 Jan 2015 22:24
by tatewise
It is looking that way.

I have another couple of inconsistencies that might offer a way forward.

1) See http://freepages.rootsweb.ancestry.com/helpftp.html Freepages at RootsWeb: FTP Instructions
There it says if you use the genealogy_html directory, you will see your files at the following URL:
http://freepages.genealogy.rootsweb.com/~username/
But your files are at the following URL:
http://freepages.genealogy.rootsweb.anc ... ldeverell/
So where does the extra .ancestry part fit in?

2) See http://freepages.computers.rootsweb.anc ... er/ftp.htm Getting Started with FTP
In the table for Fetch (Mac) it says Host: users.freepages.rootsweb.ancestry.com
That format also appears in other places too.
So perhaps give that host a go?

Re: FTP Website Manager

Posted: 31 Jan 2015 22:37
by Bill Deverell
Mike

Tried using anonymous and no password.
Got immediate message about needing to login so it must have got to the site.

So suggests that with my settings it must be logging in OK
and suggests problem must be associated with the Folder.

I think I might try Email to Rootsweb for advice and see if they can do a trace for me.

Bill

Re: FTP Website Manager

Posted: 31 Jan 2015 22:45
by tatewise
Try FTP Host: users.freepages.rootsweb.ancestry.com

It figures in loads of FTP host configurations for various FTP programs.