CGI/Perl Guide | Learning Center | Forums | Advertise | Login
Site Search: in

  Main Index MAIN
INDEX
Search Posts SEARCH
POSTS
Who's Online WHO'S
ONLINE
Log in LOG
IN

Home: Perl Programming Help: Intermediate:
scp_put failing when there are too many files

 



fcbman1980
New User

Dec 11, 2015, 3:07 AM

Post #1 of 4 (1815 views)
scp_put failing when there are too many files Can't Post

Hi,
Did anyone encounter the scenario where scp_put is failing (too many arguments) when the directory contains too many files?
We have 36K files in the directory and it is failing... (with lower amount it works fine)

This is how we use it:
$dr_node->scp_put( { recursive => 1,
glob => 1,
copy_user_attrs => 1 } ,
"$ib_backup_path/*",$ib_backup_path );

And we get the error:
Can't exec "rsync": Argument list too long at /perl/lib/perl5/site_perl/5.16.0/Net/OpenSSH.pm line 1433

Appreciate any advise :)

Thanks.


FishMonger
Veteran / Moderator

Dec 11, 2015, 7:44 AM

Post #2 of 4 (1804 views)
Re: [fcbman1980] scp_put failing when there are too many files [In reply to] Can't Post

You need to provide a more complete sample of the code for us see what you're doing.

The error message is referring to rsync, not scp. Are you sure the error is related to the code you posted?

What version of the Net::OpenSSH module are you using?


(This post was edited by FishMonger on Dec 11, 2015, 7:50 AM)


fcbman1980
New User

Dec 11, 2015, 8:11 AM

Post #3 of 4 (1799 views)
Re: [FishMonger] scp_put failing when there are too many files [In reply to] Can't Post

scp_put is probably implemented with rsync... as I'm sure this is the code causing it...

(even created a script only with the code above and got the same)

I received a reply in other forum saying to remove the glob and the * and it should work...

BTW - we are using Net::OpenSSH




Thanks


Laurent_R
Veteran / Moderator

Dec 11, 2015, 9:55 AM

Post #4 of 4 (1790 views)
Re: [fcbman1980] scp_put failing when there are too many files [In reply to] Can't Post


In Reply To
I received a reply in other forum saying to remove the glob and the * and it should work...

I also thought that you should not have glob and *, but since you did not show anything like that, I thought you did not have it. Tongue

 
 


Search for (options) Powered by Gossamer Forum v.1.2.0

Web Applications & Managed Hosting Powered by Gossamer Threads
Visit our Mailing List Archives