[Openstack] Large Files in swift and ConnectionTimeout

gaurav gangalwar gaurav.gangalwar at gmail.com
Thu Nov 3 05:56:55 UTC 2011


Hi,
I faced the simillar issue, but it was hitting node timeout in my case, it
started working fine after increasing node_timeout value in my case.
Have you tried with increased conn_timeout value in proxy-server.conf?

Regards,
Gaurav

On Thu, Nov 3, 2011 at 1:25 AM, Sharif Islam <islamsh at indiana.edu> wrote:

> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Anyone tested swift with large files (> 200GB)?
>
>
> I tried to upload a 130GB file: using segments:
>
>  -S 4147483648 newcontainer file130G.tmp
> file130G.tmp segment 1
> file130G.tmp segment 9
> file130G.tmp segment 3
> file130G.tmp segment 6
> file130G.tmp segment 8
> file130G.tmp segment 4
> file130G.tmp segment 0
> file130G.tmp segment 5
> file130G.tmp segment 2
> file130G.tmp segment 7
> file130G.tmp segment 13
> file130G.tmp segment 12
> file130G.tmp segment 14
> file130G.tmp segment 16
> file130G.tmp segment 17
> file130G.tmp segment 20
> file130G.tmp segment 19
> file130G.tmp segment 15 [after 2 attempts]
> file130G.tmp segment 22
> file130G.tmp segment 23
> file130G.tmp segment 21
> file130G.tmp segment 10 [after 3 attempts]
>
> saw these errors;
>
>
> Nov  2 15:51:25 b002 proxy-server ERROR with Account server
> 172.29.202.13:6002/sda3 re: Trying to get account info for /AUTH_system:
> ConnectionTimeout (0.5s) (client_ip: xxx.xx.xx.xxx)
> Nov  2 15:51:42 b002 object-replicator Starting object replication pass.
> Nov  2 15:51:42 b002 object-replicator Nothing replicated for
> 0.000977993011475 seconds.
> Nov  2 15:51:42 b002 object-replicator Object replication complete.
> (0.00 minutes)
> Nov  2 15:51:49 b002 container-replicator Beginning replication run
> Nov  2 15:51:49 b002 container-replicator Replication run OVER
> Nov  2 15:51:49 b002 container-replicator Attempted to replicate 0 dbs
> in 0.00071 seconds (0.00000/s)
> Nov  2 15:51:49 b002 container-replicator Removed 0 dbs
> Nov  2 15:51:49 b002 container-replicator 0 successes, 0 failures
> Nov  2 15:51:49 b002 container-replicator no_change:0 ts_repl:0 diff:0
> rsync:0 hashmatch:0 empty:0
> Nov  2 15:51:50 b002 account-replicator Beginning replication run
> Nov  2 15:51:50 b002 account-replicator Replication run OVER
> Nov  2 15:51:50 b002 account-replicator Attempted to replicate 0 dbs in
> 0.00102 seconds (0.00000/s)
> Nov  2 15:51:50 b002 account-replicator Removed 0 dbs
> Nov  2 15:51:50 b002 account-replicator 0 successes, 0 failures
> Nov  2 15:51:50 b002 account-replicator no_change:0 ts_repl:0 diff:0
> 705.0363
> Nov  2 15:52:08 b002 proxy-server ERROR with Object server
> 172.29.202.14:6000/sda3 re: Expect: 100-continue on
>
> /AUTH_system/newcontainer_segments/file130G.tmp/1320261131.87/139527716864/00000031:
> ConnectionTimeout (0.5s)
>
> - --sharif
>
>
> - --
> Sharif Islam
> Senior Systems Analyst/Programmer
> FutureGrid (http://futuregrid.org)
> Pervasive Technology Institute, Indiana University Bloomington
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.10 (GNU/Linux)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
>
> iQEcBAEBAgAGBQJOsaAwAAoJEACffes9SivFAWMIAIuB7MP/b2vDjewU9BelEV16
> Mvwzum9wCt/BVrJEliWhCwNr+3uxcyPsGICQEgNGG6YyU8hOxXWFaWB/O546PzBx
> gQulFRjG20wYw91yIm3NVvVyZrmVyRlYgcsQckcB4gjmMfdfIQ7PKlRtRP4mZ5by
> /a83HU3GIfwlU0HIHQC9umAozKq5OtDcXS7aEgj7u8uYBgVLAL0kJ5YsRNMAv68d
> Ve87J0oGCl9s0EGGFSkECaXf1Iln8AfF1UePd62ku5X2tWK9CvVVyaKlaRPF5nhC
> Lvu3JO96FZUb9j2r/NKVv3LKGRhpYbKnpDJtzF1Eq6ojDi+KwzuvJOMnRf6ZD6Y=
> =2ciw
> -----END PGP SIGNATURE-----
>
> _______________________________________________
> Mailing list: https://launchpad.net/~openstack
> Post to     : openstack at lists.launchpad.net
> Unsubscribe : https://launchpad.net/~openstack
> More help   : https://help.launchpad.net/ListHelp
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20111103/27e115d4/attachment.html>


More information about the Openstack mailing list