[Openstack] Swift - How to configure sdfs and openstack swift for these integration ?

Cihangir BEŞİKTAŞ (BİLGEM) cihangir.besiktas at tubitak.gov.tr
Tue Dec 22 13:27:06 UTC 2015


Hi Yatin,



Sdfs filesystem does not have a device node (like /dev/sda). We think Swift 
is complaining fort hat reason.



FYI,

Cihangir



From: mehmet hacısalihoğlu [mailto:esedmehmet at gmail.com]
Sent: Tuesday, December 22, 2015 1:50 PM
To: yatin kumbhare <yatinkumbhare at gmail.com>
Cc: openstack at lists.openstack.org
Subject: Re: [Openstack] Swift - How to configure sdfs and openstack swift 
for these integration ?



Hi Yatin,

I checked volume. Device is mounted. When I unmount device, I get error 
message.
"Dec 22 13:26:49 ubuntu object-replicator: ERROR creating 
/srv/1/node/sda1/objects: #012Traceback (most recent call last):#012  File 
"/usr/lib/python2.7/dist-packages/swift/obj/replicator.py", line 416, in 
collect_jobs#012    mkdirs(obj_path)#012  File 
"/usr/lib/python2.7/dist-packages/swift/common/utils.py", line 572, in 
mkdirs#012    os.makedirs(path)#012  File "/usr/lib/python2.7/os.py", line 
150, in makedirs#012    makedirs(head, mode)#012  File 
"/usr/lib/python2.7/os.py", line 150, in makedirs#012    makedirs(head, 
mode)#012  File "/usr/lib/python2.7/os.py", line 157, in makedirs#012 
mkdir(name, mode)#012OSError: [Errno 2] No such file or directory: 
'/srv/1/node'
Dec 22 13:26:49 ubuntu object-replicator: Nothing replicated for 
0.000561952590942 seconds.
Dec 22 13:26:49 ubuntu object-replicator: Object replication complete. (0.00 
minutes)
Dec 22 13:26:49 ubuntu object-replicator: Starting object replication pass.
Dec 22 13:26:49 ubuntu object-replicator: ERROR creating 
/srv/3/node/sda3/objects: #012Traceback (most recent call last):#012  File 
"/usr/lib/python2.7/dist-packages/swift/obj/replicator.py", line 416, in 
collect_jobs#012    mkdirs(obj_path)#012  File 
"/usr/lib/python2.7/dist-packages/swift/common/utils.py", line 572, in 
mkdirs#012    os.makedirs(path)#012  File "/usr/lib/python2.7/os.py", line 
150, in makedirs#012    makedirs(head, mode)#012  File 
"/usr/lib/python2.7/os.py", line 150, in makedirs#012    makedirs(head, 
mode)#012  File "/usr/lib/python2.7/os.py", line 157, in makedirs#012 
mkdir(name, mode)#012OSError: [Errno 2] No such file or directory: 
'/srv/3/node'
Dec 22 13:26:49 ubuntu object-replicator: Nothing replicated for 
0.000601053237915 seconds.
Dec 22 13:26:49 ubuntu object-replicator: Object replication complete. (0.00 
minutes)
Dec 22 13:26:49 ubuntu object-replicator: Starting object replication pass.
Dec 22 13:26:49 ubuntu object-replicator: ERROR creating 
/srv/2/node/sda2/objects: #012Traceback (most recent call last):#012  File 
"/usr/lib/python2.7/dist-packages/swift/obj/replicator.py", line 416, in 
collect_jobs#012    mkdirs(obj_path)#012  File 
"/usr/lib/python2.7/dist-packages/swift/common/utils.py", line 572, in 
mkdirs#012    os.makedirs(path)#012  File "/usr/lib/python2.7/os.py", line 
150, in makedirs#012    makedirs(head, mode)#012  File 
"/usr/lib/python2.7/os.py", line 150, in makedirs#012    makedirs(head, 
mode)#012  File "/usr/lib/python2.7/os.py", line 157, in makedirs#012 
mkdir(name, mode)#012OSError: [Errno 2] No such file or directory: 
'/srv/2/node'
Dec 22 13:26:49 ubuntu object-replicator: Nothing replicated for 
0.000571012496948 seconds.
Dec 22 13:26:49 ubuntu object-replicator: Object replication complete. (0.00 
minutes)
"

I checked permision in /srv
lrwxrwxrwx  1 swift swift   14 Dec 17 14:10 1 -> /media/pool0/1
lrwxrwxrwx  1 swift swift   14 Dec 17 14:10 2 -> /media/pool0/2
lrwxrwxrwx  1 swift swift   14 Dec 17 14:10 3 -> /media/pool0/3

and path.
root at ubuntu:/srv/1/node/sda1# ls -al
total 384
drwxr-xr-x 1 swift swift 8388608 Dec 22 11:27 .
drwxr-xr-x 1 swift swift 8388608 Dec 17 16:23 ..
drwxr-xr-x 1 swift swift  8388608 Dec 22 11:27 objects



rsyncd.conf

uid = swift
gid = swift
log file = /var/log/rsyncd.log
pid file = /var/run/rsyncd.pid
address = 192.168.56.34

[account6012]
max connections = 2
path = /srv/1/node/
read only = false
lock file = /var/lock/account.lock

[account6022]
max connections = 2
path = /srv/2/node/
read only = false
lock file = /var/lock/account.lock

[account6032]
max connections = 2
path = /srv/3/node/
read only = false
lock file = /var/lock/account.lock

[container6011]
max connections = 2
path = /srv/1/node/
read only = false
lock file = /var/lock/container.lock

[container6021]
max connections = 2
path = /srv/2/node/
read only = false
lock file = /var/lock/container.lock

[container6031]
max connections = 2
path = /srv/3/node/
read only = false
lock file = /var/lock/container.lock

[object6010]
max connections = 2
path = /srv/1/node/
read only = false
lock file = /var/lock/object.lock

[object6020]
max connections = 2
path = /srv/2/node/
read only = false
lock file = /var/lock/object.lock

[object6030]
max connections = 2
path = /srv/3/node/
read only = false
lock file = /var/lock/object.lock



Although there is no problem configuration files, I got the same error.





2015-12-22 13:23 GMT+02:00 yatin kumbhare <yatinkumbhare at gmail.com 
<mailto:yatinkumbhare at gmail.com> >:

Hi Mehmet,



Just check if the volume is mounted.



then, umount the volume and check if those directories no more seen on 
system.



also, if you are following swift saio, check the rsync settings.



check /srv permissions and check if path  /sda1/805/ exists.



Regards,

Yatin



On Tue, Dec 22, 2015 at 4:40 PM, mehmet hacısalihoğlu <esedmehmet at gmail.com 
<mailto:esedmehmet at gmail.com> > wrote:

Hi Yatin,

I stoped swift services after deleted ring files. and I created new rings 
but ı get same error message.
I apply the following steps.
swift-ring-builder object.builder create 10 3 1
swift-ring-builder object.builder add r1z1-192.168.56.34:6010/sda1 1
swift-ring-builder object.builder add r1z2-192.168.56.34:6020/sda2 1
swift-ring-builder object.builder add r1z3-192.168.56.34:6030/sda3 1
swift-ring-builder object.builder rebalance
swift-ring-builder container.builder create 10 3 1
swift-ring-builder container.builder add r1z1-192.168.56.34:6011/sda1 1
swift-ring-builder container.builder add r1z2-192.168.56.34:6021/sda2 1
swift-ring-builder container.builder add r1z3-192.168.56.34:6031/sda3 1
swift-ring-builder container.builder rebalance
swift-ring-builder account.builder create 10 3 1
swift-ring-builder account.builder add r1z1-192.168.56.34:6012/sda1 1
swift-ring-builder account.builder add r1z2-192.168.56.34:6022/sda2 1
swift-ring-builder account.builder add r1z3-192.168.56.34:6032/sda3 1
swift-ring-builder account.builder rebalance

Thanks.

Regards.



2015-12-22 12:17 GMT+02:00 yatin kumbhare <yatinkumbhare at gmail.com 
<mailto:yatinkumbhare at gmail.com> >:

Hi Mehmet,



Under 'swift-ring-builder' you should use different directories/device-name, 
as sda1, sda2 and sda3.



Regards,

Yatin







-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20151222/2fed84e6/attachment.html>


More information about the Openstack mailing list