Open Stack

Hi Clay. 

This is my first Swift install from Openstack packages. My prior expeirence with Swift has been through third-party systems that abstract a lot of the day-to-day disk mgmt activities, so this my first run-through manually. 

My personal installs have always been on Supermicro hardware, so I don't think that would be an issue (standard SATA controller, not RAID, etc), though I'm happy to check anything further. But if the kernel and shell are seeing the mounted disks without issue, I have to think it's something at the Swift process level. 

I did try disabling mount_check, which gives me this instead:

Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sda is not a directory
Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sdb is not a directory
Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sdc is not a directory
Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sdd is not a directory
Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sde is not a directory
Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sdf is not a directory
Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sdg is not a directory
Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sdh is not a directory
Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sdi is not a directory
Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sdj is not a directory
Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sdk is not a directory
Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sdl is not a directory
Sep 22 13:12:46 [hostname] account-replicator[183238]: Beginning replication run
Sep 22 13:12:46 [hostname] account-replicator[183238]: Replication run OVER
Sep 22 13:12:46 [hostname] account-replicator[183238]: Attempted to replicate 0 dbs in 0.00372 seconds (0.00000/s)
Sep 22 13:12:46 [hostname] account-replicator[183238]: Removed 0 dbs
Sep 22 13:12:46 [hostname] account-replicator[183238]: 0 successes, 144 failures
Sep 22 13:12:46 [hostname] account-replicator[183238]: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0
Sep 22 13:12:47 [hostname] object-replicator[183230]: Starting object replication pass.


And yet: 

[root at swift]# file /srv/node/sda
/srv/node/sda: directory

[root at swift]# file /srv/node/sdb
/srv/node/sdb: directory

...and so on.

Running "swift stat" with mount_check = false gives the same 507 Insufficient Storage as before.

-Andrew


> On Sep 22, 2022, at 1:08 PM, Clay Gerrard <clay.gerrard at gmail.com> wrote:
> 
> 
> 
> On Thu, Sep 22, 2022 at 12:02 PM Andrew Boring <andrew at andrewboring.com> wrote:
> 
> 
> What am I missing here? 
> 
> 
> Wow I wish I knew!  It looks like you tried everything.  ???
> 
> I have a troubleshooting strategy I call "start with something that works" - the 507 in the logs makes it look like the device mount check is failing for some reason - but you can disable that:
> 
> https://opendev.org/openstack/swift/src/branch/master/etc/account-server.conf-sample#L10
> 
> Does it "work" if we turn off the mount check entirely?  Have you been able to configure swift successfully in the past on *different* hardware or software configuration(s)?
> 
> 
> -- 
> Clay Gerrard