Hi Clay. This is my first Swift install from Openstack packages. My prior expeirence with Swift has been through third-party systems that abstract a lot of the day-to-day disk mgmt activities, so this my first run-through manually. My personal installs have always been on Supermicro hardware, so I don't think that would be an issue (standard SATA controller, not RAID, etc), though I'm happy to check anything further. But if the kernel and shell are seeing the mounted disks without issue, I have to think it's something at the Swift process level. I did try disabling mount_check, which gives me this instead: Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sda is not a directory Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sdb is not a directory Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sdc is not a directory Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sdd is not a directory Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sde is not a directory Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sdf is not a directory Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sdg is not a directory Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sdh is not a directory Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sdi is not a directory Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sdj is not a directory Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sdk is not a directory Sep 22 13:12:46 [hostname] account-replicator[183238]: Skipping: /srv/node/sdl is not a directory Sep 22 13:12:46 [hostname] account-replicator[183238]: Beginning replication run Sep 22 13:12:46 [hostname] account-replicator[183238]: Replication run OVER Sep 22 13:12:46 [hostname] account-replicator[183238]: Attempted to replicate 0 dbs in 0.00372 seconds (0.00000/s) Sep 22 13:12:46 [hostname] account-replicator[183238]: Removed 0 dbs Sep 22 13:12:46 [hostname] account-replicator[183238]: 0 successes, 144 failures Sep 22 13:12:46 [hostname] account-replicator[183238]: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 Sep 22 13:12:47 [hostname] object-replicator[183230]: Starting object replication pass. And yet: [root@swift]# file /srv/node/sda /srv/node/sda: directory [root@swift]# file /srv/node/sdb /srv/node/sdb: directory ...and so on. Running "swift stat" with mount_check = false gives the same 507 Insufficient Storage as before. -Andrew
On Sep 22, 2022, at 1:08 PM, Clay Gerrard <clay.gerrard@gmail.com> wrote:
On Thu, Sep 22, 2022 at 12:02 PM Andrew Boring <andrew@andrewboring.com> wrote:
What am I missing here?
Wow I wish I knew! It looks like you tried everything. ???
I have a troubleshooting strategy I call "start with something that works" - the 507 in the logs makes it look like the device mount check is failing for some reason - but you can disable that:
https://opendev.org/openstack/swift/src/branch/master/etc/account-server.con...
Does it "work" if we turn off the mount check entirely? Have you been able to configure swift successfully in the past on *different* hardware or software configuration(s)?
-- Clay Gerrard