Open Stack

Hello,

I'm not sure if it is related, but I am testing reimaging a node from Ubuntu 18.04 to 20.04 (Cloud Archive Ussuri 2.25.1 to Focal Repo Ussuri 2.25.2) in a 3-node cluster. I have a lot of servers to upgrade, and the environments will be mixed for a while, so I have left this mixed for a week. Now the 18.04 servers are starting to accumulate quarantined EC objects.

The 20.04 server has log messages indicating that it is unable to get enough responses from the reconstructor.

The 18.04 servers have a couple EC messages.
"...liberasurecode[30807]: Invalid fragment header information!" followed by "...object-server: Quarantined object /srv/node/d9/objects-4/10321/b2e/50a3dce515aafc6f222824ec5c7dfb2e/1664002866.33100#8#d.data: Invalid EC metadata at offset 0x0

Is there any thing you can think of that would cause this issue?

My steps to reproduce:

  1.  Create a container in an EC policy
  2.  Upload object to EC container
  3.  Wait a bit of time (It looks like the object-server is quarantining but not sure on the trigger)
  4.  Try to download the file and it will give a 504

Looking at python3-swift dependencies and the package versions I thought may affect this:
20.04
libjerasure2 = 2.0.0+2017.04.10.git.de1739cc84-1
python3-pyeclib = 1.6.0-6build1
python3-xattr = 0.9.6-1.1

18.04
libjerasure2 = 2.0.0+2017.04.10.git.de1739cc84-1
python3-pyeclib = 1.3.1-1ubuntu3
python3-xattr = 0.9.2-0ubuntu1

Thanks!
Reid

Important Notice: This email is intended to be received only by persons entitled to receive the confidential and legally privileged information it presumptively contains, and this notice constitutes identification as such. Any reading, disclosure, copying, distribution or use of this information by or to someone who is not the intended recipient, is prohibited. If you received this email in error, please notify us immediately at legal at kaseya.com, and then delete it. To opt-out of receiving emails Please click here<https://info.kaseya.com/email-subscription-center.html>. The term 'this e-mail' includes any and all attachments.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.openstack.org/pipermail/openstack-discuss/attachments/20220927/1503523f/attachment.htm>