Re: How do I disable replication in swift
question: Do you want to delete replicas of old objects? o just disable it for future objects until you get more disk/nodes? for the second did you try to stop the object replicator service? On Fri, Sep 23, 2022 at 9:04 AM Paladox <thomasmulhall410@yahoo.com> wrote:
Thanks! But that doesn’t tell you how to disable as the value must be one or higher? Unless it’s not 1+1 (or what ever you set as the replica value).
On Thursday, 22 September 2022 at 19:58:41 BST, Alvaro Soto < alsotoes@gmail.com> wrote:
Check changing the replica counts
https://docs.openstack.org/swift/xena/admin/objectstorage-ringbuilder.html#r...
--- Alvaro Soto.
Note: My work hours may not be your work hours. Please do not feel the need to respond during a time that is not convenient for you. ---------------------------------------------------------- Great people talk about ideas, ordinary people talk about things, small people talk... about other people.
On Thu, Sep 22, 2022, 6:54 AM Paladox <thomasmulhall410@yahoo.com> wrote:
Hello, I would like Swift to only have 1 file not any copies of it, how do I disable replication as you must set the value to 1 when you create the rings?
(We don’t have the disk space to have replication / copies of the files)
-- Alvaro Soto *Note: My work hours may not be your work hours. Please do not feel the need to respond during a time that is not convenient for you.* ---------------------------------------------------------- Great people talk about ideas, ordinary people talk about things, small people talk... about other people.
We're just setting it up so i can erase everything. Ah so if i stoped the object replicator service, that'll be fine? On Friday, 23 September 2022, 19:30:28 BST, Alvaro Soto <alsotoes@gmail.com> wrote: question:Do you want to delete replicas of old objects? o just disable it for future objects until you get more disk/nodes?for the second did you try to stop the object replicator service? On Fri, Sep 23, 2022 at 9:04 AM Paladox <thomasmulhall410@yahoo.com> wrote: Thanks! But that doesn’t tell you how to disable as the value must be one or higher? Unless it’s not 1+1 (or what ever you set as the replica value). On Thursday, 22 September 2022 at 19:58:41 BST, Alvaro Soto <alsotoes@gmail.com> wrote: Check changing the replica counts https://docs.openstack.org/swift/xena/admin/objectstorage-ringbuilder.html#r... --- Alvaro Soto. Note: My work hours may not be your work hours. Please do not feel the need to respond during a time that is not convenient for you. ---------------------------------------------------------- Great people talk about ideas, ordinary people talk about things, small people talk... about other people. On Thu, Sep 22, 2022, 6:54 AM Paladox <thomasmulhall410@yahoo.com> wrote: Hello, I would like Swift to only have 1 file not any copies of it, how do I disable replication as you must set the value to 1 when you create the rings? (We don’t have the disk space to have replication / copies of the files) -- Alvaro Soto Note: My work hours may not be your work hours. Please do not feel the need to respond during a time that is not convenient for you. ---------------------------------------------------------- Great people talk about ideas, ordinary people talk about things, small people talk... about other people.
If I'm no mistaken, that will stop replication for new objects but also stop checking for old objects consistency (maybe l, just maybe you will loose information if you disk or network disruption) I consider this a quick and dirty fix in the mean time you get more disk space without stop serving write IO, better option to preserve old objects consistency will be maybe to put your cluster in read-only but from the ACL, not from the Linux boxes. Can I ask what is the current space statuses on your cluster drives? --- Alvaro Soto. Note: My work hours may not be your work hours. Please do not feel the need to respond during a time that is not convenient for you. ---------------------------------------------------------- Great people talk about ideas, ordinary people talk about things, small people talk... about other people. On Fri, Sep 23, 2022, 2:26 PM Paladox <thomasmulhall410@yahoo.com> wrote:
We're just setting it up so i can erase everything. Ah so if i stoped the object replicator service, that'll be fine?
On Friday, 23 September 2022, 19:30:28 BST, Alvaro Soto < alsotoes@gmail.com> wrote:
question: Do you want to delete replicas of old objects? o just disable it for future objects until you get more disk/nodes? for the second did you try to stop the object replicator service?
On Fri, Sep 23, 2022 at 9:04 AM Paladox <thomasmulhall410@yahoo.com> wrote:
Thanks! But that doesn’t tell you how to disable as the value must be one or higher? Unless it’s not 1+1 (or what ever you set as the replica value).
On Thursday, 22 September 2022 at 19:58:41 BST, Alvaro Soto < alsotoes@gmail.com> wrote:
Check changing the replica counts
https://docs.openstack.org/swift/xena/admin/objectstorage-ringbuilder.html#r...
--- Alvaro Soto.
Note: My work hours may not be your work hours. Please do not feel the need to respond during a time that is not convenient for you. ---------------------------------------------------------- Great people talk about ideas, ordinary people talk about things, small people talk... about other people.
On Thu, Sep 22, 2022, 6:54 AM Paladox <thomasmulhall410@yahoo.com> wrote:
Hello, I would like Swift to only have 1 file not any copies of it, how do I disable replication as you must set the value to 1 when you create the rings?
(We don’t have the disk space to have replication / copies of the files)
--
Alvaro Soto
*Note: My work hours may not be your work hours. Please do not feel the need to respond during a time that is not convenient for you.* ---------------------------------------------------------- Great people talk about ideas, ordinary people talk about things, small people talk... about other people.
We have around 3.8tb but we're wanting to move from gluster to swift (which we're currently using 2.6tb). We're a small not-for-profit in the UK. We don't have the funds to support replicating data right now. On Friday, 23 September 2022, 21:04:32 BST, Alvaro Soto <alsotoes@gmail.com> wrote: If I'm no mistaken, that will stop replication for new objects but also stop checking for old objects consistency (maybe l, just maybe you will loose information if you disk or network disruption) I consider this a quick and dirty fix in the mean time you get more disk space without stop serving write IO, better option to preserve old objects consistency will be maybe to put your cluster in read-only but from the ACL, not from the Linux boxes. Can I ask what is the current space statuses on your cluster drives? --- Alvaro Soto. Note: My work hours may not be your work hours. Please do not feel the need to respond during a time that is not convenient for you. ---------------------------------------------------------- Great people talk about ideas, ordinary people talk about things, small people talk... about other people. On Fri, Sep 23, 2022, 2:26 PM Paladox <thomasmulhall410@yahoo.com> wrote: We're just setting it up so i can erase everything. Ah so if i stoped the object replicator service, that'll be fine? On Friday, 23 September 2022, 19:30:28 BST, Alvaro Soto <alsotoes@gmail.com> wrote: question:Do you want to delete replicas of old objects? o just disable it for future objects until you get more disk/nodes?for the second did you try to stop the object replicator service? On Fri, Sep 23, 2022 at 9:04 AM Paladox <thomasmulhall410@yahoo.com> wrote: Thanks! But that doesn’t tell you how to disable as the value must be one or higher? Unless it’s not 1+1 (or what ever you set as the replica value). On Thursday, 22 September 2022 at 19:58:41 BST, Alvaro Soto <alsotoes@gmail.com> wrote: Check changing the replica counts https://docs.openstack.org/swift/xena/admin/objectstorage-ringbuilder.html#r... --- Alvaro Soto. Note: My work hours may not be your work hours. Please do not feel the need to respond during a time that is not convenient for you. ---------------------------------------------------------- Great people talk about ideas, ordinary people talk about things, small people talk... about other people. On Thu, Sep 22, 2022, 6:54 AM Paladox <thomasmulhall410@yahoo.com> wrote: Hello, I would like Swift to only have 1 file not any copies of it, how do I disable replication as you must set the value to 1 when you create the rings? (We don’t have the disk space to have replication / copies of the files) -- Alvaro Soto Note: My work hours may not be your work hours. Please do not feel the need to respond during a time that is not convenient for you. ---------------------------------------------------------- Great people talk about ideas, ordinary people talk about things, small people talk... about other people.
Have you considered using Ceph? so you can easily tune this kind of thing. Also, Ceph is thin provisioning and supports compression, devs are working on deduplication. Cheers!. On Fri, Sep 23, 2022 at 4:20 PM Paladox <thomasmulhall410@yahoo.com> wrote:
We have around 3.8tb but we're wanting to move from gluster to swift (which we're currently using 2.6tb). We're a small not-for-profit in the UK. We don't have the funds to support replicating data right now.
On Friday, 23 September 2022, 21:04:32 BST, Alvaro Soto < alsotoes@gmail.com> wrote:
If I'm no mistaken, that will stop replication for new objects but also stop checking for old objects consistency (maybe l, just maybe you will loose information if you disk or network disruption) I consider this a quick and dirty fix in the mean time you get more disk space without stop serving write IO, better option to preserve old objects consistency will be maybe to put your cluster in read-only but from the ACL, not from the Linux boxes.
Can I ask what is the current space statuses on your cluster drives?
--- Alvaro Soto.
Note: My work hours may not be your work hours. Please do not feel the need to respond during a time that is not convenient for you. ---------------------------------------------------------- Great people talk about ideas, ordinary people talk about things, small people talk... about other people.
On Fri, Sep 23, 2022, 2:26 PM Paladox <thomasmulhall410@yahoo.com> wrote:
We're just setting it up so i can erase everything. Ah so if i stoped the object replicator service, that'll be fine?
On Friday, 23 September 2022, 19:30:28 BST, Alvaro Soto < alsotoes@gmail.com> wrote:
question: Do you want to delete replicas of old objects? o just disable it for future objects until you get more disk/nodes? for the second did you try to stop the object replicator service?
On Fri, Sep 23, 2022 at 9:04 AM Paladox <thomasmulhall410@yahoo.com> wrote:
Thanks! But that doesn’t tell you how to disable as the value must be one or higher? Unless it’s not 1+1 (or what ever you set as the replica value).
On Thursday, 22 September 2022 at 19:58:41 BST, Alvaro Soto < alsotoes@gmail.com> wrote:
Check changing the replica counts
https://docs.openstack.org/swift/xena/admin/objectstorage-ringbuilder.html#r...
--- Alvaro Soto.
Note: My work hours may not be your work hours. Please do not feel the need to respond during a time that is not convenient for you. ---------------------------------------------------------- Great people talk about ideas, ordinary people talk about things, small people talk... about other people.
On Thu, Sep 22, 2022, 6:54 AM Paladox <thomasmulhall410@yahoo.com> wrote:
Hello, I would like Swift to only have 1 file not any copies of it, how do I disable replication as you must set the value to 1 when you create the rings?
(We don’t have the disk space to have replication / copies of the files)
--
Alvaro Soto
*Note: My work hours may not be your work hours. Please do not feel the need to respond during a time that is not convenient for you.* ---------------------------------------------------------- Great people talk about ideas, ordinary people talk about things, small people talk... about other people.
-- Alvaro Soto *Note: My work hours may not be your work hours. Please do not feel the need to respond during a time that is not convenient for you.* ---------------------------------------------------------- Great people talk about ideas, ordinary people talk about things, small people talk... about other people.
On Fri, 23 Sep 2022 21:20:03 +0000 (UTC) Paladox <thomasmulhall410@yahoo.com> wrote:
We have around 3.8tb but we're wanting to move from gluster to swift (which we're currently using 2.6tb). We're a small not-for-profit in the UK. We don't have the funds to support replicating data right now.
You are setting yourself for a data loss and then you'll inevitably blame Swift, even though we told you not to do that. -- Pete
Thanks! So to be clear, the replication value of 1 means it won't replicate and that it's not 1 + n (n being one in this case). On Friday, 30 September 2022, 22:45:12 BST, Pete Zaitcev <zaitcev@redhat.com> wrote: On Fri, 23 Sep 2022 21:20:03 +0000 (UTC) Paladox <thomasmulhall410@yahoo.com> wrote:
We have around 3.8tb but we're wanting to move from gluster to swift (which we're currently using 2.6tb). We're a small not-for-profit in the UK. We don't have the funds to support replicating data right now.
You are setting yourself for a data loss and then you'll inevitably blame Swift, even though we told you not to do that. -- Pete
On Fri, 23 Sep 2022 19:26:11 +0000 (UTC) Paladox <thomasmulhall410@yahoo.com> wrote:
Ah so if i stoped the object replicator service, that'll be fine?
Because replicator deletes tombstones, you'll run out of inodes eventually. So you probably want to run one per node, even if you don't replicate and have replication factor of 1 in your rings. -- Pete
participants (3)
-
Alvaro Soto
-
Paladox
-
Pete Zaitcev