Open Stack

They both upgraded but still fail:

root at us01odc-dev2-ctrl1:~# nova --version
16.0.0
root at us01odc-dev2-ctrl1:~# nova console-log 3febd3b2-df87-4f06-884b-378116c6fe4c
ERROR (UnicodeEncodeError): 'latin-1' codec can't encode characters in position 46615-46617: ordinal not in range(256)
root at us01odc-dev2-ctrl1:~# os --version
openstack 4.0.0
root at us01odc-dev2-ctrl1:~# os console log show 3febd3b2-df87-4f06-884b-378116c6fe4c
'latin-1' codec can't encode characters in position 46615-46617: ordinal not in range(256)

If I look at /usr/lib/python2.7/dist-packages/openstackclient/compute/v2/console.py on the controller, I see the new code from https://review.opendev.org/#/c/541609/3/openstackclient/compute/v2/console.py:

   if data and data[-1] != '\n':
            data += '\n'
        self.app.stdout.write(data)

Also I see this in the review at https://review.opendev.org/#/c/541609

If you are sure this works, please ignore my comment.
I tried to verify this on a local python console (python-2.7.13).
To do this I used
sys.stdout = codecs.getwriter('ascii')(sys.stdout)
and
sys.stdout = codecs.getwriter('utf-8')(sys.stdout)
Before running the first command, I can write any unicode-character, after the first command I get the same error as in the bug report. After running the second command, the error persists.
That makes me believe, your patch won't fix the issue completely.

Is my cluster one of the cases where the patch doesn’t fix the issue?

From: Radosław Piliszek <radoslaw.piliszek at gmail.com>
Sent: Friday, January 31, 2020 1:21 PM
To: Albert Braden <albertb at synopsys.com>
Cc: Radosław Piliszek <radoslaw.piliszek at gmail.com>; OpenStack Discuss ML <openstack-discuss at lists.openstack.org>
Subject: Re: "encoding error when doing console log show" in Rocky

Ok, try upgrading both to the latest (no pin). Latest clients should still work on Rocky and we don't have to guess versions.

-yoctozepto

On Fri, Jan 31, 2020, 22:12 Albert Braden <Albert.Braden at synopsys.com<mailto:Albert.Braden at synopsys.com>> wrote:
In my other cluster where I haven't upgraded anything since the Rocky install, the old nova version 11 client works, but the openstack client fails:

root at us01odc-dev1-ctrl1:~# openstack --version
openstack 3.16.1
root at us01odc-dev1-ctrl1:~# openstack console log show 5a923a92-8fd1-48fd-8b76-768d1fb5f0c6
'latin-1' codec can't encode characters in position 45794-45796: ordinal not in range(256)
root at us01odc-dev1-ctrl1:~# nova --version
11.0.0
root at us01odc-dev1-ctrl1:~# nova console-log 5a923a92-8fd1-48fd-8b76-768d1fb5f0c6
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-957.5.1.el7.x86_64 (mockbuild at kbuilder.bsys.centos.org<mailto:mockbuild at kbuilder.bsys.centos.org>) (gcc version 4.8.5 20150
...

-----Original Message-----
From: Albert Braden <Albert.Braden at synopsys.com<mailto:Albert.Braden at synopsys.com>>
Sent: Friday, January 31, 2020 12:49 PM
To: Radosław Piliszek <radoslaw.piliszek at gmail.com<mailto:radoslaw.piliszek at gmail.com>>
Cc: OpenStack Discuss ML <openstack-discuss at lists.openstack.org<mailto:openstack-discuss at lists.openstack.org>>
Subject: RE: "encoding error when doing console log show" in Rocky

That ran successfully, but it didn't fix the problem.

Installing collected packages: python-novaclient
  Attempting uninstall: python-novaclient
    Found existing installation: python-novaclient 16.0.0
    Uninstalling python-novaclient-16.0.0:
      Successfully uninstalled python-novaclient-16.0.0
Successfully installed python-novaclient-11.0.1
root at us01odc-dev2-ctrl1:/var/log/nova# os console log show 3febd3b2-df87-4f06-884b-378116c6fe4c
'latin-1' codec can't encode characters in position 46615-46617: ordinal not in range(256)

-----Original Message-----
From: Radosław Piliszek <radoslaw.piliszek at gmail.com<mailto:radoslaw.piliszek at gmail.com>>
Sent: Friday, January 31, 2020 12:41 PM
To: Albert Braden <albertb at synopsys.com<mailto:albertb at synopsys.com>>
Cc: Radosław Piliszek <radoslaw.piliszek at gmail.com<mailto:radoslaw.piliszek at gmail.com>>; OpenStack Discuss ML <openstack-discuss at lists.openstack.org<mailto:openstack-discuss at lists.openstack.org>>
Subject: Re: "encoding error when doing console log show" in Rocky

Then also:
pip install -U python-novaclient==11.0.1

-yoctozepto

pt., 31 sty 2020 o 21:31 Albert Braden <Albert.Braden at synopsys.com<mailto:Albert.Braden at synopsys.com>> napisał(a):
>
> The client claims that it is version 3.16.3. What am I missing?
>
> root at us01odc-dev2-ctrl1:/var/log/nova# openstack --version
> openstack 3.16.3
> root at us01odc-dev2-ctrl1:/var/log/nova# os console log show 3febd3b2-df87-4f06-884b-378116c6fe4c
> 'latin-1' codec can't encode characters in position 46615-46617: ordinal not in range(256)
>
> -----Original Message-----
> From: Radosław Piliszek <radoslaw.piliszek at gmail.com<mailto:radoslaw.piliszek at gmail.com>>
> Sent: Friday, January 31, 2020 10:49 AM
> To: Albert Braden <albertb at synopsys.com<mailto:albertb at synopsys.com>>
> Cc: Radosław Piliszek <radoslaw.piliszek at gmail.com<mailto:radoslaw.piliszek at gmail.com>>; OpenStack Discuss ML <openstack-discuss at lists.openstack.org<mailto:openstack-discuss at lists.openstack.org>>
> Subject: Re: "encoding error when doing console log show" in Rocky
>
> It looks like these are package-provided and hence pip refused to touch them.
> Are there no updates to packages of clients?
> You could try installing the client in venv if you insist on using this machine.
>
> That file you call "source file" has a definition of environment
> variables for osc, you surely "source" it but it's far from being a
> "source file" in the specific sense around here. Hence my previous
> confusion. :-)
>
> -yoctozepto
>
> pt., 31 sty 2020 o 19:25 Albert Braden <Albert.Braden at synopsys.com<mailto:Albert.Braden at synopsys.com>> napisał(a):
> >
> > This is the source file:
> >
> > https://urldefense.proofpoint.com/v2/url?u=https-3A__f.perl.bot_p_7omp8p&d=DwIFaQ&c=DPL6_X_6JkXFx7AXWqB0tg&r=XrJBXYlVPpvOXkMqGPz6KucRW_ils95ZMrEmlTflPm8&m=9hpBVaDxs6DnEno4f15EYzgDq-WzDXknz_GfNTUqDGI&s=-eOnfHHn64irzKfiMAMB9Hp4bpvYgldkQHRCuCOvE60&e=
> >
> > I'm not very good at PIP but it looks like I already have the latest Rocky client installed:
> >
> > https://urldefense.proofpoint.com/v2/url?u=https-3A__f.perl.bot_p_xd6hi2&d=DwIFaQ&c=DPL6_X_6JkXFx7AXWqB0tg&r=XrJBXYlVPpvOXkMqGPz6KucRW_ils95ZMrEmlTflPm8&m=9hpBVaDxs6DnEno4f15EYzgDq-WzDXknz_GfNTUqDGI&s=3Skkokc_zvLhR_0v_WNYAp7rzYbPA0pDg_IvMmSPtHc&e=
> > https://urldefense.proofpoint.com/v2/url?u=https-3A__f.perl.bot_p_zxjh3t&d=DwIFaQ&c=DPL6_X_6JkXFx7AXWqB0tg&r=XrJBXYlVPpvOXkMqGPz6KucRW_ils95ZMrEmlTflPm8&m=9hpBVaDxs6DnEno4f15EYzgDq-WzDXknz_GfNTUqDGI&s=V7aVdb9JbVeogcCPGu2wAtCvM1aw5EgBGKLuhEIkMQw&e=
> >
> > Requirement already satisfied, skipping upgrade: python-novaclient>=9.1.0 in /usr/local/lib/python2.7/dist-packages (from python-openstackclient==3.16.3) (16.0.0)
> >
> > root at us01odc-dev2-ctrl1:~# os console log show 3febd3b2-df87-4f06-884b-378116c6fe4c
> > 'latin-1' codec can't encode characters in position 46615-46617: ordinal not in range(256)
> >
> > -----Original Message-----
> > From: Radosław Piliszek <radoslaw.piliszek at gmail.com<mailto:radoslaw.piliszek at gmail.com>>
> > Sent: Friday, January 31, 2020 12:39 AM
> > To: Albert Braden <albertb at synopsys.com<mailto:albertb at synopsys.com>>
> > Cc: Radosław Piliszek <radoslaw.piliszek at gmail.com<mailto:radoslaw.piliszek at gmail.com>>; OpenStack Discuss ML <openstack-discuss at lists.openstack.org<mailto:openstack-discuss at lists.openstack.org>>
> > Subject: Re: "encoding error when doing console log show" in Rocky
> >
> > Well, I might be slow here. :-)
> > What source file do you need to run on the controller?
> > If you run openstack client from controller then it becomes your
> > client so just update the client there to the latest rocky release:
> > https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.openstack.org_releasenotes_python-2Dopenstackclient_rocky.html&d=DwIFaQ&c=DPL6_X_6JkXFx7AXWqB0tg&r=XrJBXYlVPpvOXkMqGPz6KucRW_ils95ZMrEmlTflPm8&m=avA5Liwj2cVesY05Dk6kFm0YanYp7N7Q4PHGMbzeD6Y&s=dQaaBGR2A-dmJXGDr_TiJ0XVyghaMONnZasgJ52CnrU&e=
> > something along this:
> > sudo pip install -U python-openstackclient==3.16.3
> >
> > -yoctozepto
> >
> > czw., 30 sty 2020 o 22:18 Albert Braden <Albert.Braden at synopsys.com<mailto:Albert.Braden at synopsys.com>> napisał(a):
> > >
> > > Sorry if I am slow. This happens when I go to the controller, run my source file and then type: os console log show <UUID>
> > >
> > > How can I install a new client to use on the controller command line? Do I need to replace the files mentioned below, or is there a better way?
> > >
> > > -----Original Message-----
> > > From: Radosław Piliszek <radoslaw.piliszek at gmail.com<mailto:radoslaw.piliszek at gmail.com>>
> > > Sent: Thursday, January 30, 2020 12:09 PM
> > > To: Albert Braden <albertb at synopsys.com<mailto:albertb at synopsys.com>>
> > > Cc: OpenStack Discuss ML <openstack-discuss at lists.openstack.org<mailto:openstack-discuss at lists.openstack.org>>
> > > Subject: Re: "encoding error when doing console log show" in Rocky
> > >
> > > The bug you mention affects clients.
> > > Hence you just need to patch your clients.
> > > I guess just using a newer version of client would work fine.
> > >
> > > -yoctozepto
> > >
> > > czw., 30 sty 2020 o 20:56 Albert Braden <Albert.Braden at synopsys.com<mailto:Albert.Braden at synopsys.com>> napisał(a):
> > > >
> > > > We’re running openstack-ansible Rocky and seeing the “encoding error when doing console log show.” I see here that there is a patch:
> > > >
> > > >
> > > >
> > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__bugs.launchpad.net_python-2Dopenstackclient_-2Bbug_1747862&d=DwIFaQ&c=DPL6_X_6JkXFx7AXWqB0tg&r=XrJBXYlVPpvOXkMqGPz6KucRW_ils95ZMrEmlTflPm8&m=-HCLwwRjUJ1GrihF5PjSNOYqDFH9Y7Qg0Bckxae56UY&s=vpftbl1w23aba5hyvrLPC-bG3IemMkFqbNBDTxrtHFM&e=
> > > >
> > > >
> > > >
> > > > How can I apply this patch to our Rocky install? Do I need to just copy the file over the existing /usr/lib/python2.7/dist-packages/openstackclient/compute/v2/console.py on controllers and hypervisors? Or is there a better way?
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-discuss/attachments/20200131/76fdd4c8/attachment-0001.html>