Hello Guys, With Michaels help I was able to solve the problem but now there is another error I was able to create my network on vlan but still error persist. PFB the logs: http://paste.openstack.org/show/fEixSudZ6lzscxYxsG1z/ Kindly help regards, Monika ________________________________ From: Michael Johnson <johnsomor@gmail.com> Sent: Monday, August 3, 2020 9:10 PM To: Fabian Zimmermann <dev.faz@gmail.com> Cc: Monika Samal <monika.samal@outlook.com>; openstack-discuss <openstack-discuss@lists.openstack.org> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer Yeah, it looks like nova is failing to boot the instance. Check this setting in your octavia.conf files: https://docs.openstack.org/octavia/latest/configuration/configref.html#contr... Also, if kolla-ansible didn't set both of these values correctly, please open bug reports for kolla-ansible. These all should have been configured by the deployment tool. Michael On Mon, Aug 3, 2020 at 7:53 AM Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>> wrote: Seems like the flavor is missing or empty '' - check for typos and enable debug. Check if the nova req contains valid information/flavor. Fabian Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> schrieb am Mo., 3. Aug. 2020, 15:46: It's registered Get Outlook for Android<https://aka.ms/ghei36> ________________________________ From: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>> Sent: Monday, August 3, 2020 7:08:21 PM To: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer Did you check the (nova) flavor you use in octavia. Fabian Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> schrieb am Mo., 3. Aug. 2020, 10:53: After Michael suggestion I was able to create load balancer but there is error in status. [X] PFB the error link: http://paste.openstack.org/show/meNZCeuOlFkfjj189noN/ ________________________________ From: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> Sent: Monday, August 3, 2020 2:08 PM To: Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>> Cc: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>>; Amy Marrich <amy@demarco.com<mailto:amy@demarco.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>>; community@lists.openstack.org<mailto:community@lists.openstack.org> <community@lists.openstack.org<mailto:community@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer Thanks a ton Michael for helping me out ________________________________ From: Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>> Sent: Friday, July 31, 2020 3:57 AM To: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> Cc: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>>; Amy Marrich <amy@demarco.com<mailto:amy@demarco.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>>; community@lists.openstack.org<mailto:community@lists.openstack.org> <community@lists.openstack.org<mailto:community@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer Just to close the loop on this, the octavia.conf file had "project_name = admin" instead of "project_name = service" in the [service_auth] section. This was causing the keystone errors when Octavia was communicating with neutron. I don't know if that is a bug in kolla-ansible or was just a local configuration issue. Michael On Thu, Jul 30, 2020 at 1:39 PM Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> wrote:

Hello Fabian,,

http://paste.openstack.org/show/QxKv2Ai697qulp9UWTjY/

Regards, Monika ________________________________ From: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>> Sent: Friday, July 31, 2020 1:57 AM To: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> Cc: Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>>; Amy Marrich <amy@demarco.com<mailto:amy@demarco.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>>; community@lists.openstack.org<mailto:community@lists.openstack.org> <community@lists.openstack.org<mailto:community@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer

Hi,

just to debug, could you replace the auth_type password with v3password?

And do a curl against your :5000 and :35357 urls and paste the output.

Fabian

Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> schrieb am Do., 30. Juli 2020, 22:15:

Hello Fabian,

http://paste.openstack.org/show/796477/

Thanks, Monika ________________________________ From: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>> Sent: Friday, July 31, 2020 1:38 AM To: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> Cc: Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>>; Amy Marrich <amy@demarco.com<mailto:amy@demarco.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>>; community@lists.openstack.org<mailto:community@lists.openstack.org> <community@lists.openstack.org<mailto:community@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer

The sections should be

service_auth keystone_authtoken

if i read the docs correctly. Maybe you can just paste your config (remove/change passwords) to paste.openstack.org<http://paste.openstack.org> and post the link?

Fabian

Looking at that error, it appears that the lb-mgmt-net is not setup correctly. The Octavia controller containers are not able to reach the amphora instances on the lb-mgmt-net subnet. I don't know how kolla is setup to connect the containers to the neutron lb-mgmt-net network. Maybe the above documents will help with that. Michael On Wed, Aug 5, 2020 at 12:53 AM Mark Goddard <mark@stackhpc.com> wrote:

On Tue, 4 Aug 2020 at 16:58, Monika Samal <monika.samal@outlook.com> wrote:

...

Hello Guys,

With Michaels help I was able to solve the problem but now there is another error I was able to create my network on vlan but still error persist. PFB the logs:

http://paste.openstack.org/show/fEixSudZ6lzscxYxsG1z/

Kindly help

regards, Monika ------------------------------ *From:* Michael Johnson <johnsomor@gmail.com> *Sent:* Monday, August 3, 2020 9:10 PM *To:* Fabian Zimmermann <dev.faz@gmail.com> *Cc:* Monika Samal <monika.samal@outlook.com>; openstack-discuss < openstack-discuss@lists.openstack.org> *Subject:* Re: [openstack-community] Octavia :; Unable to create load balancer

Yeah, it looks like nova is failing to boot the instance.

Check this setting in your octavia.conf files: https://docs.openstack.org/octavia/latest/configuration/configref.html#contr...

Also, if kolla-ansible didn't set both of these values correctly, please open bug reports for kolla-ansible. These all should have been configured by the deployment tool.

I wasn't following this thread due to no [kolla] tag, but here are the recently added docs for Octavia in kolla [1]. Note the octavia_service_auth_project variable which was added to migrate from the admin project to the service project for octavia resources. We're lacking proper automation for the flavor, image etc, but it is being worked on in Victoria [2].

[1] https://docs.openstack.org/kolla-ansible/latest/reference/networking/octavia... [2] https://review.opendev.org/740180

Michael

...

On Mon, Aug 3, 2020 at 7:53 AM Fabian Zimmermann <dev.faz@gmail.com> wrote:

Seems like the flavor is missing or empty '' - check for typos and enable debug.

Check if the nova req contains valid information/flavor.

Fabian

Monika Samal <monika.samal@outlook.com> schrieb am Mo., 3. Aug. 2020, 15:46:

It's registered

Get Outlook for Android <https://aka.ms/ghei36> ------------------------------ *From:* Fabian Zimmermann <dev.faz@gmail.com> *Sent:* Monday, August 3, 2020 7:08:21 PM *To:* Monika Samal <monika.samal@outlook.com>; openstack-discuss < openstack-discuss@lists.openstack.org> *Subject:* Re: [openstack-community] Octavia :; Unable to create load balancer

Did you check the (nova) flavor you use in octavia.

Fabian

Monika Samal <monika.samal@outlook.com> schrieb am Mo., 3. Aug. 2020, 10:53:

After Michael suggestion I was able to create load balancer but there is error in status.

PFB the error link:

http://paste.openstack.org/show/meNZCeuOlFkfjj189noN/ ------------------------------ *From:* Monika Samal <monika.samal@outlook.com> *Sent:* Monday, August 3, 2020 2:08 PM *To:* Michael Johnson <johnsomor@gmail.com> *Cc:* Fabian Zimmermann <dev.faz@gmail.com>; Amy Marrich <amy@demarco.com>; openstack-discuss <openstack-discuss@lists.openstack.org>; community@lists.openstack.org <community@lists.openstack.org> *Subject:* Re: [openstack-community] Octavia :; Unable to create load balancer

Thanks a ton Michael for helping me out ------------------------------ *From:* Michael Johnson <johnsomor@gmail.com> *Sent:* Friday, July 31, 2020 3:57 AM *To:* Monika Samal <monika.samal@outlook.com> *Cc:* Fabian Zimmermann <dev.faz@gmail.com>; Amy Marrich <amy@demarco.com>; openstack-discuss <openstack-discuss@lists.openstack.org>; community@lists.openstack.org <community@lists.openstack.org> *Subject:* Re: [openstack-community] Octavia :; Unable to create load balancer

Just to close the loop on this, the octavia.conf file had "project_name = admin" instead of "project_name = service" in the [service_auth] section. This was causing the keystone errors when Octavia was communicating with neutron.

I don't know if that is a bug in kolla-ansible or was just a local configuration issue.

Michael

On Thu, Jul 30, 2020 at 1:39 PM Monika Samal <monika.samal@outlook.com> wrote:

...

Hello Fabian,,

http://paste.openstack.org/show/QxKv2Ai697qulp9UWTjY/

Regards, Monika ________________________________ From: Fabian Zimmermann <dev.faz@gmail.com> Sent: Friday, July 31, 2020 1:57 AM To: Monika Samal <monika.samal@outlook.com> Cc: Michael Johnson <johnsomor@gmail.com>; Amy Marrich <amy@demarco.com>;

openstack-discuss <openstack-discuss@lists.openstack.org>; community@lists.openstack.org <community@lists.openstack.org>

...

Subject: Re: [openstack-community] Octavia :; Unable to create load balancer

Hi,

just to debug, could you replace the auth_type password with v3password?

And do a curl against your :5000 and :35357 urls and paste the output.

Fabian

Monika Samal <monika.samal@outlook.com> schrieb am Do., 30. Juli 2020, 22:15:

Hello Fabian,

http://paste.openstack.org/show/796477/

Thanks, Monika ________________________________ From: Fabian Zimmermann <dev.faz@gmail.com> Sent: Friday, July 31, 2020 1:38 AM To: Monika Samal <monika.samal@outlook.com> Cc: Michael Johnson <johnsomor@gmail.com>; Amy Marrich <amy@demarco.com>; openstack-discuss <openstack-discuss@lists.openstack.org>; community@lists.openstack.org <community@lists.openstack.org> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer

The sections should be

service_auth keystone_authtoken

if i read the docs correctly. Maybe you can just paste your config (remove/change passwords) to paste.openstack.org and post the link?

Fabian

Thanks for responding ? ________________________________ From: Mark Goddard <mark@stackhpc.com> Sent: Thursday, August 6, 2020 1:16 PM To: Michael Johnson <johnsomor@gmail.com> Cc: Monika Samal <monika.samal@outlook.com>; Fabian Zimmermann <dev.faz@gmail.com>; openstack-discuss <openstack-discuss@lists.openstack.org> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer On Wed, 5 Aug 2020 at 16:16, Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>> wrote: Looking at that error, it appears that the lb-mgmt-net is not setup correctly. The Octavia controller containers are not able to reach the amphora instances on the lb-mgmt-net subnet. I don't know how kolla is setup to connect the containers to the neutron lb-mgmt-net network. Maybe the above documents will help with that. Right now it's up to the operator to configure that. The kolla documentation doesn't prescribe any particular setup. We're working on automating it in Victoria. Michael On Wed, Aug 5, 2020 at 12:53 AM Mark Goddard <mark@stackhpc.com<mailto:mark@stackhpc.com>> wrote: On Tue, 4 Aug 2020 at 16:58, Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> wrote: Hello Guys, With Michaels help I was able to solve the problem but now there is another error I was able to create my network on vlan but still error persist. PFB the logs: http://paste.openstack.org/show/fEixSudZ6lzscxYxsG1z/ Kindly help regards, Monika ________________________________ From: Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>> Sent: Monday, August 3, 2020 9:10 PM To: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>> Cc: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer Yeah, it looks like nova is failing to boot the instance. Check this setting in your octavia.conf files: https://docs.openstack.org/octavia/latest/configuration/configref.html#contr... Also, if kolla-ansible didn't set both of these values correctly, please open bug reports for kolla-ansible. These all should have been configured by the deployment tool. I wasn't following this thread due to no [kolla] tag, but here are the recently added docs for Octavia in kolla [1]. Note the octavia_service_auth_project variable which was added to migrate from the admin project to the service project for octavia resources. We're lacking proper automation for the flavor, image etc, but it is being worked on in Victoria [2]. [1] https://docs.openstack.org/kolla-ansible/latest/reference/networking/octavia... [2] https://review.opendev.org/740180 Michael On Mon, Aug 3, 2020 at 7:53 AM Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>> wrote: Seems like the flavor is missing or empty '' - check for typos and enable debug. Check if the nova req contains valid information/flavor. Fabian Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> schrieb am Mo., 3. Aug. 2020, 15:46: It's registered Get Outlook for Android<https://aka.ms/ghei36> ________________________________ From: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>> Sent: Monday, August 3, 2020 7:08:21 PM To: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer Did you check the (nova) flavor you use in octavia. Fabian Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> schrieb am Mo., 3. Aug. 2020, 10:53: After Michael suggestion I was able to create load balancer but there is error in status. [X] PFB the error link: http://paste.openstack.org/show/meNZCeuOlFkfjj189noN/ ________________________________ From: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> Sent: Monday, August 3, 2020 2:08 PM To: Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>> Cc: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>>; Amy Marrich <amy@demarco.com<mailto:amy@demarco.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>>; community@lists.openstack.org<mailto:community@lists.openstack.org> <community@lists.openstack.org<mailto:community@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer Thanks a ton Michael for helping me out ________________________________ From: Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>> Sent: Friday, July 31, 2020 3:57 AM To: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> Cc: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>>; Amy Marrich <amy@demarco.com<mailto:amy@demarco.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>>; community@lists.openstack.org<mailto:community@lists.openstack.org> <community@lists.openstack.org<mailto:community@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer Just to close the loop on this, the octavia.conf file had "project_name = admin" instead of "project_name = service" in the [service_auth] section. This was causing the keystone errors when Octavia was communicating with neutron. I don't know if that is a bug in kolla-ansible or was just a local configuration issue. Michael On Thu, Jul 30, 2020 at 1:39 PM Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> wrote:

Hello Fabian,,

http://paste.openstack.org/show/QxKv2Ai697qulp9UWTjY/

Regards, Monika ________________________________ From: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>> Sent: Friday, July 31, 2020 1:57 AM To: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> Cc: Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>>; Amy Marrich <amy@demarco.com<mailto:amy@demarco.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>>; community@lists.openstack.org<mailto:community@lists.openstack.org> <community@lists.openstack.org<mailto:community@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer

Hi,

just to debug, could you replace the auth_type password with v3password?

And do a curl against your :5000 and :35357 urls and paste the output.

Fabian

Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> schrieb am Do., 30. Juli 2020, 22:15:

Hello Fabian,

http://paste.openstack.org/show/796477/

Thanks, Monika ________________________________ From: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>> Sent: Friday, July 31, 2020 1:38 AM To: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> Cc: Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>>; Amy Marrich <amy@demarco.com<mailto:amy@demarco.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>>; community@lists.openstack.org<mailto:community@lists.openstack.org> <community@lists.openstack.org<mailto:community@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer

The sections should be

service_auth keystone_authtoken

if i read the docs correctly. Maybe you can just paste your config (remove/change passwords) to paste.openstack.org<http://paste.openstack.org> and post the link?

Fabian

________________________________ From: Monika Samal <monika.samal@outlook.com> Sent: Friday, August 7, 2020 4:41:52 AM To: Mark Goddard <mark@stackhpc.com>; Michael Johnson <johnsomor@gmail.com> Cc: Fabian Zimmermann <dev.faz@gmail.com>; openstack-discuss <openstack-discuss@lists.openstack.org> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer I tried following above document still facing same Octavia connection error with amphora image. Regards, Monika ________________________________ From: Mark Goddard <mark@stackhpc.com> Sent: Thursday, August 6, 2020 1:16:01 PM To: Michael Johnson <johnsomor@gmail.com> Cc: Monika Samal <monika.samal@outlook.com>; Fabian Zimmermann <dev.faz@gmail.com>; openstack-discuss <openstack-discuss@lists.openstack.org> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer On Wed, 5 Aug 2020 at 16:16, Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>> wrote: Looking at that error, it appears that the lb-mgmt-net is not setup correctly. The Octavia controller containers are not able to reach the amphora instances on the lb-mgmt-net subnet. I don't know how kolla is setup to connect the containers to the neutron lb-mgmt-net network. Maybe the above documents will help with that. Right now it's up to the operator to configure that. The kolla documentation doesn't prescribe any particular setup. We're working on automating it in Victoria. Michael On Wed, Aug 5, 2020 at 12:53 AM Mark Goddard <mark@stackhpc.com<mailto:mark@stackhpc.com>> wrote: On Tue, 4 Aug 2020 at 16:58, Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> wrote: Hello Guys, With Michaels help I was able to solve the problem but now there is another error I was able to create my network on vlan but still error persist. PFB the logs: http://paste.openstack.org/show/fEixSudZ6lzscxYxsG1z/ Kindly help regards, Monika ________________________________ From: Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>> Sent: Monday, August 3, 2020 9:10 PM To: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>> Cc: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer Yeah, it looks like nova is failing to boot the instance. Check this setting in your octavia.conf files: https://docs.openstack.org/octavia/latest/configuration/configref.html#contr... Also, if kolla-ansible didn't set both of these values correctly, please open bug reports for kolla-ansible. These all should have been configured by the deployment tool. I wasn't following this thread due to no [kolla] tag, but here are the recently added docs for Octavia in kolla [1]. Note the octavia_service_auth_project variable which was added to migrate from the admin project to the service project for octavia resources. We're lacking proper automation for the flavor, image etc, but it is being worked on in Victoria [2]. [1] https://docs.openstack.org/kolla-ansible/latest/reference/networking/octavia... [2] https://review.opendev.org/740180 Michael On Mon, Aug 3, 2020 at 7:53 AM Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>> wrote: Seems like the flavor is missing or empty '' - check for typos and enable debug. Check if the nova req contains valid information/flavor. Fabian Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> schrieb am Mo., 3. Aug. 2020, 15:46: It's registered Get Outlook for Android<https://aka.ms/ghei36> ________________________________ From: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>> Sent: Monday, August 3, 2020 7:08:21 PM To: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer Did you check the (nova) flavor you use in octavia. Fabian Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> schrieb am Mo., 3. Aug. 2020, 10:53: After Michael suggestion I was able to create load balancer but there is error in status. [X] PFB the error link: http://paste.openstack.org/show/meNZCeuOlFkfjj189noN/ ________________________________ From: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> Sent: Monday, August 3, 2020 2:08 PM To: Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>> Cc: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>>; Amy Marrich <amy@demarco.com<mailto:amy@demarco.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>>; community@lists.openstack.org<mailto:community@lists.openstack.org> <community@lists.openstack.org<mailto:community@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer Thanks a ton Michael for helping me out ________________________________ From: Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>> Sent: Friday, July 31, 2020 3:57 AM To: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> Cc: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>>; Amy Marrich <amy@demarco.com<mailto:amy@demarco.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>>; community@lists.openstack.org<mailto:community@lists.openstack.org> <community@lists.openstack.org<mailto:community@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer Just to close the loop on this, the octavia.conf file had "project_name = admin" instead of "project_name = service" in the [service_auth] section. This was causing the keystone errors when Octavia was communicating with neutron. I don't know if that is a bug in kolla-ansible or was just a local configuration issue. Michael On Thu, Jul 30, 2020 at 1:39 PM Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> wrote:

Hello Fabian,,

http://paste.openstack.org/show/QxKv2Ai697qulp9UWTjY/

Regards, Monika ________________________________ From: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>> Sent: Friday, July 31, 2020 1:57 AM To: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> Cc: Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>>; Amy Marrich <amy@demarco.com<mailto:amy@demarco.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>>; community@lists.openstack.org<mailto:community@lists.openstack.org> <community@lists.openstack.org<mailto:community@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer

Hi,

just to debug, could you replace the auth_type password with v3password?

And do a curl against your :5000 and :35357 urls and paste the output.

Fabian

Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> schrieb am Do., 30. Juli 2020, 22:15:

Hello Fabian,

http://paste.openstack.org/show/796477/

Thanks, Monika ________________________________ From: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>> Sent: Friday, July 31, 2020 1:38 AM To: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> Cc: Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>>; Amy Marrich <amy@demarco.com<mailto:amy@demarco.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>>; community@lists.openstack.org<mailto:community@lists.openstack.org> <community@lists.openstack.org<mailto:community@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer

The sections should be

service_auth keystone_authtoken

if i read the docs correctly. Maybe you can just paste your config (remove/change passwords) to paste.openstack.org<http://paste.openstack.org> and post the link?

Fabian

That looks like there is still a kolla networking issue where the amphora are not able to reach the controller processes. Please fix the lb-mgmt-net such that it can reach the amphora and the controller containers. This should be setup via the deployment tool, kolla in this case. Michael On Sun, Aug 9, 2020 at 5:02 AM Monika Samal <monika.samal@outlook.com> wrote:

Hi All,

Below is the error am getting, i tried configuring network issue as well still finding it difficult to resolve.

Below is my log...if somebody can help me resolving it..it would be great help since its very urgent...

http://paste.openstack.org/show/TsagcQX2ZKd6rhhsYcYd/

Regards, Monika ------------------------------ *From:* Monika Samal <monika.samal@outlook.com> *Sent:* Sunday, 9 August, 2020, 5:29 pm *To:* Mark Goddard; Michael Johnson; openstack-discuss *Cc:* Fabian Zimmermann *Subject:* Re: [openstack-community] Octavia :; Unable to create load balancer

------------------------------ *From:* Monika Samal <monika.samal@outlook.com> *Sent:* Friday, August 7, 2020 4:41:52 AM *To:* Mark Goddard <mark@stackhpc.com>; Michael Johnson < johnsomor@gmail.com> *Cc:* Fabian Zimmermann <dev.faz@gmail.com>; openstack-discuss < openstack-discuss@lists.openstack.org> *Subject:* Re: [openstack-community] Octavia :; Unable to create load balancer

I tried following above document still facing same Octavia connection error with amphora image.

Regards, Monika ------------------------------ *From:* Mark Goddard <mark@stackhpc.com> *Sent:* Thursday, August 6, 2020 1:16:01 PM *To:* Michael Johnson <johnsomor@gmail.com> *Cc:* Monika Samal <monika.samal@outlook.com>; Fabian Zimmermann < dev.faz@gmail.com>; openstack-discuss < openstack-discuss@lists.openstack.org> *Subject:* Re: [openstack-community] Octavia :; Unable to create load balancer

On Wed, 5 Aug 2020 at 16:16, Michael Johnson <johnsomor@gmail.com> wrote:

Looking at that error, it appears that the lb-mgmt-net is not setup correctly. The Octavia controller containers are not able to reach the amphora instances on the lb-mgmt-net subnet.

I don't know how kolla is setup to connect the containers to the neutron lb-mgmt-net network. Maybe the above documents will help with that.

Right now it's up to the operator to configure that. The kolla documentation doesn't prescribe any particular setup. We're working on automating it in Victoria.

Michael

On Wed, Aug 5, 2020 at 12:53 AM Mark Goddard <mark@stackhpc.com> wrote:

On Tue, 4 Aug 2020 at 16:58, Monika Samal <monika.samal@outlook.com> wrote:

Hello Guys,

With Michaels help I was able to solve the problem but now there is another error I was able to create my network on vlan but still error persist. PFB the logs:

http://paste.openstack.org/show/fEixSudZ6lzscxYxsG1z/

Kindly help

regards, Monika ------------------------------ *From:* Michael Johnson <johnsomor@gmail.com> *Sent:* Monday, August 3, 2020 9:10 PM *To:* Fabian Zimmermann <dev.faz@gmail.com> *Cc:* Monika Samal <monika.samal@outlook.com>; openstack-discuss < openstack-discuss@lists.openstack.org> *Subject:* Re: [openstack-community] Octavia :; Unable to create load balancer

Yeah, it looks like nova is failing to boot the instance.

Check this setting in your octavia.conf files: https://docs.openstack.org/octavia/latest/configuration/configref.html#contr...

Also, if kolla-ansible didn't set both of these values correctly, please open bug reports for kolla-ansible. These all should have been configured by the deployment tool.

I wasn't following this thread due to no [kolla] tag, but here are the recently added docs for Octavia in kolla [1]. Note the octavia_service_auth_project variable which was added to migrate from the admin project to the service project for octavia resources. We're lacking proper automation for the flavor, image etc, but it is being worked on in Victoria [2].

[1] https://docs.openstack.org/kolla-ansible/latest/reference/networking/octavia... [2] https://review.opendev.org/740180

Michael

On Mon, Aug 3, 2020 at 7:53 AM Fabian Zimmermann <dev.faz@gmail.com> wrote:

Seems like the flavor is missing or empty '' - check for typos and enable debug.

Check if the nova req contains valid information/flavor.

Fabian

Monika Samal <monika.samal@outlook.com> schrieb am Mo., 3. Aug. 2020, 15:46:

It's registered

Get Outlook for Android <https://aka.ms/ghei36> ------------------------------ *From:* Fabian Zimmermann <dev.faz@gmail.com> *Sent:* Monday, August 3, 2020 7:08:21 PM *To:* Monika Samal <monika.samal@outlook.com>; openstack-discuss < openstack-discuss@lists.openstack.org> *Subject:* Re: [openstack-community] Octavia :; Unable to create load balancer

Did you check the (nova) flavor you use in octavia.

Fabian

Monika Samal <monika.samal@outlook.com> schrieb am Mo., 3. Aug. 2020, 10:53:

After Michael suggestion I was able to create load balancer but there is error in status.

PFB the error link:

http://paste.openstack.org/show/meNZCeuOlFkfjj189noN/ ------------------------------ *From:* Monika Samal <monika.samal@outlook.com> *Sent:* Monday, August 3, 2020 2:08 PM *To:* Michael Johnson <johnsomor@gmail.com> *Cc:* Fabian Zimmermann <dev.faz@gmail.com>; Amy Marrich <amy@demarco.com>; openstack-discuss <openstack-discuss@lists.openstack.org>; community@lists.openstack.org <community@lists.openstack.org> *Subject:* Re: [openstack-community] Octavia :; Unable to create load balancer

Thanks a ton Michael for helping me out ------------------------------ *From:* Michael Johnson <johnsomor@gmail.com> *Sent:* Friday, July 31, 2020 3:57 AM *To:* Monika Samal <monika.samal@outlook.com> *Cc:* Fabian Zimmermann <dev.faz@gmail.com>; Amy Marrich <amy@demarco.com>; openstack-discuss <openstack-discuss@lists.openstack.org>; community@lists.openstack.org <community@lists.openstack.org> *Subject:* Re: [openstack-community] Octavia :; Unable to create load balancer

Just to close the loop on this, the octavia.conf file had "project_name = admin" instead of "project_name = service" in the [service_auth] section. This was causing the keystone errors when Octavia was communicating with neutron.

I don't know if that is a bug in kolla-ansible or was just a local configuration issue.

Michael

On Thu, Jul 30, 2020 at 1:39 PM Monika Samal <monika.samal@outlook.com> wrote:

...

Hello Fabian,,

http://paste.openstack.org/show/QxKv2Ai697qulp9UWTjY/

Regards, Monika ________________________________ From: Fabian Zimmermann <dev.faz@gmail.com> Sent: Friday, July 31, 2020 1:57 AM To: Monika Samal <monika.samal@outlook.com> Cc: Michael Johnson <johnsomor@gmail.com>; Amy Marrich <amy@demarco.com>;

openstack-discuss <openstack-discuss@lists.openstack.org>; community@lists.openstack.org <community@lists.openstack.org>

...

Subject: Re: [openstack-community] Octavia :; Unable to create load balancer

Hi,

just to debug, could you replace the auth_type password with v3password?

And do a curl against your :5000 and :35357 urls and paste the output.

Fabian

Monika Samal <monika.samal@outlook.com> schrieb am Do., 30. Juli 2020, 22:15:

Hello Fabian,

http://paste.openstack.org/show/796477/

Thanks, Monika ________________________________ From: Fabian Zimmermann <dev.faz@gmail.com> Sent: Friday, July 31, 2020 1:38 AM To: Monika Samal <monika.samal@outlook.com> Cc: Michael Johnson <johnsomor@gmail.com>; Amy Marrich <amy@demarco.com>; openstack-discuss <openstack-discuss@lists.openstack.org>; community@lists.openstack.org <community@lists.openstack.org> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer

The sections should be

service_auth keystone_authtoken

if i read the docs correctly. Maybe you can just paste your config (remove/change passwords) to paste.openstack.org and post the link?

Fabian

Sure, I am trying and will confirm shortly Get Outlook for Android<https://aka.ms/ghei36> ________________________________ From: Fabian Zimmermann <dev.faz@gmail.com> Sent: Monday, August 10, 2020 11:19:36 AM To: Michael Johnson <johnsomor@gmail.com> Cc: Monika Samal <monika.samal@outlook.com>; openstack-discuss <openstack-discuss@lists.openstack.org>; Mark Goddard <mark@stackhpc.com> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer Hi, to test your connection you can create an instance im the octavia network and try to ping/ssh from your controller (dont forget a suitable security group) Fabian Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>> schrieb am Mo., 10. Aug. 2020, 07:44: That looks like there is still a kolla networking issue where the amphora are not able to reach the controller processes. Please fix the lb-mgmt-net such that it can reach the amphora and the controller containers. This should be setup via the deployment tool, kolla in this case. Michael On Sun, Aug 9, 2020 at 5:02 AM Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> wrote: Hi All, Below is the error am getting, i tried configuring network issue as well still finding it difficult to resolve. Below is my log...if somebody can help me resolving it..it would be great help since its very urgent... http://paste.openstack.org/show/TsagcQX2ZKd6rhhsYcYd/ Regards, Monika ________________________________ From: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> Sent: Sunday, 9 August, 2020, 5:29 pm To: Mark Goddard; Michael Johnson; openstack-discuss Cc: Fabian Zimmermann Subject: Re: [openstack-community] Octavia :; Unable to create load balancer ________________________________ From: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> Sent: Friday, August 7, 2020 4:41:52 AM To: Mark Goddard <mark@stackhpc.com<mailto:mark@stackhpc.com>>; Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>> Cc: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer I tried following above document still facing same Octavia connection error with amphora image. Regards, Monika ________________________________ From: Mark Goddard <mark@stackhpc.com<mailto:mark@stackhpc.com>> Sent: Thursday, August 6, 2020 1:16:01 PM To: Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>> Cc: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>>; Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer On Wed, 5 Aug 2020 at 16:16, Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>> wrote: Looking at that error, it appears that the lb-mgmt-net is not setup correctly. The Octavia controller containers are not able to reach the amphora instances on the lb-mgmt-net subnet. I don't know how kolla is setup to connect the containers to the neutron lb-mgmt-net network. Maybe the above documents will help with that. Right now it's up to the operator to configure that. The kolla documentation doesn't prescribe any particular setup. We're working on automating it in Victoria. Michael On Wed, Aug 5, 2020 at 12:53 AM Mark Goddard <mark@stackhpc.com<mailto:mark@stackhpc.com>> wrote: On Tue, 4 Aug 2020 at 16:58, Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> wrote: Hello Guys, With Michaels help I was able to solve the problem but now there is another error I was able to create my network on vlan but still error persist. PFB the logs: http://paste.openstack.org/show/fEixSudZ6lzscxYxsG1z/ Kindly help regards, Monika ________________________________ From: Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>> Sent: Monday, August 3, 2020 9:10 PM To: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>> Cc: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer Yeah, it looks like nova is failing to boot the instance. Check this setting in your octavia.conf files: https://docs.openstack.org/octavia/latest/configuration/configref.html#contr... Also, if kolla-ansible didn't set both of these values correctly, please open bug reports for kolla-ansible. These all should have been configured by the deployment tool. I wasn't following this thread due to no [kolla] tag, but here are the recently added docs for Octavia in kolla [1]. Note the octavia_service_auth_project variable which was added to migrate from the admin project to the service project for octavia resources. We're lacking proper automation for the flavor, image etc, but it is being worked on in Victoria [2]. [1] https://docs.openstack.org/kolla-ansible/latest/reference/networking/octavia... [2] https://review.opendev.org/740180 Michael On Mon, Aug 3, 2020 at 7:53 AM Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>> wrote: Seems like the flavor is missing or empty '' - check for typos and enable debug. Check if the nova req contains valid information/flavor. Fabian Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> schrieb am Mo., 3. Aug. 2020, 15:46: It's registered Get Outlook for Android<https://aka.ms/ghei36> ________________________________ From: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>> Sent: Monday, August 3, 2020 7:08:21 PM To: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer Did you check the (nova) flavor you use in octavia. Fabian Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> schrieb am Mo., 3. Aug. 2020, 10:53: After Michael suggestion I was able to create load balancer but there is error in status. [X] PFB the error link: http://paste.openstack.org/show/meNZCeuOlFkfjj189noN/ ________________________________ From: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> Sent: Monday, August 3, 2020 2:08 PM To: Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>> Cc: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>>; Amy Marrich <amy@demarco.com<mailto:amy@demarco.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>>; community@lists.openstack.org<mailto:community@lists.openstack.org> <community@lists.openstack.org<mailto:community@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer Thanks a ton Michael for helping me out ________________________________ From: Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>> Sent: Friday, July 31, 2020 3:57 AM To: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> Cc: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>>; Amy Marrich <amy@demarco.com<mailto:amy@demarco.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>>; community@lists.openstack.org<mailto:community@lists.openstack.org> <community@lists.openstack.org<mailto:community@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer Just to close the loop on this, the octavia.conf file had "project_name = admin" instead of "project_name = service" in the [service_auth] section. This was causing the keystone errors when Octavia was communicating with neutron. I don't know if that is a bug in kolla-ansible or was just a local configuration issue. Michael On Thu, Jul 30, 2020 at 1:39 PM Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> wrote:

Hello Fabian,,

http://paste.openstack.org/show/QxKv2Ai697qulp9UWTjY/

Regards, Monika ________________________________ From: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>> Sent: Friday, July 31, 2020 1:57 AM To: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> Cc: Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>>; Amy Marrich <amy@demarco.com<mailto:amy@demarco.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>>; community@lists.openstack.org<mailto:community@lists.openstack.org> <community@lists.openstack.org<mailto:community@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer

Hi,

just to debug, could you replace the auth_type password with v3password?

And do a curl against your :5000 and :35357 urls and paste the output.

Fabian

Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> schrieb am Do., 30. Juli 2020, 22:15:

Hello Fabian,

http://paste.openstack.org/show/796477/

Thanks, Monika ________________________________ From: Fabian Zimmermann <dev.faz@gmail.com<mailto:dev.faz@gmail.com>> Sent: Friday, July 31, 2020 1:38 AM To: Monika Samal <monika.samal@outlook.com<mailto:monika.samal@outlook.com>> Cc: Michael Johnson <johnsomor@gmail.com<mailto:johnsomor@gmail.com>>; Amy Marrich <amy@demarco.com<mailto:amy@demarco.com>>; openstack-discuss <openstack-discuss@lists.openstack.org<mailto:openstack-discuss@lists.openstack.org>>; community@lists.openstack.org<mailto:community@lists.openstack.org> <community@lists.openstack.org<mailto:community@lists.openstack.org>> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer

The sections should be

service_auth keystone_authtoken

if i read the docs correctly. Maybe you can just paste your config (remove/change passwords) to paste.openstack.org<http://paste.openstack.org> and post the link?

Fabian

Hi, Check if the vlan of eth1 is reachable by the compute nodes on the nic connected to br-ex. Is the lb-net created with the correct vlan-id so the traffic is able to flow from the nic to br-ex to the instance? Proof this with tcpdump (-e) Fabian connected to the Monika Samal <monika.samal@outlook.com> schrieb am Mo., 10. Aug. 2020, 13:12:

Hey Fabian,

I tried creating and testing instance with my available subnet created for loadbalancer , I am not able to ping it.

Please find below ip a output for controller and deployment node:

Controller Node: 30.0.0.14

Deployment Node: 30.0.0.11

------------------------------ *From:* Fabian Zimmermann <dev.faz@gmail.com> *Sent:* Monday, August 10, 2020 11:19 AM *To:* Michael Johnson <johnsomor@gmail.com> *Cc:* Monika Samal <monika.samal@outlook.com>; openstack-discuss < openstack-discuss@lists.openstack.org>; Mark Goddard <mark@stackhpc.com> *Subject:* Re: [openstack-community] Octavia :; Unable to create load balancer

Hi,

to test your connection you can create an instance im the octavia network and try to ping/ssh from your controller (dont forget a suitable security group)

Fabian

Michael Johnson <johnsomor@gmail.com> schrieb am Mo., 10. Aug. 2020, 07:44:

That looks like there is still a kolla networking issue where the amphora are not able to reach the controller processes. Please fix the lb-mgmt-net such that it can reach the amphora and the controller containers. This should be setup via the deployment tool, kolla in this case.

Michael

On Sun, Aug 9, 2020 at 5:02 AM Monika Samal <monika.samal@outlook.com> wrote:

Hi All,

Below is the error am getting, i tried configuring network issue as well still finding it difficult to resolve.

Below is my log...if somebody can help me resolving it..it would be great help since its very urgent...

http://paste.openstack.org/show/TsagcQX2ZKd6rhhsYcYd/

Regards, Monika ------------------------------ *From:* Monika Samal <monika.samal@outlook.com> *Sent:* Sunday, 9 August, 2020, 5:29 pm *To:* Mark Goddard; Michael Johnson; openstack-discuss *Cc:* Fabian Zimmermann *Subject:* Re: [openstack-community] Octavia :; Unable to create load balancer

------------------------------ *From:* Monika Samal <monika.samal@outlook.com> *Sent:* Friday, August 7, 2020 4:41:52 AM *To:* Mark Goddard <mark@stackhpc.com>; Michael Johnson < johnsomor@gmail.com> *Cc:* Fabian Zimmermann <dev.faz@gmail.com>; openstack-discuss < openstack-discuss@lists.openstack.org> *Subject:* Re: [openstack-community] Octavia :; Unable to create load balancer

I tried following above document still facing same Octavia connection error with amphora image.

Regards, Monika ------------------------------ *From:* Mark Goddard <mark@stackhpc.com> *Sent:* Thursday, August 6, 2020 1:16:01 PM *To:* Michael Johnson <johnsomor@gmail.com> *Cc:* Monika Samal <monika.samal@outlook.com>; Fabian Zimmermann < dev.faz@gmail.com>; openstack-discuss < openstack-discuss@lists.openstack.org> *Subject:* Re: [openstack-community] Octavia :; Unable to create load balancer

On Wed, 5 Aug 2020 at 16:16, Michael Johnson <johnsomor@gmail.com> wrote:

Looking at that error, it appears that the lb-mgmt-net is not setup correctly. The Octavia controller containers are not able to reach the amphora instances on the lb-mgmt-net subnet.

I don't know how kolla is setup to connect the containers to the neutron lb-mgmt-net network. Maybe the above documents will help with that.

Right now it's up to the operator to configure that. The kolla documentation doesn't prescribe any particular setup. We're working on automating it in Victoria.

Michael

On Wed, Aug 5, 2020 at 12:53 AM Mark Goddard <mark@stackhpc.com> wrote:

On Tue, 4 Aug 2020 at 16:58, Monika Samal <monika.samal@outlook.com> wrote:

Hello Guys,

With Michaels help I was able to solve the problem but now there is another error I was able to create my network on vlan but still error persist. PFB the logs:

http://paste.openstack.org/show/fEixSudZ6lzscxYxsG1z/

Kindly help

regards, Monika ------------------------------ *From:* Michael Johnson <johnsomor@gmail.com> *Sent:* Monday, August 3, 2020 9:10 PM *To:* Fabian Zimmermann <dev.faz@gmail.com> *Cc:* Monika Samal <monika.samal@outlook.com>; openstack-discuss < openstack-discuss@lists.openstack.org> *Subject:* Re: [openstack-community] Octavia :; Unable to create load balancer

Yeah, it looks like nova is failing to boot the instance.

Check this setting in your octavia.conf files: https://docs.openstack.org/octavia/latest/configuration/configref.html#contr...

Also, if kolla-ansible didn't set both of these values correctly, please open bug reports for kolla-ansible. These all should have been configured by the deployment tool.

I wasn't following this thread due to no [kolla] tag, but here are the recently added docs for Octavia in kolla [1]. Note the octavia_service_auth_project variable which was added to migrate from the admin project to the service project for octavia resources. We're lacking proper automation for the flavor, image etc, but it is being worked on in Victoria [2].

[1] https://docs.openstack.org/kolla-ansible/latest/reference/networking/octavia... [2] https://review.opendev.org/740180

Michael

On Mon, Aug 3, 2020 at 7:53 AM Fabian Zimmermann <dev.faz@gmail.com> wrote:

Seems like the flavor is missing or empty '' - check for typos and enable debug.

Check if the nova req contains valid information/flavor.

Fabian

Monika Samal <monika.samal@outlook.com> schrieb am Mo., 3. Aug. 2020, 15:46:

It's registered

Get Outlook for Android <https://aka.ms/ghei36> ------------------------------ *From:* Fabian Zimmermann <dev.faz@gmail.com> *Sent:* Monday, August 3, 2020 7:08:21 PM *To:* Monika Samal <monika.samal@outlook.com>; openstack-discuss < openstack-discuss@lists.openstack.org> *Subject:* Re: [openstack-community] Octavia :; Unable to create load balancer

Did you check the (nova) flavor you use in octavia.

Fabian

Monika Samal <monika.samal@outlook.com> schrieb am Mo., 3. Aug. 2020, 10:53:

After Michael suggestion I was able to create load balancer but there is error in status.

PFB the error link:

http://paste.openstack.org/show/meNZCeuOlFkfjj189noN/ ------------------------------ *From:* Monika Samal <monika.samal@outlook.com> *Sent:* Monday, August 3, 2020 2:08 PM *To:* Michael Johnson <johnsomor@gmail.com> *Cc:* Fabian Zimmermann <dev.faz@gmail.com>; Amy Marrich <amy@demarco.com>; openstack-discuss <openstack-discuss@lists.openstack.org>; community@lists.openstack.org <community@lists.openstack.org> *Subject:* Re: [openstack-community] Octavia :; Unable to create load balancer

Thanks a ton Michael for helping me out ------------------------------ *From:* Michael Johnson <johnsomor@gmail.com> *Sent:* Friday, July 31, 2020 3:57 AM *To:* Monika Samal <monika.samal@outlook.com> *Cc:* Fabian Zimmermann <dev.faz@gmail.com>; Amy Marrich <amy@demarco.com>; openstack-discuss <openstack-discuss@lists.openstack.org>; community@lists.openstack.org <community@lists.openstack.org> *Subject:* Re: [openstack-community] Octavia :; Unable to create load balancer

Just to close the loop on this, the octavia.conf file had "project_name = admin" instead of "project_name = service" in the [service_auth] section. This was causing the keystone errors when Octavia was communicating with neutron.

I don't know if that is a bug in kolla-ansible or was just a local configuration issue.

Michael

On Thu, Jul 30, 2020 at 1:39 PM Monika Samal <monika.samal@outlook.com> wrote:

...

Hello Fabian,,

http://paste.openstack.org/show/QxKv2Ai697qulp9UWTjY/

Regards, Monika ________________________________ From: Fabian Zimmermann <dev.faz@gmail.com> Sent: Friday, July 31, 2020 1:57 AM To: Monika Samal <monika.samal@outlook.com> Cc: Michael Johnson <johnsomor@gmail.com>; Amy Marrich <amy@demarco.com>;

openstack-discuss <openstack-discuss@lists.openstack.org>; community@lists.openstack.org <community@lists.openstack.org>

...

Subject: Re: [openstack-community] Octavia :; Unable to create load balancer

Hi,

just to debug, could you replace the auth_type password with v3password?

And do a curl against your :5000 and :35357 urls and paste the output.

Fabian

Monika Samal <monika.samal@outlook.com> schrieb am Do., 30. Juli 2020, 22:15:

Hello Fabian,

http://paste.openstack.org/show/796477/

Thanks, Monika ________________________________ From: Fabian Zimmermann <dev.faz@gmail.com> Sent: Friday, July 31, 2020 1:38 AM To: Monika Samal <monika.samal@outlook.com> Cc: Michael Johnson <johnsomor@gmail.com>; Amy Marrich <amy@demarco.com>; openstack-discuss <openstack-discuss@lists.openstack.org>; community@lists.openstack.org <community@lists.openstack.org> Subject: Re: [openstack-community] Octavia :; Unable to create load balancer

The sections should be

service_auth keystone_authtoken

if i read the docs correctly. Maybe you can just paste your config (remove/change passwords) to paste.openstack.org and post the link?

Fabian

Hi, I am using OpenStack Keystone Stein and run into the below error often where Keystone public process(listening to 5000) is running inside Apache httpd runs into the below. This problem is resolved with a restart of httpd service. Has anyone run into a similar issue ? This is seen soon after httpd is restarted and does not happen all the time. My environment has MariaDB backend. This problem is not limited to the assignment table and is seen across all other tables in Keystone. MariaDB service is functional and all the tables are in place. [Fri Aug 07 08:20:59.936087 2020] [:info] [pid 1420287] mod_wsgi (pid=1420287, process='keystone-public', application=''): Loading WSGI script '/usr/bin/keystone-wsgi-public'. [Fri Aug 07 08:20:59.936089 2020] [:info] [pid 1420288] mod_wsgi (pid=1420288, process='keystone-admin', application=''): Loading WSGI script '/usr/bin/keystone-wsgi-admin'. [Fri Aug 07 08:20:59.943431 2020] [ssl:info] [pid 1420290] [client 1.2.3.95:35762] AH01964: Connection to child 1 established (server 1.2.3.50:5000) [Fri Aug 07 08:21:00.009317 2020] [ssl:info] [pid 1420291] [client 1.2.3.113:60132] AH01964: Connection to child 2 established (server 1.2.3.50:5000) [Fri Aug 07 08:21:01.243594 2020] [ssl:info] [pid 1420289] [client 1.2.3.50:53996] AH01964: Connection to child 0 established (server 1.2.3.50:5000) [Fri Aug 07 08:21:01.386329 2020] [ssl:info] [pid 1420293] [client x.x.x.x:38645] AH01964: Connection to child 4 established (server 1.2.3.50:5000) [Fri Aug 07 08:21:01.824041 2020] [ssl:info] [pid 1420349] [client 1.2.3.101:42974] AH01964: Connection to child 5 established (server 1.2.3.50:5000) [Fri Aug 07 08:21:02.949166 2020] [ssl:info] [pid 1420378] [client 1.2.3.50:54014] AH01964: Connection to child 9 established (server 1.2.3.50:5000) [Fri Aug 07 08:21:02.949172 2020] [ssl:info] [pid 1420379] [client 1.2.3.80:46924] AH01964: Connection to child 10 established (server 1.2.3.50:5000) [Fri Aug 07 08:21:03.286057 2020] [:info] [pid 1420287] mod_wsgi (pid=1420287): Create interpreter '1.2.3.50:5000|'. [Fri Aug 07 08:21:03.287286 2020] [:info] [pid 1420287] [remote 1.2.3.95:156] mod_wsgi (pid=1420287, process='keystone-public', application='1.2.3.50:5000|'): Loading WSGI script '/usr/bin/keystone-wsgi-public'. [Fri Aug 07 08:21:04.675059 2020] [ssl:info] [pid 1420436] [client 1.2.3.50:54032] AH01964: Connection to child 12 established (server 1.2.3.50:5000) [Fri Aug 07 08:21:04.705975 2020] [ssl:info] [pid 1420437] [client 1.2.3.107:59554] AH01964: Connection to child 13 established (server 1.2.3.50:5000) [Fri Aug 07 08:21:06.960940 2020] [ssl:info] [pid 1420438] [client 1.2.3.80:46970] AH01964: Connection to child 14 established (server 1.2.3.50:5000) [Fri Aug 07 08:21:07.661670 2020] [ssl:info] [pid 1420349] [client 1.2.3.50:54124] AH01964: Connection to child 5 established (server 1.2.3.50:5000) [Fri Aug 07 08:21:07.683383 2020] [ssl:info] [pid 1420292] [client x.x.x.x:30065] AH01964: Connection to child 3 established (server 1.2.3.50:5000) [Fri Aug 07 08:21:08.442956 2020] [:error] [pid 1420287] [remote x.x.x.x:144] mod_wsgi (pid=1420287): Exception occurred processing WSGI script '/usr/bin/keystone-wsgi-public'. [Fri Aug 07 08:21:08.443002 2020] [:error] [pid 1420287] [remote x.x.x.x:144] Traceback (most recent call last): [Fri Aug 07 08:21:08.443017 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask/app.py", line 2309, in __call__ [Fri Aug 07 08:21:08.443509 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return self.wsgi_app(environ, start_response) [Fri Aug 07 08:21:08.443525 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/werkzeug/contrib/fixers.py", line 152, in __call__ [Fri Aug 07 08:21:08.443630 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return self.app(environ, start_response) [Fri Aug 07 08:21:08.443644 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/dec.py", line 129, in __call__ [Fri Aug 07 08:21:08.443746 2020] [:error] [pid 1420287] [remote x.x.x.x:144] resp = self.call_func(req, *args, **kw) [Fri Aug 07 08:21:08.443756 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/dec.py", line 193, in call_func [Fri Aug 07 08:21:08.443773 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return self.func(req, *args, **kwargs) [Fri Aug 07 08:21:08.443781 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/oslo_middleware/base.py", line 131, in __call__ [Fri Aug 07 08:21:08.443844 2020] [:error] [pid 1420287] [remote x.x.x.x:144] response = req.get_response(self.application) [Fri Aug 07 08:21:08.443859 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/request.py", line 1314, in send [Fri Aug 07 08:21:08.444194 2020] [:error] [pid 1420287] [remote x.x.x.x:144] application, catch_exc_info=False) [Fri Aug 07 08:21:08.444203 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/request.py", line 1278, in call_application [Fri Aug 07 08:21:08.444220 2020] [:error] [pid 1420287] [remote x.x.x.x:144] app_iter = application(self.environ, start_response) [Fri Aug 07 08:21:08.444229 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/dec.py", line 143, in __call__ [Fri Aug 07 08:21:08.444245 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return resp(environ, start_response) [Fri Aug 07 08:21:08.444253 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/dec.py", line 129, in __call__ [Fri Aug 07 08:21:08.444268 2020] [:error] [pid 1420287] [remote x.x.x.x:144] resp = self.call_func(req, *args, **kw) [Fri Aug 07 08:21:08.444276 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/dec.py", line 193, in call_func [Fri Aug 07 08:21:08.444292 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return self.func(req, *args, **kwargs) [Fri Aug 07 08:21:08.444300 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/oslo_middleware/base.py", line 131, in __call__ [Fri Aug 07 08:21:08.444315 2020] [:error] [pid 1420287] [remote x.x.x.x:144] response = req.get_response(self.application) [Fri Aug 07 08:21:08.444323 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/request.py", line 1314, in send [Fri Aug 07 08:21:08.444338 2020] [:error] [pid 1420287] [remote x.x.x.x:144] application, catch_exc_info=False) [Fri Aug 07 08:21:08.444346 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/request.py", line 1278, in call_application [Fri Aug 07 08:21:08.444361 2020] [:error] [pid 1420287] [remote x.x.x.x:144] app_iter = application(self.environ, start_response) [Fri Aug 07 08:21:08.444370 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/dec.py", line 129, in __call__ [Fri Aug 07 08:21:08.444385 2020] [:error] [pid 1420287] [remote x.x.x.x:144] resp = self.call_func(req, *args, **kw) [Fri Aug 07 08:21:08.444393 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/dec.py", line 193, in call_func [Fri Aug 07 08:21:08.444408 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return self.func(req, *args, **kwargs) [Fri Aug 07 08:21:08.444416 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/osprofiler/web.py", line 112, in __call__ [Fri Aug 07 08:21:08.444476 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return request.get_response(self.application) [Fri Aug 07 08:21:08.444485 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/request.py", line 1314, in send [Fri Aug 07 08:21:08.444501 2020] [:error] [pid 1420287] [remote x.x.x.x:144] application, catch_exc_info=False) [Fri Aug 07 08:21:08.444509 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/request.py", line 1278, in call_application [Fri Aug 07 08:21:08.444524 2020] [:error] [pid 1420287] [remote x.x.x.x:144] app_iter = application(self.environ, start_response) [Fri Aug 07 08:21:08.444533 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/dec.py", line 129, in __call__ [Fri Aug 07 08:21:08.444547 2020] [:error] [pid 1420287] [remote x.x.x.x:144] resp = self.call_func(req, *args, **kw) [Fri Aug 07 08:21:08.444556 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/dec.py", line 193, in call_func [Fri Aug 07 08:21:08.444571 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return self.func(req, *args, **kwargs) [Fri Aug 07 08:21:08.444587 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/oslo_middleware/request_id.py", line 58, in __call__ [Fri Aug 07 08:21:08.444636 2020] [:error] [pid 1420287] [remote x.x.x.x:144] response = req.get_response(self.application) [Fri Aug 07 08:21:08.444645 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/request.py", line 1314, in send [Fri Aug 07 08:21:08.444660 2020] [:error] [pid 1420287] [remote x.x.x.x:144] application, catch_exc_info=False) [Fri Aug 07 08:21:08.444669 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/request.py", line 1278, in call_application [Fri Aug 07 08:21:08.444684 2020] [:error] [pid 1420287] [remote x.x.x.x:144] app_iter = application(self.environ, start_response) [Fri Aug 07 08:21:08.444698 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/keystone/server/flask/request_processing/middleware/url_normalize.py", line 38, in __call__ [Fri Aug 07 08:21:08.444750 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return self.app(environ, start_response) [Fri Aug 07 08:21:08.444759 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/dec.py", line 129, in __call__ [Fri Aug 07 08:21:08.444774 2020] [:error] [pid 1420287] [remote x.x.x.x:144] resp = self.call_func(req, *args, **kw) [Fri Aug 07 08:21:08.444783 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/dec.py", line 193, in call_func [Fri Aug 07 08:21:08.444797 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return self.func(req, *args, **kwargs) [Fri Aug 07 08:21:08.444810 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/keystonemiddleware/auth_token/__init__.py", line 333, in __call__ [Fri Aug 07 08:21:08.444828 2020] [:error] [pid 1420287] [remote x.x.x.x:144] response = req.get_response(self._app) [Fri Aug 07 08:21:08.444836 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/request.py", line 1314, in send [Fri Aug 07 08:21:08.444851 2020] [:error] [pid 1420287] [remote x.x.x.x:144] application, catch_exc_info=False) [Fri Aug 07 08:21:08.444859 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/request.py", line 1278, in call_application [Fri Aug 07 08:21:08.444874 2020] [:error] [pid 1420287] [remote x.x.x.x:144] app_iter = application(self.environ, start_response) [Fri Aug 07 08:21:08.444883 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/dec.py", line 129, in __call__ [Fri Aug 07 08:21:08.444897 2020] [:error] [pid 1420287] [remote x.x.x.x:144] resp = self.call_func(req, *args, **kw) [Fri Aug 07 08:21:08.444906 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/dec.py", line 193, in call_func [Fri Aug 07 08:21:08.444920 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return self.func(req, *args, **kwargs) [Fri Aug 07 08:21:08.444929 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/oslo_middleware/base.py", line 131, in __call__ [Fri Aug 07 08:21:08.444944 2020] [:error] [pid 1420287] [remote x.x.x.x:144] response = req.get_response(self.application) [Fri Aug 07 08:21:08.444952 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/request.py", line 1314, in send [Fri Aug 07 08:21:08.444967 2020] [:error] [pid 1420287] [remote x.x.x.x:144] application, catch_exc_info=False) [Fri Aug 07 08:21:08.444975 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/webob/request.py", line 1278, in call_application [Fri Aug 07 08:21:08.444990 2020] [:error] [pid 1420287] [remote x.x.x.x:144] app_iter = application(self.environ, start_response) [Fri Aug 07 08:21:08.444998 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/werkzeug/wsgi.py", line 826, in __call__ [Fri Aug 07 08:21:08.445279 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return app(environ, start_response) [Fri Aug 07 08:21:08.445288 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask/app.py", line 2295, in wsgi_app [Fri Aug 07 08:21:08.445304 2020] [:error] [pid 1420287] [remote x.x.x.x:144] response = self.handle_exception(e) [Fri Aug 07 08:21:08.445316 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445490 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445500 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445516 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445524 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445539 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445547 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445562 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445570 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445585 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445593 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445608 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445616 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445630 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445639 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445654 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445662 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445676 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445685 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445699 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445708 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445722 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445731 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445745 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445758 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445772 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445780 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445795 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445803 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445818 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445826 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445841 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445849 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445863 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445871 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445886 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445894 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445908 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445917 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445931 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445939 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445954 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445962 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445976 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.445984 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.445999 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446007 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446021 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446030 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446044 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446052 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446067 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446075 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446090 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446098 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446113 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446121 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446135 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446143 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446158 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446166 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask/app.py", line 1741, in handle_exception [Fri Aug 07 08:21:08.446181 2020] [:error] [pid 1420287] [remote x.x.x.x:144] reraise(exc_type, exc_value, tb) [Fri Aug 07 08:21:08.446190 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 266, in error_router [Fri Aug 07 08:21:08.446204 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return self.handle_error(e) [Fri Aug 07 08:21:08.446212 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask/app.py", line 2292, in wsgi_app [Fri Aug 07 08:21:08.446227 2020] [:error] [pid 1420287] [remote x.x.x.x:144] response = self.full_dispatch_request() [Fri Aug 07 08:21:08.446236 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask/app.py", line 1815, in full_dispatch_request [Fri Aug 07 08:21:08.446250 2020] [:error] [pid 1420287] [remote x.x.x.x:144] rv = self.handle_user_exception(e) [Fri Aug 07 08:21:08.446259 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446273 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446282 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446296 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446304 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446318 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446327 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446341 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446349 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446363 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446372 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446386 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446395 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446409 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446417 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446432 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446440 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446454 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446463 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446477 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446485 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446500 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446508 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446522 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446531 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446545 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446553 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446568 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446576 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446590 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446599 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446613 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446621 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446636 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446644 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446658 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446667 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446681 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446689 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446704 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446712 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446727 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446735 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446749 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446757 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446772 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446780 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446795 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446803 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446817 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446826 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446840 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446848 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446863 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446871 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446885 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446893 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446908 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446916 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router [Fri Aug 07 08:21:08.446930 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return original_handler(e) [Fri Aug 07 08:21:08.446938 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask/app.py", line 1718, in handle_user_exception [Fri Aug 07 08:21:08.446953 2020] [:error] [pid 1420287] [remote x.x.x.x:144] reraise(exc_type, exc_value, tb) [Fri Aug 07 08:21:08.446962 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 266, in error_router [Fri Aug 07 08:21:08.446976 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return self.handle_error(e) [Fri Aug 07 08:21:08.446984 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask/app.py", line 1813, in full_dispatch_request [Fri Aug 07 08:21:08.446999 2020] [:error] [pid 1420287] [remote x.x.x.x:144] rv = self.dispatch_request() [Fri Aug 07 08:21:08.447007 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask/app.py", line 1799, in dispatch_request [Fri Aug 07 08:21:08.447022 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return self.view_functions[rule.endpoint](**req.view_args) [Fri Aug 07 08:21:08.447031 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 458, in wrapper [Fri Aug 07 08:21:08.447046 2020] [:error] [pid 1420287] [remote x.x.x.x:144] resp = resource(*args, **kwargs) [Fri Aug 07 08:21:08.447055 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask/views.py", line 88, in view [Fri Aug 07 08:21:08.447119 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return self.dispatch_request(*args, **kwargs) [Fri Aug 07 08:21:08.447128 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 573, in dispatch_request [Fri Aug 07 08:21:08.447144 2020] [:error] [pid 1420287] [remote x.x.x.x:144] resp = meth(*args, **kwargs) [Fri Aug 07 08:21:08.447152 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/keystone/server/flask/common.py", line 1060, in wrapper [Fri Aug 07 08:21:08.447392 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return f(*args, **kwargs) [Fri Aug 07 08:21:08.447406 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/keystone/api/auth.py", line 312, in post [Fri Aug 07 08:21:08.447551 2020] [:error] [pid 1420287] [remote x.x.x.x:144] token = authentication.authenticate_for_token(auth_data) [Fri Aug 07 08:21:08.447561 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/keystone/api/_shared/authentication.py", line 229, in authenticate_for_token [Fri Aug 07 08:21:08.447652 2020] [:error] [pid 1420287] [remote x.x.x.x:144] app_cred_id=app_cred_id, parent_audit_id=token_audit_id) [Fri Aug 07 08:21:08.447662 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/keystone/common/manager.py", line 116, in wrapped [Fri Aug 07 08:21:08.447679 2020] [:error] [pid 1420287] [remote x.x.x.x:144] __ret_val = __f(*args, **kwargs) [Fri Aug 07 08:21:08.447687 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/keystone/token/provider.py", line 252, in issue_token [Fri Aug 07 08:21:08.447706 2020] [:error] [pid 1420287] [remote x.x.x.x:144] token.mint(token_id, issued_at) [Fri Aug 07 08:21:08.447714 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/keystone/models/token_model.py", line 563, in mint [Fri Aug 07 08:21:08.448498 2020] [:error] [pid 1420287] [remote x.x.x.x:144] self._validate_project_scope() [Fri Aug 07 08:21:08.448508 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/keystone/models/token_model.py", line 512, in _validate_project_scope [Fri Aug 07 08:21:08.448525 2020] [:error] [pid 1420287] [remote x.x.x.x:144] if self.project_scoped and not self.roles: [Fri Aug 07 08:21:08.448533 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/keystone/models/token_model.py", line 438, in roles [Fri Aug 07 08:21:08.448549 2020] [:error] [pid 1420287] [remote x.x.x.x:144] roles = self._get_project_roles() [Fri Aug 07 08:21:08.448557 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/keystone/models/token_model.py", line 400, in _get_project_roles [Fri Aug 07 08:21:08.448573 2020] [:error] [pid 1420287] [remote x.x.x.x:144] self.user_id, self.project_id [Fri Aug 07 08:21:08.448581 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/keystone/common/manager.py", line 116, in wrapped [Fri Aug 07 08:21:08.448597 2020] [:error] [pid 1420287] [remote x.x.x.x:144] __ret_val = __f(*args, **kwargs) [Fri Aug 07 08:21:08.448605 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/dogpile/cache/region.py", line 1220, in decorate [Fri Aug 07 08:21:08.449478 2020] [:error] [pid 1420287] [remote x.x.x.x:144] should_cache_fn) [Fri Aug 07 08:21:08.449488 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/dogpile/cache/region.py", line 825, in get_or_create [Fri Aug 07 08:21:08.449504 2020] [:error] [pid 1420287] [remote x.x.x.x:144] async_creator) as value: [Fri Aug 07 08:21:08.449512 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/dogpile/lock.py", line 154, in __enter__ [Fri Aug 07 08:21:08.449967 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return self._enter() [Fri Aug 07 08:21:08.449977 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/dogpile/lock.py", line 94, in _enter [Fri Aug 07 08:21:08.449995 2020] [:error] [pid 1420287] [remote x.x.x.x:144] generated = self._enter_create(createdtime) [Fri Aug 07 08:21:08.450004 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/dogpile/lock.py", line 145, in _enter_create [Fri Aug 07 08:21:08.450020 2020] [:error] [pid 1420287] [remote x.x.x.x:144] created = self.creator() [Fri Aug 07 08:21:08.450029 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/dogpile/cache/region.py", line 792, in gen_value [Fri Aug 07 08:21:08.450046 2020] [:error] [pid 1420287] [remote x.x.x.x:144] created_value = creator() [Fri Aug 07 08:21:08.450055 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/dogpile/cache/region.py", line 1216, in creator [Fri Aug 07 08:21:08.450071 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return fn(*arg, **kw) [Fri Aug 07 08:21:08.450080 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/keystone/assignment/core.py", line 128, in get_roles_for_user_and_project [Fri Aug 07 08:21:08.450975 2020] [:error] [pid 1420287] [remote x.x.x.x:144] user_id=user_id, project_id=project_id, effective=True) [Fri Aug 07 08:21:08.450985 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/keystone/common/manager.py", line 116, in wrapped [Fri Aug 07 08:21:08.451001 2020] [:error] [pid 1420287] [remote x.x.x.x:144] __ret_val = __f(*args, **kwargs) [Fri Aug 07 08:21:08.451009 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/keystone/assignment/core.py", line 999, in list_role_assignments [Fri Aug 07 08:21:08.451025 2020] [:error] [pid 1420287] [remote x.x.x.x:144] strip_domain_roles) [Fri Aug 07 08:21:08.451033 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/keystone/assignment/core.py", line 845, in _list_effective_role_assignments [Fri Aug 07 08:21:08.451049 2020] [:error] [pid 1420287] [remote x.x.x.x:144] domain_id=domain_id, inherited=inherited) [Fri Aug 07 08:21:08.451057 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/keystone/assignment/core.py", line 780, in list_role_assignments_for_actor [Fri Aug 07 08:21:08.451072 2020] [:error] [pid 1420287] [remote x.x.x.x:144] group_ids=group_ids, inherited_to_projects=False) [Fri Aug 07 08:21:08.451081 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib/python2.7/site-packages/keystone/assignment/backends/sql.py", line 248, in list_role_assignments [Fri Aug 07 08:21:08.451599 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return [denormalize_role(ref) for ref in query.all()] [Fri Aug 07 08:21:08.451609 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2925, in all [Fri Aug 07 08:21:08.451632 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return list(self) [Fri Aug 07 08:21:08.451641 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3081, in __iter__ [Fri Aug 07 08:21:08.451656 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return self._execute_and_instances(context) [Fri Aug 07 08:21:08.451665 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 3106, in _execute_and_instances [Fri Aug 07 08:21:08.451683 2020] [:error] [pid 1420287] [remote x.x.x.x:144] result = conn.execute(querycontext.statement, self._params) [Fri Aug 07 08:21:08.451691 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 980, in execute [Fri Aug 07 08:21:08.451711 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return meth(self, multiparams, params) [Fri Aug 07 08:21:08.451720 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 273, in _execute_on_connection [Fri Aug 07 08:21:08.451736 2020] [:error] [pid 1420287] [remote x.x.x.x:144] return connection._execute_clauseelement(self, multiparams, params) [Fri Aug 07 08:21:08.451745 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1099, in _execute_clauseelement [Fri Aug 07 08:21:08.451762 2020] [:error] [pid 1420287] [remote x.x.x.x:144] distilled_params, [Fri Aug 07 08:21:08.451771 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1240, in _execute_context [Fri Aug 07 08:21:08.451786 2020] [:error] [pid 1420287] [remote x.x.x.x:144] e, statement, parameters, cursor, context [Fri Aug 07 08:21:08.451795 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1456, in _handle_dbapi_exception [Fri Aug 07 08:21:08.451810 2020] [:error] [pid 1420287] [remote x.x.x.x:144] util.raise_from_cause(newraise, exc_info) [Fri Aug 07 08:21:08.451818 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 296, in raise_from_cause [Fri Aug 07 08:21:08.451834 2020] [:error] [pid 1420287] [remote x.x.x.x:144] reraise(type(exception), exception, tb=exc_tb, cause=cause) [Fri Aug 07 08:21:08.451843 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1236, in _execute_context [Fri Aug 07 08:21:08.451858 2020] [:error] [pid 1420287] [remote x.x.x.x:144] cursor, statement, parameters, context [Fri Aug 07 08:21:08.451866 2020] [:error] [pid 1420287] [remote x.x.x.x:144] File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 536, in do_execute [Fri Aug 07 08:21:08.451882 2020] [:error] [pid 1420287] [remote x.x.x.x:144] cursor.execute(statement, parameters) [Fri Aug 07 08:21:08.451923 2020] [:error] [pid 1420287] [remote x.x.x.x:144] DBNonExistentTable: (sqlite3.OperationalError) no such table: assignment [SQL: u'SELECT assignment.type AS assignment_type, assignment.actor_id AS assignment_actor_id, assignment.target_id AS assignment_target_id, assignment.role_id AS assignment_role_id, assignment.inherited AS assignment_inherited \\nFROM assignment \\nWHERE assignment.actor_id IN (?) AND assignment.target_id IN (?) AND assignment.type IN (?) AND assignment.inherited = 0'] [parameters: ('15c2fe91e053af57a997c568c117c908d59c138f996bdc19ae97e9f16df12345', '12345978536e45ab8a279e2b0fa4f947', 'UserProject')] (Background on this error at: http://sqlalche.me/e/e3q8) Regards, Divya