[openstack-ko] [Cinder] 인스턴스 생성 시 volume 연결 문제

Minjun Hong nickeysgo at gmail.com
Wed Dec 19 14:26:53 UTC 2018


안녕하세요. Openstack을 학교 서버에 수동으로 설치 중인데, Cinder 관련 해서 문제가 발생해서 도움 요청 합니다.
Queens 버전 최소 설치 가이드 (
https://docs.openstack.org/cinder/queens/install/index-ubuntu.html)를 참고 해서
설치 중인데, 인스턴스를 생성 할 때, 해당 인스턴스가 사용할 volume을 storage server에서 못받아 오는 것 처럼
보입니다.
iSCSI를 위한 tgt 서비스를 보면, 뭔가 커널 모듈이 추가적으로 로드 되어야 하는거 같은데, 이게 스토리지 서버에 있는 RAID
controller 와 관련이 있을까요?
아래는 tgt 서비스의 상태입니다.

● tgt.service - (i)SCSI target daemon
>    Loaded: loaded (/lib/systemd/system/tgt.service; enabled; vendor
> preset: enabled)
>    Active: active (running) since Wed 2018-12-19 22:05:55 KST; 26min ago
>      Docs: man:tgtd(8)
>   Process: 2249 ExecStartPost=/usr/sbin/tgtadm --op update --mode sys
> --name State -v ready (code=exited, status=0/SUCCESS)
>   Process: 2230 ExecStartPost=/usr/sbin/tgt-admin -e -c
> /etc/tgt/targets.conf (code=exited, status=0/SUCCESS)
>   Process: 2206 ExecStartPost=/usr/sbin/tgtadm --op update --mode sys
> --name State -v offline (code=exited, status=0/SUCCESS)
>  Main PID: 2170 (tgtd)
>    Status: "Starting event loop..."
>     Tasks: 1
>    Memory: 2.7M
>       CPU: 87ms
>    CGroup: /system.slice/tgt.service
>            └─2170 /usr/sbin/tgtd -f
> Dec 19 22:05:55 node0 systemd[1]: Starting (i)SCSI target daemon...
> Dec 19 22:05:55 node0 tgtd[2170]: tgtd: iser_ib_init(3434) Failed to
> initialize RDMA; load kernel modules?
> Dec 19 22:05:55 node0 tgtd[2170]: tgtd: work_timer_start(150) use signal
> based scheduler
> Dec 19 22:05:55 node0 tgtd[2170]: tgtd: bs_init(387) use signalfd
> notification
> Dec 19 22:05:55 node0 systemd[1]: Started (i)SCSI target daemon.


그리고 아래는 cinder 서비스의 상태 입니다.

● cinder-volume.service - OpenStack Cinder Volume
>    Loaded: loaded (/lib/systemd/system/cinder-volume.service; enabled;
> vendor preset: enabled)
>    Active: active (running) since Wed 2018-12-19 22:05:55 KST; 45min ago
>  Main PID: 2110 (cinder-volume)
>     Tasks: 2
>    Memory: 210.2M
>       CPU: 1min 23.649s
>    CGroup: /system.slice/cinder-volume.service
>            ├─2110 /usr/bin/python2 /usr/bin/cinder-volume
> --config-file=/etc/cinder/cinder.conf
> --log-file=/var/log/cinder/cinder-volume.log
>            └─2657 /usr/bin/python2 /usr/bin/cinder-volume
> --config-file=/etc/cinder/cinder.conf
> --log-file=/var/log/cinder/cinder-volume.log
> Dec 19 22:05:55 node0 systemd[1]: Started OpenStack Cinder Volume.
> Dec 19 22:06:00 node0 sudo[2658]: pam_unix(sudo:auth): auth could not
> identify password for [cinder]


Cinder-volume의 로그는 계속해서 cinder-volume 서비스가 통신을 못하고 있는 것 처럼 보이는데, 아래와 같이
volume에 접근 하려고 할 때 (e.g. instance 생성), 에러 메시지가 출력 되고, 그 이후에는 계속해서 동일한 메시지가
매초 반복되고 있습니다.

2018-12-19 22:04:00.747 35996 INFO oslo_service.service
> [req-bcc39e60-531e-4484-ab4b-bab085d112c4 - - - - -] Caught SIGTERM,
> stopping children
> 2018-12-19 22:04:00.784 35996 INFO oslo_service.service
> [req-bcc39e60-531e-4484-ab4b-bab085d112c4 - - - - -] Waiting on 1 children
> to exit
> 2018-12-19 22:04:00.809 35996 INFO oslo_service.service
> [req-bcc39e60-531e-4484-ab4b-bab085d112c4 - - - - -] Child 36039 killed by
> signal 15
> 2018-12-19 22:05:58.378 2110 INFO root [-] Generating grammar tables from
> /usr/lib/python2.7/lib2to3/Grammar.txt
> 2018-12-19 22:05:58.403 2110 INFO root [-] Generating grammar tables from
> /usr/lib/python2.7/lib2to3/PatternGrammar.txt
> 2018-12-19 22:05:59.820 2110 INFO cinder.rpc
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Automatically selected
> cinder-scheduler objects version 1.35 as minimum service version.
> 2018-12-19 22:05:59.826 2110 INFO cinder.rpc
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Automatically selected
> cinder-scheduler RPC version 3.10 as minimum service version.
> 2018-12-19 22:05:59.875 2110 INFO cinder.volume.manager
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Determined volume DB
> was empty at startup.
> 2018-12-19 22:05:59.908 2110 WARNING oslo_config.cfg
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Option "iscsi_helper"
> from group "lvm" is deprecated. Use option "target_helper" from group "lvm".
> 2018-12-19 22:05:59.914 2110 WARNING oslo_config.cfg
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Option
> "iscsi_protocol" from group "lvm" is deprecated. Use option
> "target_protocol" from group "lvm".
> 2018-12-19 22:05:59.916 2110 INFO cinder.volume.manager
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Image-volume cache
> disabled for host node0 at lvm.
> 2018-12-19 22:05:59.932 2110 INFO oslo_service.service
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Starting 1 workers
> 2018-12-19 22:05:59.940 2657 INFO cinder.service
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Starting cinder-volume
> node (version 13.0.0)
> 2018-12-19 22:05:59.942 2110 WARNING oslo_config.cfg
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Option "iscsi_helper"
> from group "DEFAULT" is deprecated. Use option "target_helper" from group
> "DEFAULT".
> 2018-12-19 22:05:59.952 2110 WARNING oslo_config.cfg
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Option "auth_uri" from
> group "keystone_authtoken" is deprecated for removal (The auth_uri option
> is deprecated in favor of www_authenticate_uri and will be removed in the
> S  release.).  Its value may be silently ignored in the future.
> 2018-12-19 22:05:59.953 2110 WARNING oslo_config.cfg
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Option "auth_uri" from
> group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri"
> from group "keystone_authtoken".
> 2018-12-19 22:05:59.961 2657 INFO cinder.volume.manager
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Starting volume driver
> LVMVolumeDriver (3.0.0)
> 2018-12-19 22:06:00.007 2657 ERROR cinder.volume.manager
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Failed to initialize
> driver.: ProcessExecutionError: Unexpected error while running command.
> Command: sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs
> --version
> Exit code: 1
> Stdout: u''
> Stderr: u'sudo: no tty present and no askpass program specified\n'
> 2018-12-19 22:06:00.007 2657 ERROR cinder.volume.manager Traceback (most
> recent call last):
> 2018-12-19 22:06:00.007 2657 ERROR cinder.volume.manager   File
> "/opt/stack/cinder/cinder/volume/manager.py", line 433, in init_host
> 2018-12-19 22:06:00.007 2657 ERROR cinder.volume.manager
>  self.driver.check_for_setup_error()
> 2018-12-19 22:06:00.007 2657 ERROR cinder.volume.manager   File
> "/opt/stack/cinder/cinder/volume/drivers/lvm.py", line 286, in
> check_for_setup_error
> 2018-12-19 22:06:00.007 2657 ERROR cinder.volume.manager     if
> volutils.supports_thin_provisioning():
> 2018-12-19 22:06:00.007 2657 ERROR cinder.volume.manager   File
> "/opt/stack/cinder/cinder/volume/utils.py", line 628, in
> supports_thin_provisioning
> 2018-12-19 22:06:00.007 2657 ERROR cinder.volume.manager
>  utils.get_root_helper())
> 2018-12-19 22:06:00.007 2657 ERROR cinder.volume.manager   File
> "/opt/stack/cinder/cinder/brick/local_dev/lvm.py", line 225, in
> supports_thin_provisioning
> 2018-12-19 22:06:00.007 2657 ERROR cinder.volume.manager     return
> LVM.get_lvm_version(root_helper) >= (2, 2, 95)
> 2018-12-19 22:06:00.007 2657 ERROR cinder.volume.manager   File
> "/opt/stack/cinder/cinder/brick/local_dev/lvm.py", line 202, in
> get_lvm_version
> 2018-12-19 22:06:00.007 2657 ERROR cinder.volume.manager
>  run_as_root=True)
> 2018-12-19 22:06:00.007 2657 ERROR cinder.volume.manager   File
> "/usr/local/lib/python2.7/dist-packages/oslo_concurrency/processutils.py",
> line 424, in execute
> 2018-12-19 22:06:00.007 2657 ERROR cinder.volume.manager
>  cmd=sanitized_cmd)
> 2018-12-19 22:06:00.007 2657 ERROR cinder.volume.manager
> ProcessExecutionError: Unexpected error while running command.
> 2018-12-19 22:06:00.007 2657 ERROR cinder.volume.manager Command: sudo
> cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --version
> 2018-12-19 22:06:00.007 2657 ERROR cinder.volume.manager Exit code: 1
> 2018-12-19 22:06:00.007 2657 ERROR cinder.volume.manager Stdout: u''
> 2018-12-19 22:06:00.007 2657 ERROR cinder.volume.manager Stderr: u'sudo:
> no tty present and no askpass program specified\n'
> 2018-12-19 22:06:00.007 2657 ERROR cinder.volume.manager
> 2018-12-19 22:06:00.075 2657 INFO cinder.volume.manager
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Initializing RPC
> dependent components of volume driver LVMVolumeDriver (3.0.0)
> 2018-12-19 22:06:00.076 2657 ERROR cinder.utils
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Volume driver
> LVMVolumeDriver not initialized
> 2018-12-19 22:06:00.076 2657 ERROR cinder.volume.manager
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Cannot complete RPC
> initialization because driver isn't initialized properly.:
> DriverNotInitialized: Volume driver not ready.
> 2018-12-19 22:06:10.077 2657 ERROR cinder.service
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Manager for service
> cinder-volume node0 at lvm is reporting problems, not sending heartbeat.
> Service will appear "down".
> 2018-12-19 22:06:20.077 2657 ERROR cinder.service
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Manager for service
> cinder-volume node0 at lvm is reporting problems, not sending heartbeat.
> Service will appear "down".
> 2018-12-19 22:06:30.078 2657 ERROR cinder.service
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Manager for service
> cinder-volume node0 at lvm is reporting problems, not sending heartbeat.
> Service will appear "down".
> 2018-12-19 22:06:40.078 2657 ERROR cinder.service
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Manager for service
> cinder-volume node0 at lvm is reporting problems, not sending heartbeat.
> Service will appear "down".
> 2018-12-19 22:06:50.079 2657 ERROR cinder.service
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Manager for service
> cinder-volume node0 at lvm is reporting problems, not sending heartbeat.
> Service will appear "down".
> 2018-12-19 22:07:00.079 2657 ERROR cinder.service
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Manager for service
> cinder-volume node0 at lvm is reporting problems, not sending heartbeat.
> Service will appear "down".
> 2018-12-19 22:07:10.078 2657 WARNING cinder.volume.manager
> [req-b3178448-4e17-489b-8267-2fd7992bc876 - - - - -] Update driver status
> failed: (config name lvm) is uninitialized.


위의 로그에서 'Manage for service cinder -volume node0 at lvm is ...' 이 부분이 계속 반복 되는
부분 입니다.
혹시, 이에 대해서 경험 해 보신 분 있으시면, 조언 부탁 드립니다.

감사합니다.
-------------- next part --------------
HTML 첨부를 없애버렸습니다...
URL: <http://lists.openstack.org/pipermail/openstack-ko/attachments/20181219/71cd537f/attachment-0001.html>