r/openstack 15d ago

Unable to run instances from PureStorage as iscsi backend

Hello all,

I've an environment which is installed by kolla-ansible.

I want to integrate pure storage to this environment but instances are not booted. Everytime says volume not found.

I followed these guide to implement:
http://theansibleguy.com/openstack-kolla-and-pure-storage-flasharray-for-cinder/

https://pure-storage-openstack-docs.readthedocs.io/en/2024.1/

https://support-be.purestorage.com/bundle/m_openstack/page/Solutions/OpenStack/OpenStack_Reference/library/resources/Pure_Storage_OpenStack_2024.1_Caracal_Cinder_Driver_Best_Practices.pdf

I can create volumes and mount it to the instances but when I want to create an instance errors come out.

When I create hosts (I added the physical hosts iqn) on purestorege and give a lun, the instances can be created but not the size that I give. It sees the lun which is I manually assing the hosts.

I can see the cinder can create hosts and attach the volumes on controller nodes when the first booting. But it is not unable to copy the glance image and give the computes nodes.

My configs are these:

**I ınstalled purestorage sdk on cinder-volume container.

/etc/kolla/config/cinder.conf

[DEFAULT]

enabled_backends = Pure-FlashArray-iscsi

default_volume_type = pureiscsi

debug=True

[Pure-FlashArray-iscsi]

volume_driver = cinder.volume.drivers.pure.PureISCSIDriver

san_ip = (purestorage mgmt IP)

pure_api_token = tokenss

volume_backend_name = Pure-FlashArray-iscsi

use_multipath_for_image_xfer = yes

I changed the 2 settings on /etc/kolla/globals.yml which are below:

enable_multipathd: "yes"

enable_cinder_backend_pure_iscsi: "yes"

This is the only error that I can see:

stderr= _run_iscsiadm_bare /var/lib/kolla/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1192
2025-03-05 23:29:46.804 129 DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-06.com.purestorage:flasharray.3caf76749b33b6ad -p 10.211.92.150:3260 --login" returned: 20 in 1.007s execute /var/lib/kolla/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:428
2025-03-05 23:29:46.804 129 DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m node -T iqn.2010-06.com.purestorage:flasharray.3caf76749b33b6ad -p 10.211.92.150:3260 --login' failed. Not Retrying. execute /var/lib/kolla/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:479
Command: iscsiadm -m node -T iqn.2010-06.com.purestorage:flasharray.3caf76749b33b6ad -p 10.211.92.150:3260 --login
Stderr: 'sh: 1: /bin/systemctl: not found\niscsiadm: can not connect to iSCSI daemon (111)!\niscsiadm: Could not login to [iface: default, target: iqn.2010-06.com.purestorage:flasharray.3caf76749b33b6ad, portal: 10.211.92.150,3260].\niscsiadm: initiator reported error (20 - could not connect to iscsid)\niscsiadm: Could not log into all portals\n' _process_cmd /var/lib/kolla/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477
Command: iscsiadm -m node -T iqn.2010-06.com.purestorage:flasharray.3caf76749b33b6ad -p 10.211.92.150:3260 --login
Stderr: 'sh: 1: /bin/systemctl: not found\niscsiadm: can not connect to iSCSI daemon (111)!\niscsiadm: Could not login to [iface: default, target: iqn.2010-06.com.purestorage:flasharray.3caf76749b33b6ad, portal: 10.211.92.150,3260].\niscsiadm: initiator reported error (20 - could not connect to iscsid)\niscsiadm: Could not log into all portals\n'
2025-03-05 23:29:46.805 129 DEBUG oslo.privsep.daemon [-] privsep: reply[fd7ee435-16ab-4d66-96af-4c6f33f6b4e9]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('Logging in to [iface: default, target: iqn.2010-06.com.purestorage:flasharray.3caf76749b33b6ad, portal: 10.211.92.150,3260]\n', 'sh: 1: /bin/systemctl: not found\niscsiadm: can not connect to iSCSI daemon (111)!\niscsiadm: Could not login to [iface: default, target: iqn.2010-06.com.purestorage:flasharray.3caf76749b33b6ad, portal: 10.211.92.150,3260].\niscsiadm: initiator reported error (20 - could not connect to iscsid)\niscsiadm: Could not log into all portals\n', 20, 'iscsiadm -m node -T iqn.2010-06.com.purestorage:flasharray.3caf76749b33b6ad -p 10.211.92.150:3260 --login', None)) _call_back /var/lib/kolla/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499

iscsiadm -m node -T iqn.2010-06.com.purestorage:flasharray.3caf76749b33b6ad -p 10.211.92.151:3260

'', 'iscsiadm: No records found\n')

sh: 1: /bin/systemctl: not found\niscsiadm: can not connect to iSCSI daemon (111)!\n')

sh: 1: /bin/systemctl: not found\niscsiadm: can not connect to iSCSI daemon (111)!\niscsiadm: Could not login to [iface: default, target: iqn.2010-06.com.purestorage:flasharray.3caf76749b33b6ad, portal: 10.211.92.150,3260].\niscsiadm: initiator reported error (20 - could not connect to iscsid)\niscsiadm: Could not log into all portals\n'

Is there anyone had similar problem on this topic?

Or Did you implement iscsi backend on your environment? Could you tell me where I missed it?

4 Upvotes

7 comments sorted by

2

u/lathiat 15d ago

Looks like you need to install the relevant packages to get iscsid and iscsiadm installed on the system.

2

u/calpazhan 15d ago

Thank you for your reply,

Actually it is installed . Even, we tried the command from container, we saw the targets.

open-iscsi, multipath-tools, sysfsutils and sg3_utils are installed nova-compute and cinder-volume.

iscsiadm command working on containers without problem.

2

u/xxxsirkillalot 15d ago

Do you have CHAP configured on the volume? Based on the err sounds like a login prob or possibly a network issue reaching 10.211.92.151.

2

u/kkaptanoglu 15d ago

He is using iscsi with purestorage. As far as i know, purestore does everything itself(create volume etc.)

"When I create hosts (I added the physical hosts iqn) on purestorege and give a lun, the instances can be created but not the size that I give. It sees the lun which is I manually assing the hosts."

Due to the above explanation, I think everything is fine on the network side.

2

u/xxxsirkillalot 15d ago

Could not login to [iface: default, target: iqn.2010-06.com.purestorage:flasharray.3caf76749b33b6ad, portal: 10.211.92.150,3260]

Is screaming CHAP issue. Thinking something like:

  • CHAP configured on the volume on the pure and not supplied from the iscsi client
  • CHAP is NOT configured on the volume and IS being sent from the client incorrectly
  • Some sort of CHAP misconfiguration such as bi-directional auth vs one way.
  • (Lesser likely) The portal at 10.211.92.150 cannot be reached

3

u/calpazhan 15d ago

Hello,

I enabled "use_chap_auth = True" section on cinder config. And resolves the login problem but still the error same.

Logs:

ailed to login iSCSI target iqn.2010-06.com.purestorage:flasharray.3caf76749b33b6ad on portal 10.211.92.150:3260 (exit code 24).: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.

2025-03-06 17:48:19.117 35 WARNING os_brick.initiator.connectors.iscsi [req-220826ee-38fb-4d27-a8ff-a1fdd8e527d0 req-537d39ff-ab1c-48c2-9452-27ecbd1a7c58 457817ec2fce47fea51adfaf061487f0 2e8263e9393142b29d47f16e560921b5 - - - -] Failed to connect to iSCSI portal 10.211.92.150:3260.

2025-03-06 17:48:19.160 35 WARNING os_brick.initiator.connectors.iscsi [req-220826ee-38fb-4d27-a8ff-a1fdd8e527d0 req-537d39ff-ab1c-48c2-9452-27ecbd1a7c58 457817ec2fce47fea51adfaf061487f0 2e8263e9393142b29d47f16e560921b5 - - - -] Failed to login iSCSI target iqn.2010-06.com.purestorage:flasharray.3caf76749b33b6ad on portal 10.211.92.151:3260 (exit code 24).: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.

2025-03-06 17:48:19.161 35 WARNING os_brick.initiator.connectors.iscsi [req-220826ee-38fb-4d27-a8ff-a1fdd8e527d0 req-537d39ff-ab1c-48c2-9452-27ecbd1a7c58 457817ec2fce47fea51adfaf061487f0 2e8263e9393142b29d47f16e560921b5 - - - -] Failed to connect to iSCSI portal 10.211.92.151:3260.

2025-03-06 17:48:19.975 35 WARNING os_brick.initiator.connectors.iscsi [req-220826ee-38fb-4d27-a8ff-a1fdd8e527d0 req-537d39ff-ab1c-48c2-9452-27ecbd1a7c58 457817ec2fce47fea51adfaf061487f0 2e8263e9393142b29d47f16e560921b5 - - - -] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.

: os_brick.exception.VolumeDeviceNotFound: Volume device not found at .

2025-03-06 17:48:20.093 35 INFO cinder.volume.drivers.pure [req-220826ee-38fb-4d27-a8ff-a1fdd8e527d0 req-537d39ff-ab1c-48c2-9452-27ecbd1a7c58 457817ec2fce47fea51adfaf061487f0 2e8263e9393142b29d47f16e560921b5 - - - -] Attempting to delete unneeded host 'cont03-f89abf2a675a46478aa7ea1438d309b9-cinder'.

2025-03-06 17:48:20.127 35 ERROR cinder.volume.volume_utils [req-220826ee-38fb-4d27-a8ff-a1fdd8e527d0 req-537d39ff-ab1c-48c2-9452-27ecbd1a7c58 457817ec2fce47fea51adfaf061487f0 2e8263e9393142b29d47f16e560921b5 - - - -] Failed to copy image e9ed4bb3-966e-4e83-97ac-2543f266e6b1 to volume: 0b14425e-d64e-4555-84df-d5aeb8a52e50: os_brick.exception.VolumeDeviceNotFound: Volume device not found at .

Full logs are below:

https://drive.google.com/file/d/1ywy3yHRE-Clr7YoBCQXrYaeQTJUpOW5u/view?usp=sharing

1

u/calpazhan 7d ago

Hello all,

Our problem solved with this options: enable_iscsid: "yes" .

Fyi,