settingsLogin | Registersettings

[Openstack-operators] [cinder] Cant create Volume from Image, says checksums dont match

0 votes

HI guys;
This used to work. Trying to come up with an update / backup strategy
here. Successfully created an image from a volume (must do as admin it
seems, but that's not an issue.) The image runs just fine as an instance
(creates it's root drive on the controller/cumpute node).
But when I try to turn the image back into a volume I get this nonsense.....

Note the warnings in the beginning. Not sure what these mean.

Running Liberty.

Thanks yet again;
-Chris


2017-10-19 14:00:55.258 2787 INFO
cinder.volume.flows.manager.createvolume
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Volume
cfb61fc5-4900-4e39-bda7-66f0f1b46a69: being created as image with
specification: {'status': u'creating', 'image
location': (None, None),
'volumesize': 200, 'volumename':
u'volume-cfb61fc5-4900-4e39-bda7-66f0f1b46a69', 'imageid':
u'37a74759-f002-4fdd-9a83-4ce46ab6c867', 'image
service':
<cinder.image.glance.GlanceImageService object at 0x5851110>, 'imagemeta':
{'status': u'active', 'name': u'CentOS-KDE-Desktop2', 'deleted': False,
'container
format': u'bare', 'createdat': datetime.datetime(2017, 10, 19,
19, 34, 44, tzinfo=<iso8601.Utc>), 'disk
format': u'qcow2', 'updatedat':
datetime.datetime(2017, 10, 19, 20, 2, 45, tzinfo=<iso8601.Utc>), 'id':
u'37a74759-f002-4fdd-9a83-4ce46ab6c867', 'owner':
u'fdf3f98a9b0c4e9e94603d8a84ea41a8', 'min
ram': 0, 'checksum':
u'ac1f1ca3c04dd439291fd598d723adb5', 'mindisk': 0, 'ispublic': True,
'deleted_at': None, 'properties': {}, 'size': 12859670528}}

2017-10-19 14:00:55.259 2787 WARNING cinder.context
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Unable to get internal tenant
context: Missing required config parameters.

2017-10-19 14:00:55.259 2787 WARNING
cinder.volume.flows.manager.create_volume
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Unable to get Cinder internal
context, will not use image-volume cache.

2017-10-19 14:02:18.216 2787 WARNING cinder.volume.manager
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Task
'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create'
(fdcc9b52-493d-4fb5-929f-d1554672deb1) transitioned into state 'FAILURE'
from state 'RUNNING'

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager Traceback (most
recent call last):

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File
"/usr/lib/python2.7/site-packages/taskflow/engines/actionengine/executor.py",
line 82, in _execute
task

*2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager result =
task.execute(**arguments)*

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File
"/usr/lib/python2.7/site-packages/cinder/volume/flows/manager/create_volume.py",
line 834, in execute

*2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager
**volume_spec)*

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File
"/usr/lib/python2.7/site-packages/cinder/volume/flows/manager/createvolume.py",
line 737, in _create
from_image

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager
imageservice, context, imageid) as tmp_image:

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File
"/usr/lib64/python2.7/contextlib.py", line 17, in enter

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager return
self.gen.next()

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File
"/usr/lib/python2.7/site-packages/cinder/image/image_utils.py", line 540,
in fetch

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager
fetchverifyimage(context, imageservice, imageid, tmp)

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File
"/usr/lib/python2.7/site-packages/cinder/image/imageutils.py", line 204,
in fetch
verify_image

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager None, None)

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File
"/usr/lib/python2.7/site-packages/cinder/image/image_utils.py", line 182,
in fetch

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager
imageservice.download(context, imageid, image_file)

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File
"/usr/lib/python2.7/site-packages/cinder/image/glance.py", line 323, in
download

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager for chunk in
image_chunks:

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File
"/usr/lib/python2.7/site-packages/glanceclient/common/utils.py", line 477,
in iter

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager for chunk in
self.iterable:

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File
"/usr/lib/python2.7/site-packages/glanceclient/common/utils.py", line 434,
in integrity_iter

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager (md5sum,
checksum))

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager IOError: [Errno
32] Corrupt image download. Checksum was 73b9d335f52ed257acaf9ccefeb84825
expected ac1f1ca3c04dd439291fd598d723adb5

*2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager *

2017-10-19 14:02:18.220 2787 WARNING cinder.volume.manager
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Task
'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create'
(fdcc9b52-493d-4fb5-929f-d1554672deb1) transitioned into state 'REVERTED'
from state 'REVERTING'

2017-10-19 14:02:18.221 2787 WARNING cinder.volume.manager
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Task
'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create,
create.start' (fcfd3c55-998e-44d2-9f41-b6e0be9ffaa2) transitioned into
state 'REVERTED' from state 'REVERTING'

2017-10-19 14:02:18.223 2787 WARNING cinder.volume.manager
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Task
'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create'
(3fcabeb8-feba-42a9-af28-d20b07d4dfd9) transitioned into state 'REVERTED'
from state 'REVERTING'

2017-10-19 14:02:18.284 2787 INFO oslo.messaging.drivers.implrabbit [-]
A recoverable connection/channel error occurred, trying to reconnect:
[Errno 104] Connection reset by peer

2017-10-19 14:02:18.286 2787 ERROR oslo.messaging.drivers.implrabbit
[req-50c9b34a-0266-4e32-9557-2022d262ca33 - - - - -] AMQP server on
controller:5672 is unreachable: [Errno 32] Broken pipe. Trying again in 1
seconds.

2017-10-19 14:02:18.331 2787 WARNING cinder.volume.manager
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Task
'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create'
(d9c4b24e-1f12-446c-8a9e-b3880da813e6) transitioned into state 'REVERTED'
from state 'REVERTING'

2017-10-19 14:02:18.332 2787 WARNING cinder.volume.manager
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Task
'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create'
(1a35871d-ab69-4ad9-ab94-4acb230365d8) transitioned into state 'REVERTED'
from state 'REVERTING'

2017-10-19 14:02:18.334 2787 WARNING cinder.volume.manager
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Flow 'volumecreatemanager'
(7bc006fe-f48b-4e4e-b321-d26ab32de9ae) transitioned into state 'REVERTED'
from state 'RUNNING'

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Exception during message handling:
[Errno 32] Corrupt image download. Checksum was
73b9d335f52ed257acaf9ccefeb84825 expected ac1f1ca3c04dd439291fd598d723adb5

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher Traceback
(most recent call last):

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/oslo
messaging/rpc/dispatcher.py", line
142, in dispatchand_reply

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher
executor
callback))

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/oslo
messaging/rpc/dispatcher.py", line
186, in _dispatch

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher
executor
callback)

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/oslo
messaging/rpc/dispatcher.py", line
129, in dodispatch

*2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
result = func(ctxt, **new_args)*

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 105, in
wrapper

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
return f(
args, **kwargs)*

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 547, in
create
volume

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher
_run
flow()

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 534, in
_run
flow

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher
flow
engine.run()

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/taskflow/engines/action
engine/engine.py",
line 159, in run

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher for
_state in self.run
iter():

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/taskflow/engines/action
engine/engine.py",
line 223, in run_iter

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher
failure.Failure.reraise
if_any(it)

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 308, in
reraise
if_any

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
failures[0].reraise()

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 315, in
reraise

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
six.reraise(
self.excinfo)*

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/taskflow/engines/action
engine/executor.py",
line 82, in executetask

*2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
result = task.execute(**arguments)*

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/cinder/volume/flows/manager/create
volume.py",
line 834, in execute

*2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
**volume_spec)*

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/cinder/volume/flows/manager/create
volume.py",
line 737, in createfrom_image

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher
image
service, context, imageid) as tmpimage:

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher File
"/usr/lib64/python2.7/contextlib.py", line 17, in enter

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
return self.gen.next()

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/cinder/image/image
utils.py", line 540,
in fetch

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher
fetch
verifyimage(context, imageservice, image_id, tmp)

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/cinder/image/image
utils.py", line 204,
in fetchverifyimage

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher None,
None)

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/cinder/image/image
utils.py", line 182,
in fetch

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher
image
service.download(context, imageid, imagefile)

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/cinder/image/glance.py", line 323, in
download

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher for
chunk in image
chunks:

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/glanceclient/common/utils.py", line 477,
in iter

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher for
chunk in self.iterable:

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/glanceclient/common/utils.py", line 434,
in integrity
iter

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
(md5sum, checksum))

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher IOError:
[Errno 32] Corrupt image download. Checksum was
73b9d335f52ed257acaf9ccefeb84825 expected ac1f1ca3c04dd439291fd598d723adb5

*2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher *

2017-10-19 14:02:18.566 2787 INFO
cinder.volume.flows.manager.createvolume
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Volume
cfb61fc5-4900-4e39-bda7-66f0f1b46a69: being created as image with
specification: {'status': u'creating', 'image
location': (None, None),
'volumesize': 200, 'volumename':
u'volume-cfb61fc5-4900-4e39-bda7-66f0f1b46a69', 'imageid':
u'37a74759-f002-4fdd-9a83-4ce46ab6c867', 'image
service':
<cinder.image.glance.GlanceImageService object at 0x5cc8d90>, 'imagemeta':
{'status': u'active', 'name': u'CentOS-KDE-Desktop2', 'deleted': False,
'container
format': u'bare', 'createdat': datetime.datetime(2017, 10, 19,
19, 34, 44, tzinfo=<iso8601.Utc>), 'disk
format': u'qcow2', 'updatedat':
datetime.datetime(2017, 10, 19, 20, 2, 45, tzinfo=<iso8601.Utc>), 'id':
u'37a74759-f002-4fdd-9a83-4ce46ab6c867', 'owner':
u'fdf3f98a9b0c4e9e94603d8a84ea41a8', 'min
ram': 0, 'checksum':
u'ac1f1ca3c04dd439291fd598d723adb5', 'mindisk': 0, 'ispublic': True,
'deleted_at': None, 'properties': {}, 'size': 12859670528}}

2017-10-19 14:02:18.567 2787 WARNING cinder.context
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Unable to get internal tenant
context: Missing required config parameters.

2017-10-19 14:02:18.567 2787 WARNING
cinder.volume.flows.manager.create_volume
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Unable to get Cinder internal
context, will not use image-volume cache.

^C

*[root@maersk cinder]# *

asked Oct 20, 2017 in openstack-operators by Christopher_Hull (2,220 points)   2 5 7

3 Responses

0 votes

The qcow2 checksums are correct. They run via nova.

I seem to recall that the cinder checksum calculation when reading in an
image is faulty. I'm simply going to remove the offending code.
-Chris

  • Christopher T. Hull
    My contract at NASA has ended and I am seeking new opportunities.
    For updated resume and other info, please click this link.
    http://faq.chrishull.com
    Sunnyvale CA. 94085
    (415) 385 4865
    chrishull42@gmail.com
    http://chrishull.com

On Thu, Oct 19, 2017 at 2:07 PM, Christopher Hull chrishull42@gmail.com
wrote:

HI guys;
This used to work. Trying to come up with an update / backup strategy
here. Successfully created an image from a volume (must do as admin it
seems, but that's not an issue.) The image runs just fine as an instance
(creates it's root drive on the controller/cumpute node).
But when I try to turn the image back into a volume I get this
nonsense.....

Note the warnings in the beginning. Not sure what these mean.

Running Liberty.

Thanks yet again;
-Chris


2017-10-19 14:00:55.258 2787 INFO
cinder.volume.flows.manager.createvolume
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Volume
cfb61fc5-4900-4e39-bda7-66f0f1b46a69: being created as image with
specification: {'status': u'creating', 'image
location': (None, None),
'volumesize': 200, 'volumename':
u'volume-cfb61fc5-4900-4e39-bda7-66f0f1b46a69', 'imageid':
u'37a74759-f002-4fdd-9a83-4ce46ab6c867', 'image
service':
<cinder.image.glance.GlanceImageService object at 0x5851110>, 'imagemeta':
{'status': u'active', 'name': u'CentOS-KDE-Desktop2', 'deleted': False,
'container
format': u'bare', 'createdat': datetime.datetime(2017, 10, 19,
19, 34, 44, tzinfo=<iso8601.Utc>), 'disk
format': u'qcow2', 'updatedat':
datetime.datetime(2017, 10, 19, 20, 2, 45, tzinfo=<iso8601.Utc>), 'id':
u'37a74759-f002-4fdd-9a83-4ce46ab6c867', 'owner':
u'fdf3f98a9b0c4e9e94603d8a84ea41a8', 'min
ram': 0, 'checksum':
u'ac1f1ca3c04dd439291fd598d723adb5', 'mindisk': 0, 'ispublic': True,
'deleted_at': None, 'properties': {}, 'size': 12859670528}}

2017-10-19 14:00:55.259 2787 WARNING cinder.context
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Unable to get internal tenant
context: Missing required config parameters.

2017-10-19 14:00:55.259 2787 WARNING
cinder.volume.flows.manager.create_volume
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Unable to get Cinder internal
context, will not use image-volume cache.

2017-10-19 14:02:18.216 2787 WARNING cinder.volume.manager
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Task
'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create'
(fdcc9b52-493d-4fb5-929f-d1554672deb1) transitioned into state 'FAILURE'
from state 'RUNNING'

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager Traceback (most
recent call last):

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File
"/usr/lib/python2.7/site-packages/taskflow/engines/actionengine/executor.py",
line 82, in _execute
task

*2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager result =
task.execute(**arguments)*

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File
"/usr/lib/python2.7/site-packages/cinder/volume/flows/manager/create_volume.py",
line 834, in execute

*2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager
**volume_spec)*

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File
"/usr/lib/python2.7/site-packages/cinder/volume/flows/manager/createvolume.py",
line 737, in _create
from_image

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager
imageservice, context, imageid) as tmp_image:

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File
"/usr/lib64/python2.7/contextlib.py", line 17, in enter

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager return
self.gen.next()

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File
"/usr/lib/python2.7/site-packages/cinder/image/image_utils.py", line 540,
in fetch

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager
fetchverifyimage(context, imageservice, imageid, tmp)

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File
"/usr/lib/python2.7/site-packages/cinder/image/imageutils.py", line 204,
in fetch
verify_image

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager None, None)

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File
"/usr/lib/python2.7/site-packages/cinder/image/image_utils.py", line 182,
in fetch

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager
imageservice.download(context, imageid, image_file)

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File
"/usr/lib/python2.7/site-packages/cinder/image/glance.py", line 323, in
download

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager for chunk in
image_chunks:

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File
"/usr/lib/python2.7/site-packages/glanceclient/common/utils.py", line 477,
in iter

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager for chunk in
self.iterable:

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager File
"/usr/lib/python2.7/site-packages/glanceclient/common/utils.py", line 434,
in integrity_iter

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager (md5sum,
checksum))

2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager IOError: [Errno
32] Corrupt image download. Checksum was 73b9d335f52ed257acaf9ccefeb84825
expected ac1f1ca3c04dd439291fd598d723adb5

*2017-10-19 14:02:18.216 2787 ERROR cinder.volume.manager *

2017-10-19 14:02:18.220 2787 WARNING cinder.volume.manager
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Task
'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create'
(fdcc9b52-493d-4fb5-929f-d1554672deb1) transitioned into state 'REVERTED'
from state 'REVERTING'

2017-10-19 14:02:18.221 2787 WARNING cinder.volume.manager
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Task
'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create,
create.start' (fcfd3c55-998e-44d2-9f41-b6e0be9ffaa2) transitioned into
state 'REVERTED' from state 'REVERTING'

2017-10-19 14:02:18.223 2787 WARNING cinder.volume.manager
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Task
'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create'
(3fcabeb8-feba-42a9-af28-d20b07d4dfd9) transitioned into state 'REVERTED'
from state 'REVERTING'

2017-10-19 14:02:18.284 2787 INFO oslo.messaging.drivers.implrabbit [-]
A recoverable connection/channel error occurred, trying to reconnect:
[Errno 104] Connection reset by peer

2017-10-19 14:02:18.286 2787 ERROR oslo.messaging.drivers.implrabbit
[req-50c9b34a-0266-4e32-9557-2022d262ca33 - - - - -] AMQP server on
controller:5672 is unreachable: [Errno 32] Broken pipe. Trying again in 1
seconds.

2017-10-19 14:02:18.331 2787 WARNING cinder.volume.manager
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Task
'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create'
(d9c4b24e-1f12-446c-8a9e-b3880da813e6) transitioned into state 'REVERTED'
from state 'REVERTING'

2017-10-19 14:02:18.332 2787 WARNING cinder.volume.manager
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Task
'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create'
(1a35871d-ab69-4ad9-ab94-4acb230365d8) transitioned into state 'REVERTED'
from state 'REVERTING'

2017-10-19 14:02:18.334 2787 WARNING cinder.volume.manager
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Flow 'volumecreatemanager'
(7bc006fe-f48b-4e4e-b321-d26ab32de9ae) transitioned into state 'REVERTED'
from state 'RUNNING'

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Exception during message handling:
[Errno 32] Corrupt image download. Checksum was
73b9d335f52ed257acaf9ccefeb84825 expected ac1f1ca3c04dd439291fd598d723adb5

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
Traceback (most recent call last):

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/oslo
messaging/rpc/dispatcher.py", line
142, in dispatchand_reply

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher
executor
callback))

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/oslo
messaging/rpc/dispatcher.py", line
186, in _dispatch

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher
executor
callback)

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/oslo
messaging/rpc/dispatcher.py", line
129, in dodispatch

*2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
result = func(ctxt, **new_args)*

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 105, in
wrapper

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
return f(
args, **kwargs)*

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 547, in
create
volume

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher
_run
flow()

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 534, in
_run
flow

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher
flow
engine.run()

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/taskflow/engines/action
engine/engine.py",
line 159, in run

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher for
_state in self.run
iter():

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/taskflow/engines/action
engine/engine.py",
line 223, in run_iter

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher
failure.Failure.reraise
if_any(it)

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 308, in
reraise
if_any

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
failures[0].reraise()

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 315, in
reraise

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
six.reraise(
self.excinfo)*

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/taskflow/engines/action
engine/executor.py",
line 82, in executetask

*2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
result = task.execute(**arguments)*

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/cinder/volume/flows/manager/create
volume.py",
line 834, in execute

*2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
**volume_spec)*

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/cinder/volume/flows/manager/create
volume.py",
line 737, in createfrom_image

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher
image
service, context, imageid) as tmpimage:

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher File
"/usr/lib64/python2.7/contextlib.py", line 17, in enter

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
return self.gen.next()

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/cinder/image/image
utils.py", line 540,
in fetch

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher
fetch
verifyimage(context, imageservice, image_id, tmp)

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/cinder/image/image
utils.py", line 204,
in fetchverifyimage

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
None, None)

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/cinder/image/image
utils.py", line 182,
in fetch

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher
image
service.download(context, imageid, imagefile)

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/cinder/image/glance.py", line 323, in
download

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher for
chunk in image
chunks:

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/glanceclient/common/utils.py", line 477,
in iter

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher for
chunk in self.iterable:

2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/glanceclient/common/utils.py", line 434,
in integrity
iter

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
(md5sum, checksum))

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher IOError:
[Errno 32] Corrupt image download. Checksum was
73b9d335f52ed257acaf9ccefeb84825 expected ac1f1ca3c04dd439291fd598d723adb5

*2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher *

2017-10-19 14:02:18.566 2787 INFO
cinder.volume.flows.manager.createvolume
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Volume
cfb61fc5-4900-4e39-bda7-66f0f1b46a69: being created as image with
specification: {'status': u'creating', 'image
location': (None, None),
'volumesize': 200, 'volumename':
u'volume-cfb61fc5-4900-4e39-bda7-66f0f1b46a69', 'imageid':
u'37a74759-f002-4fdd-9a83-4ce46ab6c867', 'image
service':
<cinder.image.glance.GlanceImageService object at 0x5cc8d90>, 'imagemeta':
{'status': u'active', 'name': u'CentOS-KDE-Desktop2', 'deleted': False,
'container
format': u'bare', 'createdat': datetime.datetime(2017, 10, 19,
19, 34, 44, tzinfo=<iso8601.Utc>), 'disk
format': u'qcow2', 'updatedat':
datetime.datetime(2017, 10, 19, 20, 2, 45, tzinfo=<iso8601.Utc>), 'id':
u'37a74759-f002-4fdd-9a83-4ce46ab6c867', 'owner':
u'fdf3f98a9b0c4e9e94603d8a84ea41a8', 'min
ram': 0, 'checksum':
u'ac1f1ca3c04dd439291fd598d723adb5', 'mindisk': 0, 'ispublic': True,
'deleted_at': None, 'properties': {}, 'size': 12859670528}}

2017-10-19 14:02:18.567 2787 WARNING cinder.context
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Unable to get internal tenant
context: Missing required config parameters.

2017-10-19 14:02:18.567 2787 WARNING
cinder.volume.flows.manager.create_volume
[req-174e56ef-9f05-4f54-8e44-d48ee2eab3ac e8e70bfee9034cbe99d68ef5bbde540f
7813be77b1de4196b1c6b77006afa21c - - -] Unable to get Cinder internal
context, will not use image-volume cache.

^C

*[root@maersk cinder]# *

  • Christopher T. Hull
    My contract at NASA has ended and I am seeking new opportunities.
    For updated resume and other info, please click this link.
    http://faq.chrishull.com
    Sunnyvale CA. 94085
    (415) 385 4865 <(415)%20385-4865>
    chrishull42@gmail.com
    http://chrishull.com


OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
responded Oct 20, 2017 by Christopher_Hull (2,220 points)   2 5 7
0 votes

On Thu, Oct 19, 2017 at 06:55:38PM -0700, Christopher Hull wrote:
The qcow2 checksums are correct. They run via nova.

I seem to recall that the cinder checksum calculation when reading in an
image is faulty. I'm simply going to remove the offending code.
-Chris

I have not heard this before. If you remove that check and verify everything is
working without it, it would be useful to post those results here.

I didn't see an open bug for this. If you could file a bug and include any log
files and details, that would be appreciated:

https://bugs.launchpad.net/cinder

Sean


OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
responded Oct 20, 2017 by Sean_McGinnis (11,820 points)   2 2 5
0 votes

Hi Sean;
It works just fine without the check. This is a hack, not my preferred
solution. It would be nice if Cinder properly doublechecked the checksum.
But this does work nicely.

The symptom you will get from Horizon is an almost useless error message
telling you to come back later. Us Java folks believe in proper error
propagation. Guess PyDevs don't. heh. (I do Py too btw).

I am not running any particular distro. I installed Liberty myself and
developed a small tool to help with custom OPenstack installs. I would
like to place it in the Operators git. Had tried that before with
difficulty so I posted to Github. See
https://github.com/chrishull/github-openstack

Anyway, here's my fix with notes....

-Chris


2017-10-19 14:02:18.334 2787 ERROR oslomessaging.rpc.dispatcher File
"/usr/lib/python2.7/site-packages/glanceclient/common/utils.py", line 434,
in integrity
iter

2017-10-19 14:02:18.334 2787 ERROR oslo_messaging.rpc.dispatcher
(md5sum, checksum))

def integrity_iter(iter, checksum):
"""Check image data integrity.

:raises: IOError
"""
md5sum = hashlib.md5()
for chunk in iter:
    yield chunk
    if isinstance(chunk, six.string_types):
        chunk = six.b(chunk)
    md5sum.update(chunk)
md5sum = md5sum.hexdigest()
# if md5sum != checksum:   <--- line 434
#    raise IOError(errno.EPIPE,
#                  'Corrupt image download. Checksum was %s expected

%s' %
# (md5sum, checksum))
# Checksum is known to be good and working. glance to cinder seems to
have an issue
# Code commented out by chris hull on 19 Oct 2017 CTH

  • Christopher T. Hull
    My contract at NASA has ended and I am seeking new opportunities.
    For updated resume and other info, please click this link.
    http://faq.chrishull.com
    Sunnyvale CA. 94085
    (415) 385 4865
    chrishull42@gmail.com
    http://chrishull.com

On Fri, Oct 20, 2017 at 5:57 AM, Sean McGinnis sean.mcginnis@gmx.com
wrote:

On Thu, Oct 19, 2017 at 06:55:38PM -0700, Christopher Hull wrote:

The qcow2 checksums are correct. They run via nova.

I seem to recall that the cinder checksum calculation when reading in an
image is faulty. I'm simply going to remove the offending code.
-Chris

I have not heard this before. If you remove that check and verify
everything is
working without it, it would be useful to post those results here.

I didn't see an open bug for this. If you could file a bug and include any
log
files and details, that would be appreciated:

https://bugs.launchpad.net/cinder

Sean


OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
responded Oct 20, 2017 by Christopher_Hull (2,220 points)   2 5 7
...