settingsLogin | Registersettings

[openstack-dev] [nova] boot images in power state PAUSED for stable/juno

0 votes

Not sure if I?m going crazy or what. I?m using DevStack and, after stacking I tried booting a Cirros 3.2, 3.3, and Ubuntu cloud 14.04 image. Each time, the image ends up in PAUSED power state:

ubuntu at juno:/opt/stack/neutron$ nova show peter
+--------------------------------------+----------------------------------------------------------------+
| Property | Value |
+--------------------------------------+----------------------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availabilityzone | nova |
| OS-EXT-SRV-ATTR:host | juno |
| OS-EXT-SRV-ATTR:hypervisor
hostname | juno |
| OS-EXT-SRV-ATTR:instancename | instance-00000001 |
| OS-EXT-STS:power
state | 3 |
| OS-EXT-STS:taskstate | - |
| OS-EXT-STS:vm
state | active |
| OS-SRV-USG:launchedat | 2014-12-31T15:15:33.000000 |
| OS-SRV-USG:terminated
at | - |
| accessIPv4 | |
| accessIPv6 | |
| configdrive | |
| created | 2014-12-31T15:15:24Z |
| flavor | m1.tiny (1) |
| hostId | 5b0c48250ccc0ac3fca8a821e29e4b154ec0b101f9cc0a0b27071a3f |
| id | ec5c8d70-ae80-4cc3-a5bb-b68019170dd6 |
| image | cirros-0.3.3-x86
64-uec (797e4dee-8c03-497f-8dac-a44b9351dfa3) |
| keyname | - |
| metadata | {} |
| name | peter |
| os-extended-volumes:volumes
attached | [] |
| private network | 10.0.0.4 |
| progress | 0 |
| securitygroups | default |
| status | ACTIVE |
| tenant
id | 7afb5bc1d88d462c8d57178437d3c277 |
| updated | 2014-12-31T15:15:34Z |
| user_id | 4ff18bdbeb4d436ea4ff1bcd29e269a9 |
+--------------------------------------+----------------------------------------------------------------+
ubuntu at juno:/opt/stack/neutron$ nova list
+--------------------------------------+-------+--------+------------+-------------+------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+-------+--------+------------+-------------+------------------+
| ec5c8d70-ae80-4cc3-a5bb-b68019170dd6 | peter | ACTIVE | - | Paused | private=10.0.0.4 |

I don?t see this with Kilo latest images. Any idea what I may be doing wrong, or if there is an issue (I didn?t see anything on Google search)?

IMAGEID=nova image-list | grep 'cloudimg-amd64 ' | cut -d' ' -f 2
PRIVATE
NET=neutron net-list | grep 'private ' | cut -f 2 -d' ?

nova boot peter --flavor 3 --image $IMAGEID --user-data ~/devstack/userdata.txt --nic net-id=$PRIVATENET
nova boot --flavor 1 --image cirros-0.3.3-x86
64-uec --nic net-id=$PRIVATE_NET paul

Thanks.

PCM (Paul Michali)

MAIL ?..?. pcm at cisco.com
IRC ??..? pc_m (irc.freenode.com)
TW ???... @pmichali
GPG Key ? 4525ECC253E31A83
Fingerprint .. 307A 96BB 1A4C D2C7 931D 8D2D 4525 ECC2 53E3 1A83

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.openstack.org/pipermail/openstack-dev/attachments/20141231/24ee8150/attachment.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 842 bytes
Desc: Message signed with OpenPGP using GPGMail
URL: http://lists.openstack.org/pipermail/openstack-dev/attachments/20141231/24ee8150/attachment.pgp

asked Dec 31, 2014 in openstack-dev by Paul_Michali_(pcm (3,280 points)   1 4 6
retagged Feb 25, 2015 by admin

9 Responses

0 votes

Any exceptions on the Neutron side? It might not be notifying nova
that the network is ready.

On Wed, Dec 31, 2014 at 8:41 AM, Paul Michali (pcm) wrote:
Not sure if I?m going crazy or what. I?m using DevStack and, after stacking
I tried booting a Cirros 3.2, 3.3, and Ubuntu cloud 14.04 image. Each time,
the image ends up in PAUSED power state:

ubuntu at juno:/opt/stack/neutron$ nova show peter
+--------------------------------------+----------------------------------------------------------------+
| Property | Value
|
+--------------------------------------+----------------------------------------------------------------+
| OS-DCF:diskConfig | MANUAL
|
| OS-EXT-AZ:availabilityzone | nova
|
| OS-EXT-SRV-ATTR:host | juno
|
| OS-EXT-SRV-ATTR:hypervisor
hostname | juno
|
| OS-EXT-SRV-ATTR:instancename | instance-00000001
|
| OS-EXT-STS:power
state | 3
|
| OS-EXT-STS:taskstate | -
|
| OS-EXT-STS:vm
state | active
|
| OS-SRV-USG:launchedat | 2014-12-31T15:15:33.000000
|
| OS-SRV-USG:terminated
at | -
|
| accessIPv4 |
|
| accessIPv6 |
|
| configdrive |
|
| created | 2014-12-31T15:15:24Z
|
| flavor | m1.tiny (1)
|
| hostId |
5b0c48250ccc0ac3fca8a821e29e4b154ec0b101f9cc0a0b27071a3f |
| id |
ec5c8d70-ae80-4cc3-a5bb-b68019170dd6 |
| image | cirros-0.3.3-x86
64-uec
(797e4dee-8c03-497f-8dac-a44b9351dfa3) |
| keyname | -
|
| metadata | {}
|
| name | peter
|
| os-extended-volumes:volumes
attached | []
|
| private network | 10.0.0.4
|
| progress | 0
|
| securitygroups | default
|
| status | ACTIVE
|
| tenant
id | 7afb5bc1d88d462c8d57178437d3c277
|
| updated | 2014-12-31T15:15:34Z
|
| user_id | 4ff18bdbeb4d436ea4ff1bcd29e269a9
|
+--------------------------------------+----------------------------------------------------------------+
ubuntu at juno:/opt/stack/neutron$ nova list
+--------------------------------------+-------+--------+------------+-------------+------------------+
| ID | Name | Status | Task State | Power
State | Networks |
+--------------------------------------+-------+--------+------------+-------------+------------------+
| ec5c8d70-ae80-4cc3-a5bb-b68019170dd6 | peter | ACTIVE | - |
Paused | private=10.0.0.4 |

I don?t see this with Kilo latest images. Any idea what I may be doing
wrong, or if there is an issue (I didn?t see anything on Google search)?

IMAGEID=nova image-list | grep 'cloudimg-amd64 ' | cut -d' ' -f 2
PRIVATE
NET=neutron net-list | grep 'private ' | cut -f 2 -d' ?

nova boot peter --flavor 3 --image $IMAGEID --user-data
~/devstack/user
data.txt --nic net-id=$PRIVATENET
nova boot --flavor 1 --image cirros-0.3.3-x86
64-uec --nic
net-id=$PRIVATE_NET paul

Thanks.

PCM (Paul Michali)

MAIL ?..?. pcm at cisco.com
IRC ??..? pc_m (irc.freenode.com)
TW ???... @pmichali
GPG Key ? 4525ECC253E31A83
Fingerprint .. 307A 96BB 1A4C D2C7 931D 8D2D 4525 ECC2 53E3 1A83


OpenStack-dev mailing list
OpenStack-dev at lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

--
Kevin Benton

responded Jan 1, 2015 by Kevin_Benton (24,800 points)   3 5 6
retagged Jan 28, 2015 by admin
0 votes

Hi Kevin,

No exceptions/tracebacks/errors in Neutron at all. In the Nova logs, it seems to create the instance, pause, and then resume, but it looks like maybe it is not resuming?

2015-01-01 14:44:30.716 3516 DEBUG nova.openstack.common.processutils [-] Running cmd (subprocess): sudo nova-rootwrap /etc/nova/rootwrap.conf ovs-vsctl --timeout=120 -- --if-exists del-port qvoded0d35f-20 -- add-port br-int qvoded0d35\
f-20 -- set Interface qvoded0d35f-20 external-ids:iface-id=ded0d35f-204f-4ca8-a85b-85decb53d9fe external-ids:iface-status=active external-ids:attached-mac=fa:16:3e:81:ab:12 external-ids:vm-uuid=c32ac737-1788-4420-b200-2a107d5ad335 exec\
ute /opt/stack/nova/nova/openstack/common/processutils.py:161
2015-01-01 14:44:30.786 3516 DEBUG nova.openstack.common.processutils [-] Result was 0 execute /opt/stack/nova/nova/openstack/common/processutils.py:195
2015-01-01 14:44:31.542 3516 DEBUG nova.virt.driver [-] Emitting event Started> emitevent /opt/stack/nova/nova/virt/driver.py:1298
2015-01-01 14:44:31.543 3516 INFO nova.compute.manager [-] [instance: c32ac737-1788-4420-b200-2a107d5ad335] VM Started (Lifecycle Event)
2015-01-01 14:44:31.584 DEBUG nova.compute.manager [req-77c13ae6-ccf9-48ee-881a-8bb7f04ee4bc None None] [instance: c32ac737-1788-4420-b200-2a107d5ad335] Synchronizing instance power state after lifecycle event "Started"; current vm
sta\
te: building, current taskstate: spawning, current DB powerstate: 0, VM powerstate: 1 handlelifecycleevent /opt/stack/nova/nova/compute/manager.py:1105
2015-01-01 14:44:31.629 INFO nova.compute.manager [req-77c13ae6-ccf9-48ee-881a-8bb7f04ee4bc None None] [instance: c32ac737-1788-4420-b200-2a107d5ad335] During sync
powerstate the instance has a pending task (spawning). Skip.
2015-01-01 14:44:31.630 3516 DEBUG nova.virt.driver [-] Emitting event Paused> emit
event /opt/stack/nova/nova/virt/driver.py:1298
2015-01-01 14:44:31.630 3516 INFO nova.compute.manager [-] [instance: c32ac737-1788-4420-b200-2a107d5ad335] VM Paused (Lifecycle Event)
2015-01-01 14:44:31.670 3516 DEBUG nova.compute.manager [-] [instance: c32ac737-1788-4420-b200-2a107d5ad335] Synchronizing instance power state after lifecycle event "Paused"; current vmstate: building, current taskstate: spawning, c\
urrent DB powerstate: 0, VM powerstate: 3 handlelifecycleevent /opt/stack/nova/nova/compute/manager.py:1105
2015-01-01 14:44:31.714 3516 INFO nova.compute.manager [-] [instance: c32ac737-1788-4420-b200-2a107d5ad335] During syncpowerstate the instance has a pending task (spawning). Skip.
2015-01-01 14:44:38.293 DEBUG nova.compute.manager [req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] [instance: c32ac737-1788-4420-b200-2a107d5ad335] Received event network-vif-plugged-ded0d35f-204f-4ca8-a85b-85decb53d9fe externa\
linstanceevent /opt/stack/nova/nova/compute/manager.py:6180
2015-01-01 14:44:38.293 DEBUG nova.openstack.common.lockutils [req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] Created new semaphore "c32ac737-1788-4420-b200-2a107d5ad335-events" internallock /opt/stack/nova/nova/openstack/comm\
on/lockutils.py:206
2015-01-01 14:44:38.294 DEBUG nova.openstack.common.lockutils [req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] Acquired semaphore "c32ac737-1788-4420-b200-2a107d5ad335-events" lock /opt/stack/nova/nova/openstack/common/lockutils\
.py:229
2015-01-01 14:44:38.294 DEBUG nova.openstack.common.lockutils [req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] Got semaphore / lock "
popevent" inner /opt/stack/nova/nova/openstack/common/lockutils.py:271
2015-01-01 14:44:38.294 DEBUG nova.openstack.common.lockutils [req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] Releasing semaphore "c32ac737-1788-4420-b200-2a107d5ad335-events" lock /opt/stack/nova/nova/openstack/common/lockutil\
s.py:238
2015-01-01 14:44:38.295 DEBUG nova.openstack.common.lockutils [req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] Semaphore / lock released "
popevent" inner /opt/stack/nova/nova/openstack/common/lockutils.py:275
2015-01-01 14:44:38.295 DEBUG nova.compute.manager [req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] [instance: c32ac737-1788-4420-b200-2a107d5ad335] Processing event network-vif-plugged-ded0d35f-204f-4ca8-a85b-85decb53d9fe _proc\
ess
instanceevent /opt/stack/nova/nova/compute/manager.py:6166
2015-01-01 14:44:38.309 3516 DEBUG nova.virt.libvirt.driver [-] [instance: c32ac737-1788-4420-b200-2a107d5ad335] Instance is running spawn /opt/stack/nova/nova/virt/libvirt/driver.py:2622
2015-01-01 14:44:38.310 3516 DEBUG nova.virt.driver [-] Emitting event Resumed> emit
event /opt/stack/nova/nova/virt/driver.py:1298
2015-01-01 14:44:38.311 3516 INFO nova.compute.manager [-] [instance: c32ac737-1788-4420-b200-2a107d5ad335] VM Resumed (Lifecycle Event)
2015-01-01 14:44:38.315 3516 INFO nova.virt.libvirt.driver [-] [instance: c32ac737-1788-4420-b200-2a107d5ad335] Instance spawned successfully.
2015-01-01 14:44:38.315 3516 DEBUG nova.compute.manager [-] [instance: c32ac737-1788-4420-b200-2a107d5ad335] Checking state getpowerstate /opt/stack/nova/nova/compute/manager.py:1156
2015-01-01 14:44:38.348 3516 DEBUG nova.compute.manager [-] [instance: c32ac737-1788-4420-b200-2a107d5ad335] Synchronizing instance power state after lifecycle event "Resumed"; current vm
state: building, current taskstate: spawning, \
current DB power
state: 0, VM powerstate: 1 handlelifecycleevent /opt/stack/nova/nova/compute/manager.py:1105
2015-01-01 14:44:38.391 3516 DEBUG nova.openstack.common.lockutils [-] Releasing semaphore "c32ac737-1788-4420-b200-2a107d5ad335" lock /opt/stack/nova/nova/openstack/common/lockutils.py:238
2015-01-01 14:44:38.394 3516 DEBUG nova.virt.driver [-] Emitting event Resumed> emit
event /opt/stack/nova/nova/virt/driver.py:1298
2015-01-01 14:44:38.394 3516 DEBUG nova.openstack.common.lockutils [-] Semaphore / lock released "lockeddobuildandruninstance" inner /opt/stack/nova/nova/openstack/common/lockutils.py:275
2015-01-01 14:44:38.396 3516 INFO nova.compute.manager [-] [instance: c32ac737-1788-4420-b200-2a107d5ad335] VM Resumed (Lifecycle Event)
2015-01-01 14:44:38.441 3516 DEBUG nova.compute.manager [-] [instance: c32ac737-1788-4420-b200-2a107d5ad335] Synchronizing instance power state after lifecycle event "Resumed"; current vmstate: active, current taskstate: None, curren\
t DB powerstate: 1, VM powerstate: 1 handlelifecycleevent /opt/stack/nova/nova/compute/manager.py:1105
2015-01-01 14:44:38.489 3516 DEBUG nova.virt.driver [-] Emitting event Paused> emitevent /opt/stack/nova/nova/virt/driver.py:1298
2015-01-01 14:44:38.490 3516 INFO nova.compute.manager [-] [instance: c32ac737-1788-4420-b200-2a107d5ad335] VM Paused (Lifecycle Event)
2015-01-01 14:44:38.535 3516 DEBUG nova.compute.manager [-] [instance: c32ac737-1788-4420-b200-2a107d5ad335] Synchronizing instance power state after lifecycle event "Paused"; current vm
state: active, current taskstate: None, current\
DB power
state: 1, VM powerstate: 3 handlelifecycle_event /opt/stack/nova/nova/compute/manager.py:1105
2015-01-01 14:44:38.643 3516 WARNING nova.compute.manager [-] [instance: c32ac737-1788-4420-b200-2a107d5ad335] Instance is paused unexpectedly. Ignore.

I think I saw this in one of my Kilo based VMs too.

Regards,

PCM (Paul Michali)

MAIL ?..?. pcm at cisco.com
IRC ??..? pc_m (irc.freenode.com)
TW ???... @pmichali
GPG Key ? 4525ECC253E31A83
Fingerprint .. 307A 96BB 1A4C D2C7 931D 8D2D 4525 ECC2 53E3 1A83

On Dec 31, 2014, at 7:57 PM, Kevin Benton wrote:

Any exceptions on the Neutron side? It might not be notifying nova
that the network is ready.

On Wed, Dec 31, 2014 at 8:41 AM, Paul Michali (pcm) wrote:

Not sure if I?m going crazy or what. I?m using DevStack and, after stacking
I tried booting a Cirros 3.2, 3.3, and Ubuntu cloud 14.04 image. Each time,
the image ends up in PAUSED power state:

ubuntu at juno:/opt/stack/neutron$ nova show peter
+--------------------------------------+----------------------------------------------------------------+
| Property | Value
|
+--------------------------------------+----------------------------------------------------------------+
| OS-DCF:diskConfig | MANUAL
|
| OS-EXT-AZ:availabilityzone | nova
|
| OS-EXT-SRV-ATTR:host | juno
|
| OS-EXT-SRV-ATTR:hypervisor
hostname | juno
|
| OS-EXT-SRV-ATTR:instancename | instance-00000001
|
| OS-EXT-STS:power
state | 3
|
| OS-EXT-STS:taskstate | -
|
| OS-EXT-STS:vm
state | active
|
| OS-SRV-USG:launchedat | 2014-12-31T15:15:33.000000
|
| OS-SRV-USG:terminated
at | -
|
| accessIPv4 |
|
| accessIPv6 |
|
| configdrive |
|
| created | 2014-12-31T15:15:24Z
|
| flavor | m1.tiny (1)
|
| hostId |
5b0c48250ccc0ac3fca8a821e29e4b154ec0b101f9cc0a0b27071a3f |
| id |
ec5c8d70-ae80-4cc3-a5bb-b68019170dd6 |
| image | cirros-0.3.3-x86
64-uec
(797e4dee-8c03-497f-8dac-a44b9351dfa3) |
| keyname | -
|
| metadata | {}
|
| name | peter
|
| os-extended-volumes:volumes
attached | []
|
| private network | 10.0.0.4
|
| progress | 0
|
| securitygroups | default
|
| status | ACTIVE
|
| tenant
id | 7afb5bc1d88d462c8d57178437d3c277
|
| updated | 2014-12-31T15:15:34Z
|
| user_id | 4ff18bdbeb4d436ea4ff1bcd29e269a9
|
+--------------------------------------+----------------------------------------------------------------+
ubuntu at juno:/opt/stack/neutron$ nova list
+--------------------------------------+-------+--------+------------+-------------+------------------+
| ID | Name | Status | Task State | Power
State | Networks |
+--------------------------------------+-------+--------+------------+-------------+------------------+
| ec5c8d70-ae80-4cc3-a5bb-b68019170dd6 | peter | ACTIVE | - |
Paused | private=10.0.0.4 |

I don?t see this with Kilo latest images. Any idea what I may be doing
wrong, or if there is an issue (I didn?t see anything on Google search)?

IMAGEID=nova image-list | grep 'cloudimg-amd64 ' | cut -d' ' -f 2
PRIVATE
NET=neutron net-list | grep 'private ' | cut -f 2 -d' ?

nova boot peter --flavor 3 --image $IMAGEID --user-data
~/devstack/user
data.txt --nic net-id=$PRIVATENET
nova boot --flavor 1 --image cirros-0.3.3-x86
64-uec --nic
net-id=$PRIVATE_NET paul

Thanks.

PCM (Paul Michali)

MAIL ?..?. pcm at cisco.com
IRC ??..? pc_m (irc.freenode.com)
TW ???... @pmichali
GPG Key ? 4525ECC253E31A83
Fingerprint .. 307A 96BB 1A4C D2C7 931D 8D2D 4525 ECC2 53E3 1A83


OpenStack-dev mailing list
OpenStack-dev at lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

--
Kevin Benton


OpenStack-dev mailing list
OpenStack-dev at lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL:
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 842 bytes
Desc: Message signed with OpenPGP using GPGMail
URL:

responded Jan 1, 2015 by Paul_Michali_(pcm (3,280 points)   1 4 6
0 votes

Ah, doesn't seem to be a Neutron issue then since the
'network-vif-plugged' event is showing up and it's attempting to
resume.

The red flag looks like that "Instance is paused unexpectedly.
Ignore.". If you grep the nova code base for that, it brings up a note
linking to bug 1097806.[1] The VM is paused when Nova didn't expect it
to be. Do you have any other tools running that might be affecting
kvm?

  1. https://bugs.launchpad.net/nova/+bug/1097806

On Thu, Jan 1, 2015 at 8:09 AM, Paul Michali (pcm) wrote:
Hi Kevin,

No exceptions/tracebacks/errors in Neutron at all. In the Nova logs, it
seems to create the instance, pause, and then resume, but it looks like
maybe it is not resuming?

2015-01-01 14:44:30.716 3516 DEBUG nova.openstack.common.processutils [-]
Running cmd (subprocess): sudo nova-rootwrap /etc/nova/rootwrap.conf
ovs-vsctl --timeout=120 -- --if-exists del-port qvoded0d35f-20 -- add-port
br-int qvoded0d35\
f-20 -- set Interface qvoded0d35f-20
external-ids:iface-id=ded0d35f-204f-4ca8-a85b-85decb53d9fe
external-ids:iface-status=active external-ids:attached-mac=fa:16:3e:81:ab:12
external-ids:vm-uuid=c32ac737-1788-4420-b200-2a107d5ad335 exec\
ute /opt/stack/nova/nova/openstack/common/processutils.py:161
2015-01-01 14:44:30.786 3516 DEBUG nova.openstack.common.processutils [-]
Result was 0 execute
/opt/stack/nova/nova/openstack/common/processutils.py:195
2015-01-01 14:44:31.542 3516 DEBUG nova.virt.driver [-] Emitting event

Started> emitevent /opt/stack/nova/nova/virt/driver.py:1298
2015-01-01 14:44:31.543 3516 INFO nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] VM Started (Lifecycle Event)
2015-01-01 14:44:31.584 DEBUG nova.compute.manager
[req-77c13ae6-ccf9-48ee-881a-8bb7f04ee4bc None None] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Synchronizing instance power state
after lifecycle event "Started"; current vm
sta\
te: building, current taskstate: spawning, current DB powerstate: 0, VM
powerstate: 1 handlelifecycleevent
/opt/stack/nova/nova/compute/manager.py:1105
2015-01-01 14:44:31.629 INFO nova.compute.manager
[req-77c13ae6-ccf9-48ee-881a-8bb7f04ee4bc None None] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] During sync
powerstate the instance
has a pending task (spawning). Skip.
2015-01-01 14:44:31.630 3516 DEBUG nova.virt.driver [-] Emitting event

Paused> emit
event /opt/stack/nova/nova/virt/driver.py:1298
2015-01-01 14:44:31.630 3516 INFO nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] VM Paused (Lifecycle Event)
2015-01-01 14:44:31.670 3516 DEBUG nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Synchronizing instance power state
after lifecycle event "Paused"; current vmstate: building, current
task
state: spawning, c\
urrent DB powerstate: 0, VM powerstate: 3 handlelifecycleevent
/opt/stack/nova/nova/compute/manager.py:1105
2015-01-01 14:44:31.714 3516 INFO nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] During syncpowerstate the instance
has a pending task (spawning). Skip.
2015-01-01 14:44:38.293 DEBUG nova.compute.manager
[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Received event
network-vif-plugged-ded0d35f-204f-4ca8-a85b-85decb53d9fe externa\
linstanceevent /opt/stack/nova/nova/compute/manager.py:6180
2015-01-01 14:44:38.293 DEBUG nova.openstack.common.lockutils
[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] Created new
semaphore "c32ac737-1788-4420-b200-2a107d5ad335-events" internallock
/opt/stack/nova/nova/openstack/comm\
on/lockutils.py:206
2015-01-01 14:44:38.294 DEBUG nova.openstack.common.lockutils
[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] Acquired semaphore
"c32ac737-1788-4420-b200-2a107d5ad335-events" lock
/opt/stack/nova/nova/openstack/common/lockutils\
.py:229
2015-01-01 14:44:38.294 DEBUG nova.openstack.common.lockutils
[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] Got semaphore / lock
"
popevent" inner /opt/stack/nova/nova/openstack/common/lockutils.py:271
2015-01-01 14:44:38.294 DEBUG nova.openstack.common.lockutils
[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] Releasing semaphore
"c32ac737-1788-4420-b200-2a107d5ad335-events" lock
/opt/stack/nova/nova/openstack/common/lockutil\
s.py:238
2015-01-01 14:44:38.295 DEBUG nova.openstack.common.lockutils
[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] Semaphore / lock
released "
popevent" inner
/opt/stack/nova/nova/openstack/common/lockutils.py:275
2015-01-01 14:44:38.295 DEBUG nova.compute.manager
[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Processing event
network-vif-plugged-ded0d35f-204f-4ca8-a85b-85decb53d9fe _proc\
ess
instanceevent /opt/stack/nova/nova/compute/manager.py:6166
2015-01-01 14:44:38.309 3516 DEBUG nova.virt.libvirt.driver [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Instance is running spawn
/opt/stack/nova/nova/virt/libvirt/driver.py:2622
2015-01-01 14:44:38.310 3516 DEBUG nova.virt.driver [-] Emitting event

Resumed> emit
event /opt/stack/nova/nova/virt/driver.py:1298
2015-01-01 14:44:38.311 3516 INFO nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] VM Resumed (Lifecycle Event)
2015-01-01 14:44:38.315 3516 INFO nova.virt.libvirt.driver [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Instance spawned successfully.
2015-01-01 14:44:38.315 3516 DEBUG nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Checking state getpowerstate
/opt/stack/nova/nova/compute/manager.py:1156
2015-01-01 14:44:38.348 3516 DEBUG nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Synchronizing instance power state
after lifecycle event "Resumed"; current vm
state: building, current
taskstate: spawning, \
current DB power
state: 0, VM powerstate: 1 handlelifecycleevent
/opt/stack/nova/nova/compute/manager.py:1105
2015-01-01 14:44:38.391 3516 DEBUG nova.openstack.common.lockutils [-]
Releasing semaphore "c32ac737-1788-4420-b200-2a107d5ad335" lock
/opt/stack/nova/nova/openstack/common/lockutils.py:238
2015-01-01 14:44:38.394 3516 DEBUG nova.virt.driver [-] Emitting event

Resumed> emit
event /opt/stack/nova/nova/virt/driver.py:1298
2015-01-01 14:44:38.394 3516 DEBUG nova.openstack.common.lockutils [-]
Semaphore / lock released "lockeddobuildandruninstance" inner
/opt/stack/nova/nova/openstack/common/lockutils.py:275
2015-01-01 14:44:38.396 3516 INFO nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] VM Resumed (Lifecycle Event)
2015-01-01 14:44:38.441 3516 DEBUG nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Synchronizing instance power state
after lifecycle event "Resumed"; current vmstate: active, current
task
state: None, curren\
t DB powerstate: 1, VM powerstate: 1 handlelifecycleevent
/opt/stack/nova/nova/compute/manager.py:1105
2015-01-01 14:44:38.489 3516 DEBUG nova.virt.driver [-] Emitting event

Paused> emitevent /opt/stack/nova/nova/virt/driver.py:1298
2015-01-01 14:44:38.490 3516 INFO nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] VM Paused (Lifecycle Event)
2015-01-01 14:44:38.535 3516 DEBUG nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Synchronizing instance power state
after lifecycle event "Paused"; current vm
state: active, current
taskstate: None, current\
DB power
state: 1, VM powerstate: 3 handlelifecycle_event
/opt/stack/nova/nova/compute/manager.py:1105
2015-01-01 14:44:38.643 3516 WARNING nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Instance is paused unexpectedly.
Ignore.

I think I saw this in one of my Kilo based VMs too.

Regards,

PCM (Paul Michali)

MAIL ?..?. pcm at cisco.com
IRC ??..? pc_m (irc.freenode.com)
TW ???... @pmichali
GPG Key ? 4525ECC253E31A83
Fingerprint .. 307A 96BB 1A4C D2C7 931D 8D2D 4525 ECC2 53E3 1A83

On Dec 31, 2014, at 7:57 PM, Kevin Benton wrote:

Any exceptions on the Neutron side? It might not be notifying nova
that the network is ready.

On Wed, Dec 31, 2014 at 8:41 AM, Paul Michali (pcm) wrote:

Not sure if I?m going crazy or what. I?m using DevStack and, after stacking
I tried booting a Cirros 3.2, 3.3, and Ubuntu cloud 14.04 image. Each time,
the image ends up in PAUSED power state:

ubuntu at juno:/opt/stack/neutron$ nova show peter
+--------------------------------------+----------------------------------------------------------------+
| Property | Value
|
+--------------------------------------+----------------------------------------------------------------+
| OS-DCF:diskConfig | MANUAL
|
| OS-EXT-AZ:availabilityzone | nova
|
| OS-EXT-SRV-ATTR:host | juno
|
| OS-EXT-SRV-ATTR:hypervisor
hostname | juno
|
| OS-EXT-SRV-ATTR:instancename | instance-00000001
|
| OS-EXT-STS:power
state | 3
|
| OS-EXT-STS:taskstate | -
|
| OS-EXT-STS:vm
state | active
|
| OS-SRV-USG:launchedat | 2014-12-31T15:15:33.000000
|
| OS-SRV-USG:terminated
at | -
|
| accessIPv4 |
|
| accessIPv6 |
|
| configdrive |
|
| created | 2014-12-31T15:15:24Z
|
| flavor | m1.tiny (1)
|
| hostId |
5b0c48250ccc0ac3fca8a821e29e4b154ec0b101f9cc0a0b27071a3f |
| id |
ec5c8d70-ae80-4cc3-a5bb-b68019170dd6 |
| image | cirros-0.3.3-x86
64-uec
(797e4dee-8c03-497f-8dac-a44b9351dfa3) |
| keyname | -
|
| metadata | {}
|
| name | peter
|
| os-extended-volumes:volumes
attached | []
|
| private network | 10.0.0.4
|
| progress | 0
|
| securitygroups | default
|
| status | ACTIVE
|
| tenant
id | 7afb5bc1d88d462c8d57178437d3c277
|
| updated | 2014-12-31T15:15:34Z
|
| user_id | 4ff18bdbeb4d436ea4ff1bcd29e269a9
|
+--------------------------------------+----------------------------------------------------------------+
ubuntu at juno:/opt/stack/neutron$ nova list
+--------------------------------------+-------+--------+------------+-------------+------------------+
| ID | Name | Status | Task State | Power
State | Networks |
+--------------------------------------+-------+--------+------------+-------------+------------------+
| ec5c8d70-ae80-4cc3-a5bb-b68019170dd6 | peter | ACTIVE | - |
Paused | private=10.0.0.4 |

I don?t see this with Kilo latest images. Any idea what I may be doing
wrong, or if there is an issue (I didn?t see anything on Google search)?

IMAGEID=nova image-list | grep 'cloudimg-amd64 ' | cut -d' ' -f 2
PRIVATE
NET=neutron net-list | grep 'private ' | cut -f 2 -d' ?

nova boot peter --flavor 3 --image $IMAGEID --user-data
~/devstack/user
data.txt --nic net-id=$PRIVATENET
nova boot --flavor 1 --image cirros-0.3.3-x86
64-uec --nic
net-id=$PRIVATE_NET paul

Thanks.

PCM (Paul Michali)

MAIL ?..?. pcm at cisco.com
IRC ??..? pc_m (irc.freenode.com)
TW ???... @pmichali
GPG Key ? 4525ECC253E31A83
Fingerprint .. 307A 96BB 1A4C D2C7 931D 8D2D 4525 ECC2 53E3 1A83


OpenStack-dev mailing list
OpenStack-dev at lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

--
Kevin Benton


OpenStack-dev mailing list
OpenStack-dev at lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


OpenStack-dev mailing list
OpenStack-dev at lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

--
Kevin Benton

responded Jan 2, 2015 by Kevin_Benton (24,800 points)   3 5 6
0 votes

No other tools. Running a stock Ubuntu 14.04 server, installed devstack, created local.conf, stacked, and tried to create a VM. I?ve since seen this on another VM I have running with Kilo code, so it is not specifically a Juno issue.

I don?t see what the difference is between a working and non-working setup. :(

On all instances, virsh -v shows 1.2.2.

Baffled.

PCM (Paul Michali)

MAIL ?..?. pcm at cisco.com
IRC ??..? pc_m (irc.freenode.com)
TW ???... @pmichali
GPG Key ? 4525ECC253E31A83
Fingerprint .. 307A 96BB 1A4C D2C7 931D 8D2D 4525 ECC2 53E3 1A83

On Jan 2, 2015, at 4:48 AM, Kevin Benton wrote:

Ah, doesn't seem to be a Neutron issue then since the
'network-vif-plugged' event is showing up and it's attempting to
resume.

The red flag looks like that "Instance is paused unexpectedly.
Ignore.". If you grep the nova code base for that, it brings up a note
linking to bug 1097806.[1] The VM is paused when Nova didn't expect it
to be. Do you have any other tools running that might be affecting
kvm?

  1. https://bugs.launchpad.net/nova/+bug/1097806

On Thu, Jan 1, 2015 at 8:09 AM, Paul Michali (pcm) wrote:

Hi Kevin,

No exceptions/tracebacks/errors in Neutron at all. In the Nova logs, it
seems to create the instance, pause, and then resume, but it looks like
maybe it is not resuming?

2015-01-01 14:44:30.716 3516 DEBUG nova.openstack.common.processutils [-]
Running cmd (subprocess): sudo nova-rootwrap /etc/nova/rootwrap.conf
ovs-vsctl --timeout=120 -- --if-exists del-port qvoded0d35f-20 -- add-port
br-int qvoded0d35\
f-20 -- set Interface qvoded0d35f-20
external-ids:iface-id=ded0d35f-204f-4ca8-a85b-85decb53d9fe
external-ids:iface-status=active external-ids:attached-mac=fa:16:3e:81:ab:12
external-ids:vm-uuid=c32ac737-1788-4420-b200-2a107d5ad335 exec\
ute /opt/stack/nova/nova/openstack/common/processutils.py:161
2015-01-01 14:44:30.786 3516 DEBUG nova.openstack.common.processutils [-]
Result was 0 execute
/opt/stack/nova/nova/openstack/common/processutils.py:195
2015-01-01 14:44:31.542 3516 DEBUG nova.virt.driver [-] Emitting event

Started> emitevent /opt/stack/nova/nova/virt/driver.py:1298
2015-01-01 14:44:31.543 3516 INFO nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] VM Started (Lifecycle Event)
2015-01-01 14:44:31.584 DEBUG nova.compute.manager
[req-77c13ae6-ccf9-48ee-881a-8bb7f04ee4bc None None] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Synchronizing instance power state
after lifecycle event "Started"; current vm
sta\
te: building, current taskstate: spawning, current DB powerstate: 0, VM
powerstate: 1 handlelifecycleevent
/opt/stack/nova/nova/compute/manager.py:1105
2015-01-01 14:44:31.629 INFO nova.compute.manager
[req-77c13ae6-ccf9-48ee-881a-8bb7f04ee4bc None None] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] During sync
powerstate the instance
has a pending task (spawning). Skip.
2015-01-01 14:44:31.630 3516 DEBUG nova.virt.driver [-] Emitting event

Paused> emit
event /opt/stack/nova/nova/virt/driver.py:1298
2015-01-01 14:44:31.630 3516 INFO nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] VM Paused (Lifecycle Event)
2015-01-01 14:44:31.670 3516 DEBUG nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Synchronizing instance power state
after lifecycle event "Paused"; current vmstate: building, current
task
state: spawning, c\
urrent DB powerstate: 0, VM powerstate: 3 handlelifecycleevent
/opt/stack/nova/nova/compute/manager.py:1105
2015-01-01 14:44:31.714 3516 INFO nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] During syncpowerstate the instance
has a pending task (spawning). Skip.
2015-01-01 14:44:38.293 DEBUG nova.compute.manager
[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Received event
network-vif-plugged-ded0d35f-204f-4ca8-a85b-85decb53d9fe externa\
linstanceevent /opt/stack/nova/nova/compute/manager.py:6180
2015-01-01 14:44:38.293 DEBUG nova.openstack.common.lockutils
[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] Created new
semaphore "c32ac737-1788-4420-b200-2a107d5ad335-events" internallock
/opt/stack/nova/nova/openstack/comm\
on/lockutils.py:206
2015-01-01 14:44:38.294 DEBUG nova.openstack.common.lockutils
[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] Acquired semaphore
"c32ac737-1788-4420-b200-2a107d5ad335-events" lock
/opt/stack/nova/nova/openstack/common/lockutils\
.py:229
2015-01-01 14:44:38.294 DEBUG nova.openstack.common.lockutils
[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] Got semaphore / lock
"
popevent" inner /opt/stack/nova/nova/openstack/common/lockutils.py:271
2015-01-01 14:44:38.294 DEBUG nova.openstack.common.lockutils
[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] Releasing semaphore
"c32ac737-1788-4420-b200-2a107d5ad335-events" lock
/opt/stack/nova/nova/openstack/common/lockutil\
s.py:238
2015-01-01 14:44:38.295 DEBUG nova.openstack.common.lockutils
[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] Semaphore / lock
released "
popevent" inner
/opt/stack/nova/nova/openstack/common/lockutils.py:275
2015-01-01 14:44:38.295 DEBUG nova.compute.manager
[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Processing event
network-vif-plugged-ded0d35f-204f-4ca8-a85b-85decb53d9fe _proc\
ess
instanceevent /opt/stack/nova/nova/compute/manager.py:6166
2015-01-01 14:44:38.309 3516 DEBUG nova.virt.libvirt.driver [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Instance is running spawn
/opt/stack/nova/nova/virt/libvirt/driver.py:2622
2015-01-01 14:44:38.310 3516 DEBUG nova.virt.driver [-] Emitting event

Resumed> emit
event /opt/stack/nova/nova/virt/driver.py:1298
2015-01-01 14:44:38.311 3516 INFO nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] VM Resumed (Lifecycle Event)
2015-01-01 14:44:38.315 3516 INFO nova.virt.libvirt.driver [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Instance spawned successfully.
2015-01-01 14:44:38.315 3516 DEBUG nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Checking state getpowerstate
/opt/stack/nova/nova/compute/manager.py:1156
2015-01-01 14:44:38.348 3516 DEBUG nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Synchronizing instance power state
after lifecycle event "Resumed"; current vm
state: building, current
taskstate: spawning, \
current DB power
state: 0, VM powerstate: 1 handlelifecycleevent
/opt/stack/nova/nova/compute/manager.py:1105
2015-01-01 14:44:38.391 3516 DEBUG nova.openstack.common.lockutils [-]
Releasing semaphore "c32ac737-1788-4420-b200-2a107d5ad335" lock
/opt/stack/nova/nova/openstack/common/lockutils.py:238
2015-01-01 14:44:38.394 3516 DEBUG nova.virt.driver [-] Emitting event

Resumed> emit
event /opt/stack/nova/nova/virt/driver.py:1298
2015-01-01 14:44:38.394 3516 DEBUG nova.openstack.common.lockutils [-]
Semaphore / lock released "lockeddobuildandruninstance" inner
/opt/stack/nova/nova/openstack/common/lockutils.py:275
2015-01-01 14:44:38.396 3516 INFO nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] VM Resumed (Lifecycle Event)
2015-01-01 14:44:38.441 3516 DEBUG nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Synchronizing instance power state
after lifecycle event "Resumed"; current vmstate: active, current
task
state: None, curren\
t DB powerstate: 1, VM powerstate: 1 handlelifecycleevent
/opt/stack/nova/nova/compute/manager.py:1105
2015-01-01 14:44:38.489 3516 DEBUG nova.virt.driver [-] Emitting event

Paused> emitevent /opt/stack/nova/nova/virt/driver.py:1298
2015-01-01 14:44:38.490 3516 INFO nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] VM Paused (Lifecycle Event)
2015-01-01 14:44:38.535 3516 DEBUG nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Synchronizing instance power state
after lifecycle event "Paused"; current vm
state: active, current
taskstate: None, current\
DB power
state: 1, VM powerstate: 3 handlelifecycle_event
/opt/stack/nova/nova/compute/manager.py:1105
2015-01-01 14:44:38.643 3516 WARNING nova.compute.manager [-] [instance:
c32ac737-1788-4420-b200-2a107d5ad335] Instance is paused unexpectedly.
Ignore.

I think I saw this in one of my Kilo based VMs too.

Regards,

PCM (Paul Michali)

MAIL ?..?. pcm at cisco.com
IRC ??..? pc_m (irc.freenode.com)
TW ???... @pmichali
GPG Key ? 4525ECC253E31A83
Fingerprint .. 307A 96BB 1A4C D2C7 931D 8D2D 4525 ECC2 53E3 1A83

On Dec 31, 2014, at 7:57 PM, Kevin Benton wrote:

Any exceptions on the Neutron side? It might not be notifying nova
that the network is ready.

On Wed, Dec 31, 2014 at 8:41 AM, Paul Michali (pcm) wrote:

Not sure if I?m going crazy or what. I?m using DevStack and, after stacking
I tried booting a Cirros 3.2, 3.3, and Ubuntu cloud 14.04 image. Each time,
the image ends up in PAUSED power state:

ubuntu at juno:/opt/stack/neutron$ nova show peter
+--------------------------------------+----------------------------------------------------------------+
| Property | Value
|
+--------------------------------------+----------------------------------------------------------------+
| OS-DCF:diskConfig | MANUAL
|
| OS-EXT-AZ:availabilityzone | nova
|
| OS-EXT-SRV-ATTR:host | juno
|
| OS-EXT-SRV-ATTR:hypervisor
hostname | juno
|
| OS-EXT-SRV-ATTR:instancename | instance-00000001
|
| OS-EXT-STS:power
state | 3
|
| OS-EXT-STS:taskstate | -
|
| OS-EXT-STS:vm
state | active
|
| OS-SRV-USG:launchedat | 2014-12-31T15:15:33.000000
|
| OS-SRV-USG:terminated
at | -
|
| accessIPv4 |
|
| accessIPv6 |
|
| configdrive |
|
| created | 2014-12-31T15:15:24Z
|
| flavor | m1.tiny (1)
|
| hostId |
5b0c48250ccc0ac3fca8a821e29e4b154ec0b101f9cc0a0b27071a3f |
| id |
ec5c8d70-ae80-4cc3-a5bb-b68019170dd6 |
| image | cirros-0.3.3-x86
64-uec
(797e4dee-8c03-497f-8dac-a44b9351dfa3) |
| keyname | -
|
| metadata | {}
|
| name | peter
|
| os-extended-volumes:volumes
attached | []
|
| private network | 10.0.0.4
|
| progress | 0
|
| securitygroups | default
|
| status | ACTIVE
|
| tenant
id | 7afb5bc1d88d462c8d57178437d3c277
|
| updated | 2014-12-31T15:15:34Z
|
| user_id | 4ff18bdbeb4d436ea4ff1bcd29e269a9
|
+--------------------------------------+----------------------------------------------------------------+
ubuntu at juno:/opt/stack/neutron$ nova list
+--------------------------------------+-------+--------+------------+-------------+------------------+
| ID | Name | Status | Task State | Power
State | Networks |
+--------------------------------------+-------+--------+------------+-------------+------------------+
| ec5c8d70-ae80-4cc3-a5bb-b68019170dd6 | peter | ACTIVE | - |
Paused | private=10.0.0.4 |

I don?t see this with Kilo latest images. Any idea what I may be doing
wrong, or if there is an issue (I didn?t see anything on Google search)?

IMAGEID=nova image-list | grep 'cloudimg-amd64 ' | cut -d' ' -f 2
PRIVATE
NET=neutron net-list | grep 'private ' | cut -f 2 -d' ?

nova boot peter --flavor 3 --image $IMAGEID --user-data
~/devstack/user
data.txt --nic net-id=$PRIVATENET
nova boot --flavor 1 --image cirros-0.3.3-x86
64-uec --nic
net-id=$PRIVATE_NET paul

Thanks.

PCM (Paul Michali)

MAIL ?..?. pcm at cisco.com
IRC ??..? pc_m (irc.freenode.com)
TW ???... @pmichali
GPG Key ? 4525ECC253E31A83
Fingerprint .. 307A 96BB 1A4C D2C7 931D 8D2D 4525 ECC2 53E3 1A83


OpenStack-dev mailing list
OpenStack-dev at lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

--
Kevin Benton


OpenStack-dev mailing list
OpenStack-dev at lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


OpenStack-dev mailing list
OpenStack-dev at lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

--
Kevin Benton


OpenStack-dev mailing list
OpenStack-dev at lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL:
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 842 bytes
Desc: Message signed with OpenPGP using GPGMail
URL:

responded Jan 2, 2015 by Paul_Michali_(pcm (3,280 points)   1 4 6
0 votes

On Jan 2, 2015, at 4:53 AM, Paul Michali (pcm) wrote:

I don?t see what the difference is between a working and non-working setup. :(

One other time I?ve seen this happen is if the compute node is low (or out) of disk space. If there?s connectivity problems with a cinder device, this would be a similar situation. As Kevin suggested, I?d also start looking into any logs KVM/libvirt might be generating.

Cheers,
-j

responded Jan 2, 2015 by James_Downs (620 points)   1
0 votes

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

I ran into similar behavior once, and it turned out I was running out
of space on the system. This blog post helped me track down the
problem:
http://porkrind.org/missives/libvirt-based-qemu-vm-pausing-by-itself/

Not sure whether it's relevant to your situation, but it's something
to check.

  • -Ben

On 12/31/2014 09:41 AM, Paul Michali (pcm) wrote:
Not sure if I?m going crazy or what. I?m using DevStack and, after
stacking I tried booting a Cirros 3.2, 3.3, and Ubuntu cloud 14.04
image. Each time, the image ends up in PAUSED power state:

ubuntu at juno:/opt/stack/neutron$ nova show peter
+--------------------------------------+----------------------------------------------------------------+

| Property | Value
|

+--------------------------------------+----------------------------------------------------------------+

| OS-DCF:diskConfig | MANUAL
|

| OS-EXT-AZ:availabilityzone | nova
| | OS-EXT-SRV-ATTR:host | juno
| | OS-EXT-SRV-ATTR:hypervisor
hostname | juno
| | OS-EXT-SRV-ATTR:instancename | instance-00000001
| | OS-EXT-STS:power
state | 3
| | OS-EXT-STS:taskstate | -
| | OS-EXT-STS:vm
state | active
| | OS-SRV-USG:launchedat |
2014-12-31T15:15:33.000000 | |
OS-SRV-USG:terminated
at | -
| | accessIPv4 |
| | accessIPv6 |
| | configdrive |
| | created | 2014-12-31T15:15:24Z
| | flavor | m1.tiny (1)
| | hostId |
5b0c48250ccc0ac3fca8a821e29e4b154ec0b101f9cc0a0b27071a3f | |
id |
ec5c8d70-ae80-4cc3-a5bb-b68019170dd6 | |
image | cirros-0.3.3-x86
64-uec
(797e4dee-8c03-497f-8dac-a44b9351dfa3) | | keyname
| - |
| metadata | {}
| | name | peter
| | os-extended-volumes:volumes
attached | []
| | private network | 10.0.0.4
| | progress | 0
| | securitygroups | default
| | status | ACTIVE
| | tenant
id |
7afb5bc1d88d462c8d57178437d3c277 | |
updated | 2014-12-31T15:15:34Z
| | user_id |
4ff18bdbeb4d436ea4ff1bcd29e269a9 |
+--------------------------------------+----------------------------------------------------------------+

ubuntu at juno:/opt/stack/neutron$ nova list

+--------------------------------------+-------+--------+------------+-------------+------------------+

| ID | Name | Status | Task State |
Power State | Networks |

+--------------------------------------+-------+--------+------------+-------------+------------------+

| ec5c8d70-ae80-4cc3-a5bb-b68019170dd6 | peter | ACTIVE | - |
Paused | private=10.0.0.4 |

I don?t see this with Kilo latest images. Any idea what I may be
doing wrong, or if there is an issue (I didn?t see anything on
Google search)?

IMAGEID=nova image-list | grep 'cloudimg-amd64 ' | cut -d' ' -f 2 PRIVATENET=neutron net-list | grep 'private ' | cut -f 2 -d' ?

nova boot peter --flavor 3 --image $IMAGEID --user-data
~/devstack/user
data.txt --nic net-id=$PRIVATENET nova boot
--flavor 1 --image cirros-0.3.3-x86
64-uec --nic
net-id=$PRIVATE_NET paul

Thanks.

PCM (Paul Michali)

MAIL ?..?. pcm at cisco.com IRC ??..? pc_m (irc.freenode.com) TW
???... @pmichali GPG Key ? 4525ECC253E31A83 Fingerprint .. 307A
96BB 1A4C D2C7 931D 8D2D 4525 ECC2 53E3 1A83

_______________________________________________ OpenStack-dev
mailing list OpenStack-dev at lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1

iQEcBAEBAgAGBQJUpryOAAoJEDehGd0Fy7uqVQgH/3EmJBE2Z8DMQqCqhHFLat5b
H34R2sXz0ODP+X6nu9MykXjTk7O/zDW9aSgW8nNRa7pbyZm+R0AOTpqcc3P1T6uE
zZ6LqL+d8GEVaC4BNIrnCO3Ip3hDmhr+HQcAZa0LYdgxF4/Oc9merycTy5UDzwbZ
hcUwULr4OdnJqdkcnp1XfqfEKsRWi7varkj6nnuB46dOJBeH8Tmr/9NTBo+veglK
kpmKISuH+TyWpjZekmkRpPq97vEQ1pxBeJcqHfhF5x5q14CleN51JKg8J7xckcmO
XS9rrQtHjMxIB86b6oAAfKlTGhz9FsZ7c1C3QmCxco3NqCtFtCoXsFoYhiLoyIo=
=4AwW
-----END PGP SIGNATURE-----

responded Jan 2, 2015 by Ben_Nemec (19,660 points)   2 3 3
0 votes

These VMs that are running devstack are 50GB disk, so there is plenty of disk space. I don?t have cinder set up with this devstack setup.

I looked in the log for the instance and in the failing case the same message was displayed (with different MAC and uuid), and then on the next line, I see this error, register dump.

KVM: entry failed, hardware error 0x0
EAX=00000000 EBX=00000000 ECX=00000000 EDX=00000663
ESI=00000000 EDI=00000000 EBP=00000000 ESP=00000000
EIP=0000e05b EFL=00000002 [-------] CPL=0 II=0 A20=1 SMM=0 HLT=0
ES =0000 00000000 0000ffff 00009300
CS =f000 000f0000 0000ffff 00009b00
SS =0000 00000000 0000ffff 00009300
DS =0000 00000000 0000ffff 00009300
FS =0000 00000000 0000ffff 00009300
GS =0000 00000000 0000ffff 00009300
LDT=0000 00000000 0000ffff 00008200
TR =0000 00000000 0000ffff 00008b00
GDT= 00000000 0000ffff
IDT= 00000000 0000ffff
CR0=60000010 CR2=00000000 CR3=00000000 CR4=00000000
DR0=0000000000000000 DR1=0000000000000000 DR2=0000000000000000 DR3=0000000000000000
DR6=00000000ffff0ff0 DR7=0000000000000400
EFER=0000000000000000
Code=85 00 87 00 89 00 8b 00 00 00 86 00 88 00 8a 00 8c 00 00 90 <2e> 66 83 3e a4 65 00 0f 85 53 f2 31 c0 8e
d0 66 bc 00 70 00 00 66 ba 4f 3c 0f 00 e9 b1 f0

Can anyone glen anything from this?

In the libvirtd.log, I see:

2015-01-02 15:48:21.257+0000: 20711: info : libvirt version: 1.2.2
2015-01-02 15:48:21.257+0000: 20711: error : virNetSocketReadWire:1454 : End of file while reading data: Input/output error

Not much info (for me :).

PCM (Paul Michali)

MAIL ?..?. pcm at cisco.com
IRC ??..? pc_m (irc.freenode.com)
TW ???... @pmichali
GPG Key ? 4525ECC253E31A83
Fingerprint .. 307A 96BB 1A4C D2C7 931D 8D2D 4525 ECC2 53E3 1A83

On Jan 2, 2015, at 10:41 AM, James Downs > wrote:

On Jan 2, 2015, at 4:53 AM, Paul Michali (pcm) > wrote:

I don?t see what the difference is between a working and non-working setup. :(

One other time I?ve seen this happen is if the compute node is low (or out) of disk space. If there?s connectivity problems with a cinder device, this would be a similar situation. As Kevin suggested, I?d also start looking into any logs KVM/libvirt might be generating.

Cheers,
-j


OpenStack-dev mailing list
OpenStack-dev at lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL:

responded Jan 2, 2015 by Paul_Michali_(pcm (3,280 points)   1 4 6
0 votes

I checked and the disk has plenty of space:

Filesystem Size Used Avail Use% Mounted on
/dev/vda1 50G 6.2G 41G 14% /
none 4.0K 0 4.0K 0% /sys/fs/cgroup
udev 3.9G 12K 3.9G 1% /dev
tmpfs 799M 408K 799M 1% /run
none 5.0M 0 5.0M 0% /run/lock
none 3.9G 0 3.9G 0% /run/shm
none 100M 0 100M 0% /run/user

One google search mentioned checking user is in libvirtd group (it is). I have 8GB ram with 600+ MB available, when Devstack is running.

I didn?t Cinder was running, but I see cinder-api and cinder-volume processes running in top. These are running on the bare metal config that does work.

This is a Ubuntu 14.04 image for the host (cloud image).

It seems I either get the problem where the VM is in paused state, or it doesn?t even start up and is in the BUILDING/SPAWNED state forever.

PCM (Paul Michali)

MAIL ?..?. pcm at cisco.com
IRC ??..? pc_m (irc.freenode.com)
TW ???... @pmichali
GPG Key ? 4525ECC253E31A83
Fingerprint .. 307A 96BB 1A4C D2C7 931D 8D2D 4525 ECC2 53E3 1A83

On Jan 2, 2015, at 10:43 AM, Ben Nemec wrote:

Signed PGP part
I ran into similar behavior once, and it turned out I was running out
of space on the system. This blog post helped me track down the
problem:
http://porkrind.org/missives/libvirt-based-qemu-vm-pausing-by-itself/

Not sure whether it's relevant to your situation, but it's something
to check.

-Ben

On 12/31/2014 09:41 AM, Paul Michali (pcm) wrote:

Not sure if I?m going crazy or what. I?m using DevStack and, after
stacking I tried booting a Cirros 3.2, 3.3, and Ubuntu cloud 14.04
image. Each time, the image ends up in PAUSED power state:

ubuntu at juno:/opt/stack/neutron$ nova show peter
+--------------------------------------+----------------------------------------------------------------+

| Property | Value
|

+--------------------------------------+----------------------------------------------------------------+

| OS-DCF:diskConfig | MANUAL
|

| OS-EXT-AZ:availabilityzone | nova
| | OS-EXT-SRV-ATTR:host | juno
| | OS-EXT-SRV-ATTR:hypervisor
hostname | juno
| | OS-EXT-SRV-ATTR:instancename | instance-00000001
| | OS-EXT-STS:power
state | 3
| | OS-EXT-STS:taskstate | -
| | OS-EXT-STS:vm
state | active
| | OS-SRV-USG:launchedat |
2014-12-31T15:15:33.000000 | |
OS-SRV-USG:terminated
at | -
| | accessIPv4 |
| | accessIPv6 |
| | configdrive |
| | created | 2014-12-31T15:15:24Z
| | flavor | m1.tiny (1)
| | hostId |
5b0c48250ccc0ac3fca8a821e29e4b154ec0b101f9cc0a0b27071a3f | |
id |
ec5c8d70-ae80-4cc3-a5bb-b68019170dd6 | |
image | cirros-0.3.3-x86
64-uec
(797e4dee-8c03-497f-8dac-a44b9351dfa3) | | keyname
| - |
| metadata | {}
| | name | peter
| | os-extended-volumes:volumes
attached | []
| | private network | 10.0.0.4
| | progress | 0
| | securitygroups | default
| | status | ACTIVE
| | tenant
id |
7afb5bc1d88d462c8d57178437d3c277 | |
updated | 2014-12-31T15:15:34Z
| | user_id |
4ff18bdbeb4d436ea4ff1bcd29e269a9 |
+--------------------------------------+----------------------------------------------------------------+

ubuntu at juno:/opt/stack/neutron$ nova list

+--------------------------------------+-------+--------+------------+-------------+------------------+

| ID | Name | Status | Task State |
Power State | Networks |

+--------------------------------------+-------+--------+------------+-------------+------------------+

| ec5c8d70-ae80-4cc3-a5bb-b68019170dd6 | peter | ACTIVE | - |
Paused | private=10.0.0.4 |

I don?t see this with Kilo latest images. Any idea what I may be
doing wrong, or if there is an issue (I didn?t see anything on
Google search)?

IMAGEID=nova image-list | grep 'cloudimg-amd64 ' | cut -d' ' -f 2 PRIVATENET=neutron net-list | grep 'private ' | cut -f 2 -d' ?

nova boot peter --flavor 3 --image $IMAGEID --user-data
~/devstack/user
data.txt --nic net-id=$PRIVATENET nova boot
--flavor 1 --image cirros-0.3.3-x86
64-uec --nic
net-id=$PRIVATE_NET paul

Thanks.

PCM (Paul Michali)

MAIL ?..?. pcm at cisco.com IRC ??..? pc_m (irc.freenode.com) TW
???... @pmichali GPG Key ? 4525ECC253E31A83 Fingerprint .. 307A
96BB 1A4C D2C7 931D 8D2D 4525 ECC2 53E3 1A83

_______________________________________________ OpenStack-dev
mailing list OpenStack-dev at lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


OpenStack-dev mailing list
OpenStack-dev at lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL:
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 842 bytes
Desc: Message signed with OpenPGP using GPGMail
URL:

responded Jan 2, 2015 by Paul_Michali_(pcm (3,280 points)   1 4 6
0 votes

Hi Kevin,

 If you are using KVM as hyper visor and if your compute node having 

any issues with kvm acceleration, it can lead to the below problem - So
ou can try changing the virt_type to qemu from kvm in /etc/nova/nova-
compute.conf . After restarting the nova compute service - try to launch
the vm again.

Regards,
Guna


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
responded Apr 3, 2015 by Guna (140 points)   1
...