settingsLogin | Registersettings

[openstack-dev] [Nova] PCI CI is down

0 votes

Hey Nova,

It seems the a bug [1] sneaked in that made the PCI CI jobs fail 100% of
the time so they got turned off.

Fix for the bug should be making it's way through the queue soon, but it
was hinted on the review that there may be further problems. I'd like to
help fix these issues ASAP as the regression seems fairly fresh, but
debugging is hard since the CI is offline (instead of just non-voting)
so I can't really access any logs.

It'd be great if someone from the team helping out with the Intel PCI CI
would bring it back online as a non-voting job so that we can have
feedback which will surely help us fix it more quickly.

Cheers,
Nikola

[1] https://bugs.launchpad.net/nova/+bug/1535367


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
asked Jan 20, 2016 in openstack-dev by Nikola_Đipanov (5,400 points)   2 3 5

4 Responses

0 votes

Nikola,
I guess Mellanox CI ( running, failing , non-voting ) can assist on this issue.
Since we found it and opened a bug.

-----Original Message-----
From: Nikola Đipanov [mailto:ndipanov@redhat.com]
Sent: Wednesday, January 20, 2016 4:41 PM
To: OpenStack Development Mailing List openstack-dev@lists.openstack.org
Subject: [openstack-dev] [Nova] PCI CI is down

Hey Nova,

It seems the a bug [1] sneaked in that made the PCI CI jobs fail 100% of the time so they got turned off.

Fix for the bug should be making it's way through the queue soon, but it was hinted on the review that there may be further problems. I'd like to help fix these issues ASAP as the regression seems fairly fresh, but debugging is hard since the CI is offline (instead of just non-voting) so I can't really access any logs.

It'd be great if someone from the team helping out with the Intel PCI CI would bring it back online as a non-voting job so that we can have feedback which will surely help us fix it more quickly.

Cheers,
Nikola

[1] https://bugs.launchpad.net/nova/+bug/1535367


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
responded Jan 20, 2016 by Lenny_Verkhovsky (1,460 points)   1 4
0 votes

On 01/20/2016 03:03 PM, Lenny Verkhovsky wrote:
Nikola,
I guess Mellanox CI ( running, failing , non-voting ) can assist on this issue.
Since we found it and opened a bug.

Ah - I was not aware that they use the same hw/configuration. Will take
a look!

Thanks,
N.

-----Original Message-----
From: Nikola Đipanov [mailto:ndipanov@redhat.com]
Sent: Wednesday, January 20, 2016 4:41 PM
To: OpenStack Development Mailing List openstack-dev@lists.openstack.org
Subject: [openstack-dev] [Nova] PCI CI is down

Hey Nova,

It seems the a bug [1] sneaked in that made the PCI CI jobs fail 100% of the time so they got turned off.

Fix for the bug should be making it's way through the queue soon, but it was hinted on the review that there may be further problems. I'd like to help fix these issues ASAP as the regression seems fairly fresh, but debugging is hard since the CI is offline (instead of just non-voting) so I can't really access any logs.

It'd be great if someone from the team helping out with the Intel PCI CI would bring it back online as a non-voting job so that we can have feedback which will surely help us fix it more quickly.

Cheers,
Nikola

[1] https://bugs.launchpad.net/nova/+bug/1535367


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
responded Jan 20, 2016 by Nikola_Đipanov (5,400 points)   2 3 5
0 votes

On 01/20/2016 10:14 AM, Nikola Đipanov wrote:
On 01/20/2016 03:03 PM, Lenny Verkhovsky wrote:

Nikola,
I guess Mellanox CI ( running, failing , non-voting ) can assist on this issue.
Since we found it and opened a bug.

Ah - I was not aware that they use the same hw/configuration. Will take
a look!

Thanks,
N.

-----Original Message-----
From: Nikola Đipanov [mailto:ndipanov@redhat.com]
Sent: Wednesday, January 20, 2016 4:41 PM
To: OpenStack Development Mailing List openstack-dev@lists.openstack.org
Subject: [openstack-dev] [Nova] PCI CI is down

Hey Nova,

It seems the a bug [1] sneaked in that made the PCI CI jobs fail 100% of the time so they got turned off.

Fix for the bug should be making it's way through the queue soon, but it was hinted on the review that there may be further problems. I'd like to help fix these issues ASAP as the regression seems fairly fresh, but debugging is hard since the CI is offline (instead of just non-voting) so I can't really access any logs.

It'd be great if someone from the team helping out with the Intel PCI CI would bring it back online as a non-voting job so that we can have feedback which will surely help us fix it more quickly.

Cheers,
Nikola

[1] https://bugs.launchpad.net/nova/+bug/1535367

I am cc'ing the three contact email addresses for Intel PCI CI with my
reply. The addresses are found here:
https://wiki.openstack.org/wiki/ThirdPartySystems/Intel-PCI-CI

Hopefully one of the operators of this system gets in contact with you,
Nikola. Thank you for helping to resolve this issue.

Thank you, Lenny, for reporting it.

Thanks,
Anita.


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
responded Jan 20, 2016 by Anita_Kuno (21,320 points)   3 3 4
0 votes

This bug and another related block bug: https://bugs.launchpad.net/nova/+bug/1536509 been merged recently, PCI-CI now is back online.

Regards
Yongli He

-----Original Message-----
From: Nikola Đipanov [mailto:ndipanov@redhat.com]
Sent: Wednesday, January 20, 2016 10:41 PM
To: OpenStack Development Mailing List openstack-dev@lists.openstack.org
Subject: [openstack-dev] [Nova] PCI CI is down

Hey Nova,

It seems the a bug [1] sneaked in that made the PCI CI jobs fail 100% of the time so they got turned off.

Fix for the bug should be making it's way through the queue soon, but it was hinted on the review that there may be further problems. I'd like to help fix these issues ASAP as the regression seems fairly fresh, but debugging is hard since the CI is offline (instead of just non-voting) so I can't really access any logs.

It'd be great if someone from the team helping out with the Intel PCI CI would bring it back online as a non-voting job so that we can have feedback which will surely help us fix it more quickly.

Cheers,
Nikola

[1] https://bugs.launchpad.net/nova/+bug/1535367


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
responded Jan 27, 2016 by yongli_he (1,300 points)   1 2
...