settingsLogin | Registersettings

[openstack-dev] [nova] placement/resource providers update 30

0 votes

Placement Update 30

What Matters Most

Claims in the scheduler has merged, but first there was much gnashing
of teeth and pulling of hair at the many twisted webs we've weaved in
the scheduler and the resource tracker. While the base functionality
is now in master, it's not certain that it perfectly manages
allocations, especially in the case of move operations. Gibi has
started some tests to explore this. So far they are revealing more
confusion:

 https://review.openstack.org/#/c/487958/

So it would be fair to say that what matters most right now is
experimenting to see if the scheduler, resource tracker, and placement
service are doing the right things across a broad swathe of scenarios
and where possible writing functional tests that cover those
scenarios.

I thought there were going to be some changes to the resource tracker
made overnight, related to ensuring allocations on the source and
destination of a move are managed correctly, but I don't see them yet.
If they get pushed up today can someone followup here with links,
please? Or if it was decided that nothing was required can someone
explain why?

What's Changed

Claims in the scheduler has merged:

 https://review.openstack.org/#/c/483566/

The PlacementFixture now uses wsgi-intercept instead of spawning an
eventlet server. It's hoped this will help limit unpredictability in
tests:

 https://review.openstack.org/486237

Help Wanted

Areas where volunteers are needed.

Main Themes

Claims in the Scheduler

Merged, and now being exposed to the hard cold light of reality.

Custom Resource Classes for Ironic

The spec is still pending, the work going ahead without it:

 https://review.openstack.org/#/c/481748/

Updating flavors to include the resource class was merged, but then a
better place to do it was decided, that's here:

 https://review.openstack.org/#/c/487954/

And a fix for a poorly behaving ironicclient:

 https://review.openstack.org/#/c/487925/

Traits

(This section is unchanged since last time, as claims wins the
priority race.)

The concept of traits now exists in the placement service, but
filtering resource providers on traits is in flux. With the advent
of /allocation_candidates as the primary scheduling interface, that
needs to support traits. Work for that is in a stack starting at

    https://review.openstack.org/#/c/478464/

It's not yet clear if we'll want to support traits at both
/allocationcandidates and /resourceproviders. I think we should,
but the immediate need is on /allocation_candidates.

There's some proposed code to get /resource_providers started:

    https://review.openstack.org/#/c/474602/

Shared Resource Providers

We decided that for the time being, /resourceproviders should not
return shared
providers. A query against it is specifically about
providers that can satisfy the query in themselves.

Given that, there's nothing currently to do with this, other than the
general experimentation mentioned elsewhere. Notably, it's currently
unclear (in the sense that we don't have tests that prove it) whether
the resource tracker is wired up properly to not clobber allocations
the scheduler made which contain shared providers.

Nested Resource Providers

Work is paused on nested resource providers.

      https://review.openstack.org/#/q/status:open+topic:bp/nested-resource-providers

Docs

Lots of placement-related api docs have merged or are in progress:

 https://review.openstack.org/#/q/status:open+topic:cd/placement-api-ref

Much of this is ready to go and just looking for a +W or a final +2
and +W.

Setting up the official publishing job for the api ref is on hold
until the content has been migrated to the locations specified by the
docs migration that is currently in progress:

 http://specs.openstack.org/openstack/docs-specs/specs/pike/os-manuals-migration.html

Some changes have been proposed to document the scheduler's
workflow, including visual aids, starting at:

 https://review.openstack.org/#/c/475810/

Other Code/Specs

End

Thanks for reading this far. I hope you reviewed some of the links
above. If not, please do. Otherwise no prize for you.

--
Chris Dent ┬──┬◡ノ(° -°ノ) https://anticdent.org/
freenode: cdent tw: @anticdent__________________________________________________________________________
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

asked Jul 28, 2017 in openstack-dev by cdent_plus_os_at_ant (12,800 points)   2 2 6

2 Responses

0 votes

On Fri, 28 Jul 2017, Chris Dent wrote:

I thought there were going to be some changes to the resource tracker
made overnight, related to ensuring allocations on the source and
destination of a move are managed correctly, but I don't see them yet.
If they get pushed up today can someone followup here with links,
please? Or if it was decided that nothing was required can someone
explain why?

It's in progress and will be attached to this bug:

 https://bugs.launchpad.net/nova/+bug/1707071

--
Chris Dent ┬──┬◡ノ(° -°ノ) https://anticdent.org/
freenode: cdent tw: @anticdent__________________________________________________________________________
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

responded Jul 28, 2017 by cdent_plus_os_at_ant (12,800 points)   2 2 6
0 votes

On 07/28/2017 09:47 AM, Chris Dent wrote:
On Fri, 28 Jul 2017, Chris Dent wrote:

I thought there were going to be some changes to the resource tracker
made overnight, related to ensuring allocations on the source and
destination of a move are managed correctly, but I don't see them yet.
If they get pushed up today can someone followup here with links,
please? Or if it was decided that nothing was required can someone
explain why?

It's in progress and will be attached to this bug:

 https://bugs.launchpad.net/nova/+bug/1707071

Fix up now: https://review.openstack.org/488510

Best,
-jay


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
responded Jul 28, 2017 by Jay_Pipes (59,760 points)   3 11 14
...