settingsLogin | Registersettings

[openstack-dev] [all] review.openstack.org downtime and Gerrit upgrade

0 votes

Hello,

The Infra team is planning to upgrade review.openstack.org from Gerrit
2.11 to Gerrit 2.13 on September 18, 2017. This downtime will begin at
1500UTC and is expected to take many hours as we have to perform an
offline update of Gerrit's secondary indexes. The outage should be
complete by 2359UTC.

This upgrade is a relatively minor one for users. You'll find that
mobile use of Gerrit is slightly better (though still not great). The
bug that forces us to reapply Approval votes rather than just rechecking
has also been addressed. If you'd like to test out Gerrit 2.13 you can
do so at https://review-dev.openstack.org.

The date we have chosen is the Monday after the PTG. The
expectation/hope is that many people will still be traveling or
otherwise recovering from the PTG so demand for Gerrit will be low. By
doing it on Monday we also hope that there will be load on the service
the following day which should help shake out any issues quickly (in the
past we've done it on weekends then had to wait a couple days before
problems are noticed).

If you have any concerns or feedback please let the Infra team know.

Thank you,
Clark


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
asked Sep 20, 2017 in openstack-dev by Clark_Boylan (8,800 points)   1 2 4

18 Responses

0 votes

hi Clark,

Do you have any plans to update to 2.14 release which has a new polymer
based user interface?

2017-08-03 1:57 GMT+03:00 Clark Boylan cboylan@sapwetik.org:

Hello,

The Infra team is planning to upgrade review.openstack.org from Gerrit
2.11 to Gerrit 2.13 on September 18, 2017. This downtime will begin at
1500UTC and is expected to take many hours as we have to perform an
offline update of Gerrit's secondary indexes. The outage should be
complete by 2359UTC.

This upgrade is a relatively minor one for users. You'll find that
mobile use of Gerrit is slightly better (though still not great). The
bug that forces us to reapply Approval votes rather than just rechecking
has also been addressed. If you'd like to test out Gerrit 2.13 you can
do so at https://review-dev.openstack.org.

The date we have chosen is the Monday after the PTG. The
expectation/hope is that many people will still be traveling or
otherwise recovering from the PTG so demand for Gerrit will be low. By
doing it on Monday we also hope that there will be load on the service
the following day which should help shake out any issues quickly (in the
past we've done it on weekends then had to wait a couple days before
problems are noticed).

If you have any concerns or feedback please let the Infra team know.

Thank you,
Clark


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

--
Best regards,
Andrey Kurilin.


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
responded Aug 3, 2017 by andr.kurilin_at_gmai (300 points)  
0 votes

On 03.08.2017 00:57, Clark Boylan wrote:
Hello,

The Infra team is planning to upgrade review.openstack.org from Gerrit
2.11 to Gerrit 2.13 on September 18, 2017.
[...]

If you have any concerns or feedback please let the Infra team know.

Thank you,
Clark

Does this maybe include the "hashtag" feature [1] to assign a custom
taxonomy to changes? We talked about that back in 2015 [2].
After reading [3] I was still a little clueless, TBH.

[1] https://en.wikipedia.org/wiki/Tag_(metadata)
[2]
http://lists.openstack.org/pipermail/openstack-dev/2015-November/079835.html
[3] https://phabricator.wikimedia.org/T37534

--
Regards, Markus Zoeller (markus_z)


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
responded Aug 3, 2017 by mzoeller_at_linux.vn (3,220 points)   3 5
0 votes

On Thu, Aug 3, 2017, at 03:04 AM, Andrey Kurilin wrote:
hi Clark,

Do you have any plans to update to 2.14 release which has a new polymer
based user interface?

We decided to not try and go straight to 2.14 because it requires newer
java and introduces the notedb which is a fairly large change in how
Gerrit stores information. The hope is that by going to 2.13 we can get
an upgrade done more quickly which can then hopefully snowball into an
easier upgrade to 2.14 in the not too distant future.

Once 2.13 is done my goal is to upgrade the database behind Gerrit and
the base operating system which will put us in good position to upgrade
to 2.14. But it is still too early to know how quickly that can all
happen.

Clark


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
responded Aug 3, 2017 by Clark_Boylan (8,800 points)   1 2 4
0 votes

On Thu, Aug 3, 2017, at 09:11 AM, Markus Zoeller wrote:
On 03.08.2017 00:57, Clark Boylan wrote:

Hello,

The Infra team is planning to upgrade review.openstack.org from Gerrit
2.11 to Gerrit 2.13 on September 18, 2017.
[...]

If you have any concerns or feedback please let the Infra team know.

Thank you,
Clark

Does this maybe include the "hashtag" feature [1] to assign a custom
taxonomy to changes? We talked about that back in 2015 [2].
After reading [3] I was still a little clueless, TBH.

[1] https://en.wikipedia.org/wiki/Tag_(metadata)
[2]
http://lists.openstack.org/pipermail/openstack-dev/2015-November/079835.html
[3] https://phabricator.wikimedia.org/T37534

My understanding is that the Gerrit hashtag feature requires notedb
which is part of the 2.14 release not the 2.13 release. We won't have it
after this upgrade but should have it once we get to 2.14.

Clark


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
responded Aug 3, 2017 by Clark_Boylan (8,800 points)   1 2 4
0 votes

On Wed, Aug 2, 2017, at 03:57 PM, Clark Boylan wrote:
Hello,

The Infra team is planning to upgrade review.openstack.org from Gerrit
2.11 to Gerrit 2.13 on September 18, 2017. This downtime will begin at
1500UTC and is expected to take many hours as we have to perform an
offline update of Gerrit's secondary indexes. The outage should be
complete by 2359UTC.

This upgrade is a relatively minor one for users. You'll find that
mobile use of Gerrit is slightly better (though still not great). The
bug that forces us to reapply Approval votes rather than just rechecking
has also been addressed. If you'd like to test out Gerrit 2.13 you can
do so at https://review-dev.openstack.org.

The date we have chosen is the Monday after the PTG. The
expectation/hope is that many people will still be traveling or
otherwise recovering from the PTG so demand for Gerrit will be low. By
doing it on Monday we also hope that there will be load on the service
the following day which should help shake out any issues quickly (in the
past we've done it on weekends then had to wait a couple days before
problems are noticed).

If you have any concerns or feedback please let the Infra team know.

Thank you,
Clark

This is a friendly reminder that we will be upgrading Gerrit on
review.openstack.org the Monday after PTG. Expect a prolonged service
outage. Once again let us know if you have any questions or concerns.

Thank you,
Clark


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
responded Aug 23, 2017 by Clark_Boylan (8,800 points)   1 2 4
0 votes

On Wed, Aug 2, 2017, at 03:57 PM, Clark Boylan wrote:
Hello,

The Infra team is planning to upgrade review.openstack.org from Gerrit
2.11 to Gerrit 2.13 on September 18, 2017. This downtime will begin at
1500UTC and is expected to take many hours as we have to perform an
offline update of Gerrit's secondary indexes. The outage should be
complete by 2359UTC.

This upgrade is a relatively minor one for users. You'll find that
mobile use of Gerrit is slightly better (though still not great). The
bug that forces us to reapply Approval votes rather than just rechecking
has also been addressed. If you'd like to test out Gerrit 2.13 you can
do so at https://review-dev.openstack.org.

The date we have chosen is the Monday after the PTG. The
expectation/hope is that many people will still be traveling or
otherwise recovering from the PTG so demand for Gerrit will be low. By
doing it on Monday we also hope that there will be load on the service
the following day which should help shake out any issues quickly (in the
past we've done it on weekends then had to wait a couple days before
problems are noticed).

If you have any concerns or feedback please let the Infra team know.

As a friendly reminder we are planning to move ahead with this upgrade
on Monday at 1500UTC. We are reviewing the process and getting some
final preparations done on our last day at the PTG.

Thank you for your patience,
Clark


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
responded Sep 15, 2017 by Clark_Boylan (8,800 points)   1 2 4
0 votes

Just a friendly reminder that the upgrade will happen TODAY, Monday
18th, starting at 15:00 UTC. The infra team expects that it takes 8
hours, so until 2359 UTC.

For details, see Clark's announcement below:

On 2017-09-15 23:52, Clark Boylan wrote:
On Wed, Aug 2, 2017, at 03:57 PM, Clark Boylan wrote:

Hello,

The Infra team is planning to upgrade review.openstack.org from Gerrit
2.11 to Gerrit 2.13 on September 18, 2017. This downtime will begin at
1500UTC and is expected to take many hours as we have to perform an
offline update of Gerrit's secondary indexes. The outage should be
complete by 2359UTC.

This upgrade is a relatively minor one for users. You'll find that
mobile use of Gerrit is slightly better (though still not great). The
bug that forces us to reapply Approval votes rather than just rechecking
has also been addressed. If you'd like to test out Gerrit 2.13 you can
do so at https://review-dev.openstack.org.

The date we have chosen is the Monday after the PTG. The
expectation/hope is that many people will still be traveling or
otherwise recovering from the PTG so demand for Gerrit will be low. By
doing it on Monday we also hope that there will be load on the service
the following day which should help shake out any issues quickly (in the
past we've done it on weekends then had to wait a couple days before
problems are noticed).

If you have any concerns or feedback please let the Infra team know.

As a friendly reminder we are planning to move ahead with this upgrade
on Monday at 1500UTC. We are reviewing the process and getting some
final preparations done on our last day at the PTG.

Thank you for your patience,
Clark

Andreas
--
Andreas Jaeger aj@{suse.com,opensuse.org} Twitter: jaegerandi
SUSE LINUX GmbH, Maxfeldstr. 5, 90409 Nürnberg, Germany
GF: Felix Imendörffer, Jane Smithard, Graham Norton,
HRB 21284 (AG Nürnberg)
GPG fingerprint = 93A3 365E CE47 B889 DF7F FED1 389A 563C C272 A126


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
responded Sep 18, 2017 by Andreas_Jaeger (17,140 points)   2 3 4
0 votes

On Mon, Sep 18, 2017, at 06:43 AM, Andreas Jaeger wrote:
Just a friendly reminder that the upgrade will happen TODAY, Monday
18th, starting at 15:00 UTC. The infra team expects that it takes 8
hours, so until 2359 UTC.

This work was functionally completed at 23:43 UTC. We are now running
Gerrit 2.13.9. There are some cleanup steps that need to be performed in
Infra land, mostly to get puppet running properly again.

You will also notice that newer Gerrit behaves in some new and exciting
ways. Most of these should be improvements like not needing to reapprove
changes that already have a +1 Workflow but also have a +1 Verified;
recheck should now work for these cases. If you find a new behavior that
looks like a bug please let us know, but we should also work to file
them upstream so that newer Gerrit can address them.

Feel free to ask us questions if anything else comes up.

Thank you to everyone that helped with the upgrade. Seems like these get
more and more difficult with each Gerrit release so all the help is
greatly appreciated.

Clark


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
responded Sep 18, 2017 by Clark_Boylan (8,800 points)   1 2 4
0 votes

On Tue, Sep 19, 2017 at 12:58 AM Clark Boylan cboylan@sapwetik.org wrote:

On Mon, Sep 18, 2017, at 06:43 AM, Andreas Jaeger wrote:

Just a friendly reminder that the upgrade will happen TODAY, Monday
18th, starting at 15:00 UTC. The infra team expects that it takes 8
hours, so until 2359 UTC.

This work was functionally completed at 23:43 UTC. We are now running
Gerrit 2.13.9. There are some cleanup steps that need to be performed in
Infra land, mostly to get puppet running properly again.

Thanks Clark and the infra team for the hard on this!

You will also notice that newer Gerrit behaves in some new and exciting
ways. Most of these should be improvements like not needing to reapprove
changes that already have a +1 Workflow but also have a +1 Verified;
recheck should now work for these cases. If you find a new behavior that
looks like a bug please let us know, but we should also work to file
them upstream so that newer Gerrit can address them.

The "review-inbox-dashboard
https://review.openstack.org/#/projects/openstack-dev/devstack,dashboards/important-changes:review-inbox-dashboard"
dashboards
seems not be working anymore - at least they show up empty for a few
projects I tried [0][1][2][3].

Andrea Frittoli (andreaf)

[0] Tempest:
https://review.openstack.org/#/projects/openstack/tempest,dashboards/important-changes:review-inbox-dashboard

[1] subunit2sql:
https://review.openstack.org/#/projects/openstack-infra/subunit2sql,dashboards/important-changes:review-inbox-dashboard

[2] devstack:
https://review.openstack.org/#/projects/openstack-dev/devstack,dashboards/important-changes:review-inbox-dashboard

[3] nova:
https://review.openstack.org/#/projects/openstack/nova,dashboards/important-changes:review-inbox-dashboard

Feel free to ask us questions if anything else comes up.

Thank you to everyone that helped with the upgrade. Seems like these get
more and more difficult with each Gerrit release so all the help is
greatly appreciated.

Clark


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
responded Sep 19, 2017 by Andrea_Frittoli (5,920 points)   1 2 3
0 votes

Two things currently:

  • no post jobs are run, I suggest to not tag anything

  • I don't get emails from gerrit anymore

Andreas
--
Andreas Jaeger aj@{suse.com,opensuse.org} Twitter: jaegerandi
SUSE LINUX GmbH, Maxfeldstr. 5, 90409 Nürnberg, Germany
GF: Felix Imendörffer, Jane Smithard, Graham Norton,
HRB 21284 (AG Nürnberg)
GPG fingerprint = 93A3 365E CE47 B889 DF7F FED1 389A 563C C272 A126


OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
responded Sep 19, 2017 by Andreas_Jaeger (17,140 points)   2 3 4
...