|
2018-05-29
ยง
|
| 13:28 |
<volans> |
puppet run on failed hosts completed |
[production] |
| 13:25 |
<moritzm> |
powered down mw2182 for hardware diagnosis |
[production] |
| 13:19 |
<gehel> |
rolling restart of relforge for plugin upgrade - T193734 |
[production] |
| 13:16 |
<volans> |
running puppet on failed only hosts |
[production] |
| 13:12 |
<volans> |
stopped ircecho temporarily |
[production] |
| 12:54 |
<moritzm> |
installing xdg-utils security updates |
[production] |
| 12:42 |
<zeljkof> |
Reloading Zuul to deploy bcd36d9a2cd2b2ebb1ec77bdf0fcdcc612aeae8d |
[releng] |
| 11:21 |
<marostegui> |
Restar db1125 mysql - T195595 |
[production] |
| 11:14 |
<moritzm> |
upgrading snapshot hosts to hhvm-wikidiff 1.7.0 (HHVM is unused, just for completeness) |
[production] |
| 11:08 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Disable read only on s6 T194939 T187962 (duration: 01m 37s) |
[production] |
| 10:59 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Enable read only on s6 T194939 T187962 (duration: 01m 35s) |
[production] |
| 10:55 |
<XioNoX> |
Eqiad row C server move starting - T187962 |
[production] |
| 10:53 |
<XioNoX> |
Eqiad row C server move starting |
[production] |
| 10:35 |
<moritzm> |
upgrading mw1308-mw1311 to hhvm-wikidiff 1.7.0 (HHVM bytecode cache needs to be pruned during rollout) |
[production] |
| 10:30 |
<elukey> |
roll restart of druid-middlemanagers on druid* to pick up the new runtime settings (no more references to hadoop-client-cdh) |
[analytics] |
| 10:09 |
<mobrovac@tin> |
Synchronized wmf-config/InitialiseSettings.php: Switch all jobs to EventBus file 2/2 - T190327 T195500 (duration: 01m 47s) |
[production] |
| 10:06 |
<mobrovac@tin> |
Synchronized wmf-config/jobqueue.php: Switch all jobs to EventBus file 1/2 - T190327 T195500 (duration: 01m 39s) |
[production] |
| 10:05 |
<ppchelko@tin> |
Finished deploy [cpjobqueue/deploy@c6dc83d]: Enable all jobs apart from exceptions for everything. T190327 (duration: 00m 58s) |
[production] |
| 10:04 |
<ppchelko@tin> |
Started deploy [cpjobqueue/deploy@c6dc83d]: Enable all jobs apart from exceptions for everything. T190327 |
[production] |
| 10:04 |
<elukey> |
re-run pageview-druid-hourly-wf-2018-5-29-7 |
[analytics] |
| 09:20 |
<XioNoX> |
redirect ns0 to baham - T187962 |
[production] |
| 09:16 |
<XioNoX> |
disable ping1001 redirect - T187962 |
[production] |
| 09:13 |
<marostegui> |
Downtime s6 replicas for 4 hours - T195595 |
[production] |
| 09:07 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool all databases in row C - T187962 (duration: 01m 35s) |
[production] |
| 09:05 |
<moritzm> |
upgrading labweb servers to hhvm-wikidiff 1.7.0 (HHVM bytecode cache needs to be pruned during rollout) |
[production] |
| 08:40 |
<jynus> |
performing topology changes on s6 ahead of a possible failover |
[production] |
| 08:24 |
<moritzm> |
upgrading remaining API servers in eqiad to hhvm-wikidiff 1.7.0 (HHVM bytecode cache needs to be pruned during rollout) |
[production] |
| 07:56 |
<moritzm> |
upgrading mw1276-mw1290 to hhvm-wikidiff 1.7.0 (HHVM bytecode cache needs to be pruned during rollout) |
[production] |
| 07:49 |
<elukey> |
reimage druid1002 to debian stretch |
[production] |
| 07:47 |
<gilles@tin> |
Synchronized wmf-config/InitialiseSettings.php: T187299 Launch performance survey on ruwiki (duration: 01m 50s) |
[production] |
| 07:36 |
<hashar> |
cleaning up some caches on castor02.integration.eqiad.wmflabs (under /srv/jenkins-workspace/caches/ ) |
[releng] |
| 07:26 |
<moritzm> |
upgrading remaining app servers in eqiad to hhvm-wikidiff 1.7.0 (HHVM bytecode cache needs to be pruned during rollout) |
[production] |
| 07:05 |
<elukey> |
re-run webrequest-load-wf-text-2018-5-29-1 |
[analytics] |
| 06:52 |
<elukey> |
roll restart hadoop master daemons to pick up the new zookeeper settings |
[production] |
| 06:12 |
<legoktm> |
deployed https://gerrit.wikimedia.org/r/435961 |
[releng] |
| 05:20 |
<marostegui> |
Restart MySQL on db2045 (s8 codfw master) - T195598 |
[production] |
| 05:13 |
<marostegui> |
Stop MySQL on db2094 and db2095 for testing - T190704 |
[production] |
| 04:47 |
<legoktm> |
building https://gerrit.wikimedia.org/r/430037 |
[releng] |
| 04:12 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Tue May 29 04:12:10 UTC 2018 (duration 14m 32s) |
[production] |
| 03:57 |
<l10nupdate@tin> |
scap sync-l10n completed (1.32.0-wmf.5) (duration: 14m 29s) |
[production] |
| 02:59 |
<l10nupdate@tin> |
scap sync-l10n completed (1.32.0-wmf.4) (duration: 13m 18s) |
[production] |
| 01:57 |
<legoktm> |
deployed https://gerrit.wikimedia.org/r/435952 |
[releng] |
| 01:34 |
<legoktm> |
deployed https://gerrit.wikimedia.org/r/435950 |
[releng] |
| 01:31 |
<legoktm> |
deployed https://gerrit.wikimedia.org/r/435949 |
[releng] |
| 01:27 |
<legoktm> |
deployed https://gerrit.wikimedia.org/r/435948 |
[releng] |
| 01:16 |
<legoktm> |
deployed https://gerrit.wikimedia.org/r/435706 https://gerrit.wikimedia.org/r/435707 https://gerrit.wikimedia.org/r/434799 |
[releng] |
| 01:02 |
<legoktm> |
deployed https://gerrit.wikimedia.org/r/435946 |
[releng] |
| 01:00 |
<legoktm> |
deployed https://gerrit.wikimedia.org/r/435945 |
[releng] |
| 00:44 |
<legoktm> |
deployed https://gerrit.wikimedia.org/r/435943 |
[releng] |
| 00:14 |
<legoktm> |
deployed https://gerrit.wikimedia.org/r/435939 |
[releng] |