|
2021-01-07
ยง
|
| 23:14 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@25ffdee]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 00s) |
[production] |
| 23:12 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@25ffdee]: trying to debug a compression error that doesn't happen on the test host |
[production] |
| 22:54 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 00m 04s) |
[production] |
| 22:54 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host |
[production] |
| 22:52 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 07m 44s) |
[production] |
| 22:44 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host |
[production] |
| 22:41 |
<andrew@deploy1001> |
Finished deploy [striker/deploy@e4db843]: striker -> labweb1002 (duration: 00m 04s) |
[production] |
| 22:41 |
<andrew@deploy1001> |
Started deploy [striker/deploy@e4db843]: striker -> labweb1002 |
[production] |
| 22:39 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 00m 06s) |
[production] |
| 22:39 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host |
[production] |
| 22:31 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 22:24 |
<robh@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 22:19 |
<andrew@cumin1001> |
conftool action : set/pooled=inactive; selector: name=labweb1002.wikimedia.org |
[production] |
| 22:12 |
<jhuneidi@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.36.0-wmf.25 refs T267418 |
[production] |
| 21:43 |
<jforrester@deploy1001> |
Synchronized php-1.36.0-wmf.25/extensions/CodeMirror/resources/ext.CodeMirror.js: T271457 Guard against WikiEditor being removed by the time the hook runs (duration: 01m 05s) |
[production] |
| 21:16 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on labweb1002.wikimedia.org with reason: REIMAGE |
[production] |
| 21:14 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on labweb1002.wikimedia.org with reason: REIMAGE |
[production] |
| 21:10 |
<jhuneidi@deploy1001> |
rebuilt and synchronized wikiversions files: Revert "group[2] wikis to 1.36.0-wmf.22" |
[production] |
| 20:54 |
<razzi@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 20:44 |
<razzi@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 20:43 |
<razzi@cumin1001> |
END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) |
[production] |
| 20:43 |
<Operator873> |
CVNBot8-10 & 19 restarted |
[cvn] |
| 20:40 |
<Operator873> |
restarted CVNBot15 |
[cvn] |
| 20:24 |
<razzi@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 20:08 |
<jhuneidi@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.36.0-wmf.25 refs T267418 |
[production] |
| 20:01 |
<bstorm> |
restarting haproxy on dbproxy1018 to pick up new config file |
[production] |
| 19:56 |
<mutante> |
removing mongodb PHP extension, config, package from mwdebug* hosts - T180761 |
[production] |
| 19:56 |
<urbanecm@deploy1001> |
Synchronized php-1.36.0-wmf.25/includes/DefaultSettings.php: 59866730ea7534db9e47ea308ba2a3c1807d5f11: Revert "Provide native support to dismiss sitenotice in core." (T271365; T259903; 3/3) (duration: 01m 03s) |
[production] |
| 19:55 |
<urbanecm@deploy1001> |
Synchronized php-1.36.0-wmf.25/resources/: 59866730ea7534db9e47ea308ba2a3c1807d5f11: Revert "Provide native support to dismiss sitenotice in core." (T271365; T259903; 2/3) (duration: 01m 05s) |
[production] |
| 19:53 |
<urbanecm@deploy1001> |
Synchronized php-1.36.0-wmf.25/includes/skins/: 59866730ea7534db9e47ea308ba2a3c1807d5f11: Revert "Provide native support to dismiss sitenotice in core." (T271365; T259903; 1/3) (duration: 01m 04s) |
[production] |
| 19:10 |
<urbanecm@deploy1001> |
Synchronized wmf-config/throttle.php: 8a849d90277b1e13154e87d812d64efc3a99c00a: throttle: Cleanup outdated rules (duration: 01m 06s) |
[production] |
| 19:05 |
<urbanecm@deploy1001> |
Synchronized wmf-config/Wikibase.php: 90f98c6a049c69b70ab9cb78eb986f1ecf4ffc9b: Use DisabledSpecialPage to disable ItemDisambiguation (T271389) (duration: 01m 08s) |
[production] |
| 18:49 |
<jiji@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc2027.codfw.wmnet with reason: REIMAGE |
[production] |
| 18:47 |
<jiji@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1027.eqiad.wmnet with reason: REIMAGE |
[production] |
| 18:46 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mc2027.codfw.wmnet with reason: REIMAGE |
[production] |
| 18:45 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mc1027.eqiad.wmnet with reason: REIMAGE |
[production] |
| 18:34 |
<volans@deploy1001> |
Finished deploy [homer/deploy@fe7acbc]: Release v0.2.6 (duration: 04m 25s) |
[production] |
| 18:34 |
<James_F> |
Zuul: Provide experimental PHP 7.2-on-buster jobs T252434 |
[releng] |
| 18:31 |
<James_F> |
Zuul: [labs/tools/massmailer] Add gate-and-submit-l10n jobs T271426 |
[releng] |
| 18:30 |
<volans@deploy1001> |
Started deploy [homer/deploy@fe7acbc]: Release v0.2.6 |
[production] |
| 18:22 |
<elukey> |
chown -R /tmp/analytics analytics:analytics-privatedata-users (tmp dir for data quality stats tables) |
[analytics] |
| 18:21 |
<elukey> |
"sudo -u hdfs kerberos-run-command hdfs hdfs dfs -chown -R analytics:analytics-privatedata-users /wmf/data/wmf/data_quality_stats" |
[analytics] |
| 18:10 |
<wikibugs> |
Updated channels.yaml to: cfb1075f65fe0d4b6b896492846891e24cc5dfd9 Cleanup no longer used projects |
[tools.wikibugs] |
| 18:10 |
<elukey> |
disable temporarily hdfs-cleaner.timer to prevent /tmp/DataFrameToDruid to be dropped |
[analytics] |
| 18:08 |
<elukey> |
chown -R /tmp/DataFrameToDruid analytics:druid (was: analytics:hdfs) on hdfs to temporarily unblock Hive2Druid jobs |
[analytics] |
| 17:13 |
<wikibugs> |
Updated channels.yaml to: 07eb5156c9a035b4937a6269dc386d36d3726d18 Update name of SRE project in Phab |
[tools.wikibugs] |
| 16:50 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 50s) |
[production] |
| 16:47 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host |
[production] |
| 16:46 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 05s) |
[production] |
| 16:44 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host |
[production] |