|
2021-01-07
ยง
|
| 21:16 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on labweb1002.wikimedia.org with reason: REIMAGE |
[production] |
| 21:14 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on labweb1002.wikimedia.org with reason: REIMAGE |
[production] |
| 21:10 |
<jhuneidi@deploy1001> |
rebuilt and synchronized wikiversions files: Revert "group[2] wikis to 1.36.0-wmf.22" |
[production] |
| 20:54 |
<razzi@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 20:44 |
<razzi@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 20:43 |
<razzi@cumin1001> |
END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) |
[production] |
| 20:43 |
<Operator873> |
CVNBot8-10 & 19 restarted |
[cvn] |
| 20:40 |
<Operator873> |
restarted CVNBot15 |
[cvn] |
| 20:24 |
<razzi@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 20:08 |
<jhuneidi@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.36.0-wmf.25 refs T267418 |
[production] |
| 20:01 |
<bstorm> |
restarting haproxy on dbproxy1018 to pick up new config file |
[production] |
| 19:56 |
<mutante> |
removing mongodb PHP extension, config, package from mwdebug* hosts - T180761 |
[production] |
| 19:56 |
<urbanecm@deploy1001> |
Synchronized php-1.36.0-wmf.25/includes/DefaultSettings.php: 59866730ea7534db9e47ea308ba2a3c1807d5f11: Revert "Provide native support to dismiss sitenotice in core." (T271365; T259903; 3/3) (duration: 01m 03s) |
[production] |
| 19:55 |
<urbanecm@deploy1001> |
Synchronized php-1.36.0-wmf.25/resources/: 59866730ea7534db9e47ea308ba2a3c1807d5f11: Revert "Provide native support to dismiss sitenotice in core." (T271365; T259903; 2/3) (duration: 01m 05s) |
[production] |
| 19:53 |
<urbanecm@deploy1001> |
Synchronized php-1.36.0-wmf.25/includes/skins/: 59866730ea7534db9e47ea308ba2a3c1807d5f11: Revert "Provide native support to dismiss sitenotice in core." (T271365; T259903; 1/3) (duration: 01m 04s) |
[production] |
| 19:10 |
<urbanecm@deploy1001> |
Synchronized wmf-config/throttle.php: 8a849d90277b1e13154e87d812d64efc3a99c00a: throttle: Cleanup outdated rules (duration: 01m 06s) |
[production] |
| 19:05 |
<urbanecm@deploy1001> |
Synchronized wmf-config/Wikibase.php: 90f98c6a049c69b70ab9cb78eb986f1ecf4ffc9b: Use DisabledSpecialPage to disable ItemDisambiguation (T271389) (duration: 01m 08s) |
[production] |
| 18:49 |
<jiji@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc2027.codfw.wmnet with reason: REIMAGE |
[production] |
| 18:47 |
<jiji@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1027.eqiad.wmnet with reason: REIMAGE |
[production] |
| 18:46 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mc2027.codfw.wmnet with reason: REIMAGE |
[production] |
| 18:45 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mc1027.eqiad.wmnet with reason: REIMAGE |
[production] |
| 18:34 |
<volans@deploy1001> |
Finished deploy [homer/deploy@fe7acbc]: Release v0.2.6 (duration: 04m 25s) |
[production] |
| 18:34 |
<James_F> |
Zuul: Provide experimental PHP 7.2-on-buster jobs T252434 |
[releng] |
| 18:31 |
<James_F> |
Zuul: [labs/tools/massmailer] Add gate-and-submit-l10n jobs T271426 |
[releng] |
| 18:30 |
<volans@deploy1001> |
Started deploy [homer/deploy@fe7acbc]: Release v0.2.6 |
[production] |
| 18:22 |
<elukey> |
chown -R /tmp/analytics analytics:analytics-privatedata-users (tmp dir for data quality stats tables) |
[analytics] |
| 18:21 |
<elukey> |
"sudo -u hdfs kerberos-run-command hdfs hdfs dfs -chown -R analytics:analytics-privatedata-users /wmf/data/wmf/data_quality_stats" |
[analytics] |
| 18:10 |
<wikibugs> |
Updated channels.yaml to: cfb1075f65fe0d4b6b896492846891e24cc5dfd9 Cleanup no longer used projects |
[tools.wikibugs] |
| 18:10 |
<elukey> |
disable temporarily hdfs-cleaner.timer to prevent /tmp/DataFrameToDruid to be dropped |
[analytics] |
| 18:08 |
<elukey> |
chown -R /tmp/DataFrameToDruid analytics:druid (was: analytics:hdfs) on hdfs to temporarily unblock Hive2Druid jobs |
[analytics] |
| 17:13 |
<wikibugs> |
Updated channels.yaml to: 07eb5156c9a035b4937a6269dc386d36d3726d18 Update name of SRE project in Phab |
[tools.wikibugs] |
| 16:50 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 50s) |
[production] |
| 16:47 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host |
[production] |
| 16:46 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 05s) |
[production] |
| 16:44 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host |
[production] |
| 16:44 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 00m 08s) |
[production] |
| 16:44 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host |
[production] |
| 16:31 |
<elukey> |
remove /etc/mysql/conf.d/research-client.cnf from stat100x nodes |
[analytics] |
| 16:16 |
<moritzm> |
installing xerces-c security updates on Buster |
[production] |
| 16:01 |
<hashar> |
Tag Quibble 0.0.46 @ df9e75329ab # T225218 T266441 T263500 |
[releng] |
| 15:53 |
<moritzm> |
installing xorg-server security updates on stretch |
[production] |
| 15:48 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudweb2001-dev.wikimedia.org with reason: REIMAGE |
[production] |
| 15:46 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on labweb1002.wikimedia.org with reason: REIMAGE |
[production] |
| 15:45 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on cloudweb2001-dev.wikimedia.org with reason: REIMAGE |
[production] |
| 15:44 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on labweb1002.wikimedia.org with reason: REIMAGE |
[production] |
| 15:40 |
<elukey> |
deprecate the 'reseachers' posix group for good |
[analytics] |
| 15:19 |
<dcaro> |
Finished speed tests on cloudcephosd2001-dev, reprovisioning the osd.0 sdc (T271417) |
[admin] |
| 15:14 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 15:11 |
<kormat@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 15:10 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) |
[production] |