3451-3500 of 10000 results (37ms)
2021-01-07 ยง
19:05 <urbanecm@deploy1001> Synchronized wmf-config/Wikibase.php: 90f98c6a049c69b70ab9cb78eb986f1ecf4ffc9b: Use DisabledSpecialPage to disable ItemDisambiguation (T271389) (duration: 01m 08s) [production]
18:49 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc2027.codfw.wmnet with reason: REIMAGE [production]
18:47 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1027.eqiad.wmnet with reason: REIMAGE [production]
18:46 <jiji@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mc2027.codfw.wmnet with reason: REIMAGE [production]
18:45 <jiji@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mc1027.eqiad.wmnet with reason: REIMAGE [production]
18:34 <volans@deploy1001> Finished deploy [homer/deploy@fe7acbc]: Release v0.2.6 (duration: 04m 25s) [production]
18:34 <James_F> Zuul: Provide experimental PHP 7.2-on-buster jobs T252434 [releng]
18:31 <James_F> Zuul: [labs/tools/massmailer] Add gate-and-submit-l10n jobs T271426 [releng]
18:30 <volans@deploy1001> Started deploy [homer/deploy@fe7acbc]: Release v0.2.6 [production]
18:22 <elukey> chown -R /tmp/analytics analytics:analytics-privatedata-users (tmp dir for data quality stats tables) [analytics]
18:21 <elukey> "sudo -u hdfs kerberos-run-command hdfs hdfs dfs -chown -R analytics:analytics-privatedata-users /wmf/data/wmf/data_quality_stats" [analytics]
18:10 <wikibugs> Updated channels.yaml to: cfb1075f65fe0d4b6b896492846891e24cc5dfd9 Cleanup no longer used projects [tools.wikibugs]
18:10 <elukey> disable temporarily hdfs-cleaner.timer to prevent /tmp/DataFrameToDruid to be dropped [analytics]
18:08 <elukey> chown -R /tmp/DataFrameToDruid analytics:druid (was: analytics:hdfs) on hdfs to temporarily unblock Hive2Druid jobs [analytics]
17:13 <wikibugs> Updated channels.yaml to: 07eb5156c9a035b4937a6269dc386d36d3726d18 Update name of SRE project in Phab [tools.wikibugs]
16:50 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 50s) [production]
16:47 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host [production]
16:46 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 05s) [production]
16:44 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host [production]
16:44 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 00m 08s) [production]
16:44 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host [production]
16:31 <elukey> remove /etc/mysql/conf.d/research-client.cnf from stat100x nodes [analytics]
16:16 <moritzm> installing xerces-c security updates on Buster [production]
16:01 <hashar> Tag Quibble 0.0.46 @ df9e75329ab # T225218 T266441 T263500 [releng]
15:53 <moritzm> installing xorg-server security updates on stretch [production]
15:48 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudweb2001-dev.wikimedia.org with reason: REIMAGE [production]
15:46 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on labweb1002.wikimedia.org with reason: REIMAGE [production]
15:45 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudweb2001-dev.wikimedia.org with reason: REIMAGE [production]
15:44 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on labweb1002.wikimedia.org with reason: REIMAGE [production]
15:40 <elukey> deprecate the 'reseachers' posix group for good [analytics]
15:19 <dcaro> Finished speed tests on cloudcephosd2001-dev, reprovisioning the osd.0 sdc (T271417) [admin]
15:14 <kormat@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:11 <kormat@cumin1001> START - Cookbook sre.dns.netbox [production]
15:10 <kormat@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
15:09 <moritzm> installing libmaxminddb security updates on stretch [production]
15:06 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 03m 34s) [production]
15:03 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host [production]
15:01 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 25s) [production]
14:59 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host [production]
14:58 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 00m 03s) [production]
14:58 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host [production]
14:58 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 04s) [production]
14:57 <kormat@cumin1001> START - Cookbook sre.ganeti.makevm [production]
14:56 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host [production]
14:54 <kormat@cumin1001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) [production]
14:54 <kormat@cumin1001> START - Cookbook sre.ganeti.makevm [production]
14:54 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 02m 05s) [production]
14:52 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels [production]
14:51 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 00m 04s) [production]
14:51 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels [production]