401-450 of 10000 results (25ms)
2020-12-03 ยง
20:08 <ryankemper> T269204 Re-imaging `wdqs2004` to upgrade it to buster: `sudo -i wmf-auto-reimage-host --conftool -p T269204 wdqs2004.codfw.wmnet` [production]
20:03 <hashar@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.36.0-wmf.20 [production]
19:58 <milimetric@deploy1001> Finished deploy [analytics/aqs/deploy@95d6432]: (no justification provided) (duration: 00m 23s) [production]
19:58 <milimetric@deploy1001> Started deploy [analytics/aqs/deploy@95d6432]: (no justification provided) [production]
19:57 <milimetric@deploy1001> Finished deploy [analytics/aqs/deploy@95d6432]: (no justification provided) (duration: 00m 19s) [production]
19:57 <shdubsh> restart logstash kafka in codfw - java updates [production]
19:57 <milimetric@deploy1001> Started deploy [analytics/aqs/deploy@95d6432]: (no justification provided) [production]
19:57 <hashar@deploy1001> Synchronized php-1.36.0-wmf.20/extensions/AbuseFilter/includes/FilterLookup.php: Use 'default' as default group when reading filters from history - T269314 (duration: 01m 05s) [production]
19:56 <milimetric@deploy1001> Started restart [analytics/aqs/deploy@95d6432]: (no justification provided) [production]
19:56 <milimetric@deploy1001> Started restart [analytics/aqs/deploy@95d6432]: (no justification provided) [production]
19:55 <milimetric@deploy1001> Started restart [analytics/aqs/deploy@95d6432]: (no justification provided) [production]
19:55 <milimetric@deploy1001> Started restart [analytics/aqs/deploy@95d6432]: (no justification provided) [production]
19:53 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
19:51 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
19:44 <shdubsh> restart logstash kafka in eqiad - java updates [production]
19:39 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
19:37 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:23 <Urbanecm> mwscript namespaceDupes.php --wiki=kuwiktionary --fix (T269319) [production]
19:18 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 6be070c6fdc4a80954d91c2d62dab5368260c5aa: Kurdish Wiktionary: Add WF namespace alias to NS_PROJECT (T269319) (duration: 01m 08s) [production]
19:17 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: name=parse2001.codfw.wmnet [production]
19:14 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: b7b946a64ba4dc0121732ca48699a897718f4584: Enable NewUserMessage for ptwiki (T269290) (duration: 01m 08s) [production]
19:11 <mutante> depooling parse2001 and repeating auto-reimage to see if ferm issue is repeatable (T268524) [production]
19:10 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=parse2001.codfw.wmnet [production]
19:09 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 06d9e8d3081de457974e4e95fada0a502a634dd9: Undeploy graphoid for phase 3 wikis (T259207) (duration: 01m 08s) [production]
18:41 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
18:39 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
18:17 <volans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:04 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
18:03 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
18:01 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
17:56 <robh@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:50 <robh@cumin1001> START - Cookbook sre.dns.netbox [production]
17:48 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:34 <robh@cumin1001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
17:33 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
17:32 <robh@cumin1001> START - Cookbook sre.dns.netbox [production]
17:00 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
17:00 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:57 <volans@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
16:55 <volans@cumin2001> START - Cookbook sre.hosts.downtime [production]
16:33 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:27 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
15:52 <effie> upgrading labweb* to ICU 63 - T264991 [production]
15:47 <moritzm> updated thirdparty/postgres96 to 9.6.20-1.pgdg100+1 9.6.17-2.pgdg100+1 [production]
15:45 <elukey> moved conf1005 to rack B3 - T267065 [production]
15:06 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
15:06 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
14:59 <jbond42> disable puppet fleet wide to role out puppetdb node-ttl change [production]
14:46 <effie> rolling depool and pool of parsoid servers [production]
14:34 <elukey> stop zookeeper and etcd on conf1005 as prep-step before rack move [production]