8701-8750 of 10000 results (54ms)
2020-11-30 ยง
23:08 <mutante> parse2001 - sudo -i /usr/local/sbin/restart-php7.2-fpm [production]
23:08 <mutante> sudo -i /usr/local/sbin/restart-php7.2-fpm [production]
23:07 <legoktm> deploying https://gerrit.wikimedia.org/r/644354 [releng]
22:57 <James_F> jjb: Updated all 197 (!) jobs that referred to REL1_34 for T268931 [releng]
22:45 <razzi@cumin1001> START - Cookbook sre.hosts.decommission [production]
22:42 <reedy@deploy1001> Synchronized wmf-config/CommonSettings.php: Remove 1.34 from $wgExtDistSnapshotRefs T268931 (duration: 00m 57s) [production]
22:34 <James_F> Docker: Bumping new PHP 8.0 images for leanness and AST-worthiness. [releng]
22:34 <razzi@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
22:21 <cdanis@deploy1001> Synchronized docroot/thankyou: Also serve apple-app-site-assoc file from /.well-known/ T259312 bc52d1481 (duration: 00m 57s) [production]
22:17 <James_F> Zuul: [mediawiki/extensions/GlobalWatchlist] Move to Wikimedia-deployed section T260862 [releng]
22:15 <razzi@cumin1001> START - Cookbook sre.hosts.decommission [production]
22:14 <razzi@cumin1001> START - Cookbook sre.ganeti.makevm [production]
22:14 <mutante> parse2001 - systemctl restart ferm - had to restart ferm after reimaging (though there weren't any alerts about that) but it fixed running httpbb tests on it (T268524) [production]
22:13 <ejegg> extended and re-synchronized timing of thank you mail sender and donation queue consumer [production]
21:57 <andrewbogott> deleting project; clearly unused [wdqs-scaling]
21:55 <andrewbogott> deleting project; clearly unused [orch]
21:51 <mutante> parse2001 - scap pull [production]
21:51 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=parse2001.codfw.wmnet [production]
21:46 <andrewbogott> deleting project as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#techblog [techblog]
21:45 <razzi@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
21:44 <andrewbogott> deleting project as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#grantreview [grantreview]
21:42 <andrewbogott> deleting project as per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2020_Purge#DELETE_sccache [sccache]
21:40 <andrewbogott> deleting project as per communication here with legoktm [butterfly]
21:38 <razzi@cumin1001> START - Cookbook sre.hosts.decommission [production]
21:27 <legoktm> building php8.0 images https://gerrit.wikimedia.org/r/643777 [releng]
21:00 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:58 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:58 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:55 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:47 <razzi@cumin1001> START - Cookbook sre.ganeti.makevm [production]
20:47 <pt1979@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:45 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:43 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
20:43 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:42 <mutante> reimaging deploy2002 with buster (not active, deploy1001/2001 are) T265963 [production]
20:39 <mutante> reimaging parse2001 (parsoid canary) with buster (T268524) [production]
20:36 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: name=parse2001.codfw.wmnet [production]
20:33 <mutante> depooling parse2001 to prepare for reimage T268524 [production]
20:32 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=parse2001.codfw.wmnet [production]
20:28 <mutante> reimaging deploy1002 with buster - not the active deployment server, deploy1001 still is (T265963) [production]
20:10 <ariel@deploy1001> Finished deploy [dumps/dumps@2f4d931]: per job batches for page content. step one. (duration: 00m 04s) [production]
20:10 <ariel@deploy1001> Started deploy [dumps/dumps@2f4d931]: per job batches for page content. step one. [production]
19:52 <papaul> power down ms-be2059 for RAID re-configuration [production]
19:47 <mutante> added Sukhbir to Ops vendor maintenance calendar permissions to make changes and share like all of SRE (T229860) [production]
19:23 <ppchelko@deploy1001> Synchronized wmf-config/CommonSettings.php: gerrit:644236 Decrease OAuth token expiration (duration: 00m 56s) [production]
19:17 <ppchelko@deploy1001> Synchronized wmf-config/InitialiseSettings.php: gerrit:644243 group2: switch ParserCache to JSON (duration: 00m 58s) [production]
19:14 <pt1979@cumin2001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
19:11 <James_F> Zuul: [mediawiki/extensions/WikimediaApiPortalOAuth] Mark as in-prod and enable coverage reports T262495 [releng]
19:09 <pt1979@cumin2001> START - Cookbook sre.dns.netbox [production]
18:22 <bstorm> 1.17 upgrade for kubernetes complete T268669 [paws]