5801-5850 of 10000 results (40ms)
2020-06-03 ยง
14:00 <hashar> Restarted CI Jenkins for plugin update [production]
13:59 <kormat@deploy1001> Synchronized wmf-config/db-eqiad.php: Replace pc1009 with pc1010 reimaging T252182 (duration: 01m 06s) [production]
13:47 <kormat> reimaging *pc1009 (promise) to buster T252182 [production]
13:44 <kormat> reimaging pc1007 to buster, wish me luck T252182 [production]
13:20 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . [production]
13:13 <kormat@deploy1001> Synchronized wmf-config/db-codfw.php: Put pc2009 back into pc3 after reimaging T252182 (duration: 01m 05s) [production]
13:01 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . [production]
12:01 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1080', diff saved to https://phabricator.wikimedia.org/P11385 and previous config saved to /var/cache/conftool/dbconfig/20200603-120136-marostegui.json [production]
11:57 <moritzm> updating linux-libc-dev on stretch and buster hosts [production]
11:56 <XioNoX> configure management-instance on cr1/2-eqiad - T247073 [production]
11:51 <XioNoX> configure management-instance on cr2-codfw - T247073 [production]
11:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2124 after MCR schema change', diff saved to https://phabricator.wikimedia.org/P11384 and previous config saved to /var/cache/conftool/dbconfig/20200603-114409-marostegui.json [production]
11:43 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1080', diff saved to https://phabricator.wikimedia.org/P11383 and previous config saved to /var/cache/conftool/dbconfig/20200603-114351-marostegui.json [production]
11:31 <Lucas_WMDE> EU SWAT done [production]
11:30 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ mwscript namespaceDupes.php eswiki --fix | tee T254077.fix [production]
11:29 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ mwscript namespaceDupes.php eswiki | tee T254077.dry-run [production]
11:27 <moritzm> installing rubygems-integration updates for Buster [production]
11:26 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:600979|[eswiki] Normalize talk namespaces for Anexo, Portal and Wikiproyecto (T254077)]] (duration: 01m 03s) [production]
11:25 <moritzm> install brltty updates on Buster [production]
11:23 <XioNoX> configure management-instance on cr1-codfw - T247073 [production]
11:19 <XioNoX> configure management-instance on cr1-eqsin - T247073 [production]
11:15 <moritzm> installing python-oslo.utils security updates [production]
11:12 <XioNoX> remove unused logical-systems from all MX204 routers - T247073 [production]
11:10 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2124', diff saved to https://phabricator.wikimedia.org/P11382 and previous config saved to /var/cache/conftool/dbconfig/20200603-111055-marostegui.json [production]
11:08 <marostegui> Add rev_id to revision table on db2124 - T238966 [production]
11:05 <moritzm> installing pango updates for buster [production]
10:42 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1091 - will be reimaged and moved to s1 T252512', diff saved to https://phabricator.wikimedia.org/P11381 and previous config saved to /var/cache/conftool/dbconfig/20200603-104251-marostegui.json [production]
10:14 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1080', diff saved to https://phabricator.wikimedia.org/P11380 and previous config saved to /var/cache/conftool/dbconfig/20200603-101426-marostegui.json [production]
09:38 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1080', diff saved to https://phabricator.wikimedia.org/P11378 and previous config saved to /var/cache/conftool/dbconfig/20200603-093810-marostegui.json [production]
09:28 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:25 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:21 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:18 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:10 <moritzm> upgrading mw1262-1265 to PHP 7.2.31 [production]
09:08 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:05 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:04 <marostegui> Reimage db1080 [production]
09:01 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1080 for reimage', diff saved to https://phabricator.wikimedia.org/P11376 and previous config saved to /var/cache/conftool/dbconfig/20200603-090143-marostegui.json [production]
08:42 <kormat@deploy1001> Synchronized wmf-config/db-codfw.php: Replace pc2009 with pc2010 while reimaging (duration: 01m 16s) [production]
08:19 <moritzm> upgrading mw1261 to PHP 7.2.31 [production]
08:16 <XioNoX> re-add ae2 physical interfaces to external group - T253970 [production]
08:09 <moritzm> upgrading remaining mwdebug* servers to PHP 7.2.31 [production]
08:08 <kormat> reimaging pc2009 to buster T252182 [production]
08:08 <XioNoX> remove ae2 physical interfaces from external group - T253970 [production]
07:52 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
07:51 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
07:48 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
07:45 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
07:44 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: name=mw218[0-6].codfw.wmnet [production]
07:36 <mutante> depooling mw2180 - mw2186 [production]