451-500 of 10000 results (43ms)
2020-12-09 ยง
20:26 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw128[1-3].eqiad.wmnet [production]
20:22 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1283.eqiad.wmnet [production]
20:22 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1282.eqiad.wmnet [production]
20:21 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1281.eqiad.wmnet [production]
20:18 <twentyafterfour> wmf.21 looks good on group1 wikis. Still seeing T269603 but not at an increased rate. (refs T264801) [production]
20:13 <twentyafterfour@deploy1001> Synchronized php: group1 wikis to 1.36.0-wmf.21 (duration: 01m 02s) [production]
20:12 <twentyafterfour@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.36.0-wmf.21 [production]
19:38 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: ce01bbe7b05eda8065fc57c865a69370e8aae797: Enable ArticlePlaceholder at papwiki (T223693) (duration: 01m 02s) [production]
19:17 <twentyafterfour@deploy1001> Synchronized php-1.36.0-wmf.21/includes/page/Article.php: deploy 0d99fe6d54 Article::view - remove the old subtitle from doOutputFromParserCache. Bug: T269727 (duration: 01m 04s) [production]
18:59 <mutante> testreduce1001 - installed make [production]
18:48 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:43 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
18:42 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
18:41 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
18:17 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: name=mw2243.codfw.wmnet [production]
18:16 <mutante> depooling mw2243 (jobrunner) for reimaging (T245757) [production]
18:15 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2243.codfw.wmnet [production]
18:12 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
18:11 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
18:05 <mutante> mw1281,mw1282,mw1283 shut down for T266164 [production]
18:02 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
18:02 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
18:02 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
18:02 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
18:01 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
18:01 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
17:59 <clarakosi@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . [production]
17:58 <clarakosi@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . [production]
17:57 <clarakosi@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . [production]
17:49 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: name=mw128[1-3].eqiad.wmnet [production]
17:24 <mutante> depooling 3 API appservers in eqiad to physically move to another rack [production]
17:23 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw128[1-3].eqiad.wmnet [production]
16:52 <mbsantos@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'mobileapps' for release 'production' . [production]
16:49 <mbsantos@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'production' . [production]
16:48 <mbsantos@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . [production]
16:10 <ema> deployment-cache-text06: deploy varnish 6.0.0-1wm1 T264398 [production]
16:06 <moritzm> updating mwdebug1003, parse2001, deploy1002, deploy2002 to wikidiff 1.10.0-1~wmf1+buster1 [production]
16:05 <moritzm> importing wikidiff2 1.10.0-1~wmf1+buster1 to component/php72 T250515 [production]
15:56 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: dc=eqiad,cluster=maps,service=kartotherian,name=maps1001.eqiad.wmnet [production]
15:47 <hnowlan> reimaging restbase2009 after disk replacement [production]
15:29 <moritzm> restarting nginx on htmldump1001 to pick up OpenSSL security updates [production]
13:54 <godog> experiment with rsync.service increased niceness on ms-be2057 - T269337 [production]
13:27 <jmm@cumin2001> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) [production]
13:25 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
13:03 <XioNoX> standardize Private-Peer BGP group on all cr* [production]
12:30 <hnowlan@puppetmaster1001> conftool action : set/pooled=no; selector: dc=eqiad,cluster=maps,service=kartotherian,name=maps1001.eqiad.wmnet [production]
12:29 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
12:29 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]
12:24 <Urbanecm> Eu B&C window done [production]
12:23 <urbanecm@deploy1001> Synchronized w/static.php: cfb36023ac873c00e680032999b7c21c2a105132: Remove unsupported arg in MediaWiki::doPostOutputShutdown() call (duration: 01m 02s) [production]