|
2020-12-09
ยง
|
| 21:40 |
<bstorm> |
shutting down labstore1006 for maintenance T268285 |
[production] |
| 20:27 |
<mutante> |
mw1281,mw1282,mw1283 - scap pull |
[production] |
| 20:26 |
<mutante> |
repooling mw1281,mw1282,mw1283 - now in rack A8 |
[production] |
| 20:26 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw128[1-3].eqiad.wmnet |
[production] |
| 20:22 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw1283.eqiad.wmnet |
[production] |
| 20:22 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw1282.eqiad.wmnet |
[production] |
| 20:21 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw1281.eqiad.wmnet |
[production] |
| 20:18 |
<twentyafterfour> |
wmf.21 looks good on group1 wikis. Still seeing T269603 but not at an increased rate. (refs T264801) |
[production] |
| 20:13 |
<twentyafterfour@deploy1001> |
Synchronized php: group1 wikis to 1.36.0-wmf.21 (duration: 01m 02s) |
[production] |
| 20:12 |
<twentyafterfour@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.36.0-wmf.21 |
[production] |
| 19:38 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: ce01bbe7b05eda8065fc57c865a69370e8aae797: Enable ArticlePlaceholder at papwiki (T223693) (duration: 01m 02s) |
[production] |
| 19:17 |
<twentyafterfour@deploy1001> |
Synchronized php-1.36.0-wmf.21/includes/page/Article.php: deploy 0d99fe6d54 Article::view - remove the old subtitle from doOutputFromParserCache. Bug: T269727 (duration: 01m 04s) |
[production] |
| 18:59 |
<mutante> |
testreduce1001 - installed make |
[production] |
| 18:48 |
<cmjohnson@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 18:43 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 18:42 |
<cmjohnson@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 18:41 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 18:17 |
<dzahn@cumin1001> |
conftool action : set/pooled=inactive; selector: name=mw2243.codfw.wmnet |
[production] |
| 18:16 |
<mutante> |
depooling mw2243 (jobrunner) for reimaging (T245757) |
[production] |
| 18:15 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw2243.codfw.wmnet |
[production] |
| 18:12 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 18:11 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 18:05 |
<mutante> |
mw1281,mw1282,mw1283 shut down for T266164 |
[production] |
| 18:02 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 18:02 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 18:02 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 18:02 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 18:01 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 18:01 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 17:59 |
<clarakosi@deploy1001> |
helmfile [codfw] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . |
[production] |
| 17:58 |
<clarakosi@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . |
[production] |
| 17:57 |
<clarakosi@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . |
[production] |
| 17:49 |
<dzahn@cumin1001> |
conftool action : set/pooled=inactive; selector: name=mw128[1-3].eqiad.wmnet |
[production] |
| 17:24 |
<mutante> |
depooling 3 API appservers in eqiad to physically move to another rack |
[production] |
| 17:23 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw128[1-3].eqiad.wmnet |
[production] |
| 16:52 |
<mbsantos@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'mobileapps' for release 'production' . |
[production] |
| 16:49 |
<mbsantos@deploy1001> |
helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'production' . |
[production] |
| 16:48 |
<mbsantos@deploy1001> |
helmfile [staging] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . |
[production] |
| 16:10 |
<ema> |
deployment-cache-text06: deploy varnish 6.0.0-1wm1 T264398 |
[production] |
| 16:06 |
<moritzm> |
updating mwdebug1003, parse2001, deploy1002, deploy2002 to wikidiff 1.10.0-1~wmf1+buster1 |
[production] |
| 16:05 |
<moritzm> |
importing wikidiff2 1.10.0-1~wmf1+buster1 to component/php72 T250515 |
[production] |
| 15:56 |
<hnowlan@puppetmaster1001> |
conftool action : set/pooled=yes; selector: dc=eqiad,cluster=maps,service=kartotherian,name=maps1001.eqiad.wmnet |
[production] |
| 15:47 |
<hnowlan> |
reimaging restbase2009 after disk replacement |
[production] |
| 15:29 |
<moritzm> |
restarting nginx on htmldump1001 to pick up OpenSSL security updates |
[production] |
| 13:54 |
<godog> |
experiment with rsync.service increased niceness on ms-be2057 - T269337 |
[production] |
| 13:27 |
<jmm@cumin2001> |
END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) |
[production] |
| 13:25 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 13:03 |
<XioNoX> |
standardize Private-Peer BGP group on all cr* |
[production] |
| 12:30 |
<hnowlan@puppetmaster1001> |
conftool action : set/pooled=no; selector: dc=eqiad,cluster=maps,service=kartotherian,name=maps1001.eqiad.wmnet |
[production] |
| 12:29 |
<hnowlan@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |