|
2019-09-19
§
|
| 23:23 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 23:21 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 22:51 |
<ejegg> |
updated payments-wiki from adef0e858f to 939b771800 |
[production] |
| 22:34 |
<mutante> |
gerrit1001 - stopping puppet, removing gerrit IP from interface, rebooting |
[production] |
| 21:37 |
<niharika29@deploy1001> |
Synchronized wmf-config/VariantSettings.php: Enable special:mute on testwiki; T231577 (duration: 00m 56s) |
[production] |
| 20:15 |
<XioNoX> |
push firewall policies to pfw3-eqiad - T233325 |
[production] |
| 20:07 |
<XioNoX> |
push firewall policies to pfw3-codfw - T233325 |
[production] |
| 19:25 |
<twentyafterfour@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.34.0-wmf.23 refs T220748 |
[production] |
| 19:02 |
<twentyafterfour> |
There are currently no blockers for T220748 so I am preparing to deploy 1.34.0-wmf.23 to all wikis. |
[production] |
| 18:54 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw1298.eqiad.wmnet |
[production] |
| 18:14 |
<XioNoX> |
add TCP-MSS 1436 to cr2-eqiad external interfaces - T232602 |
[production] |
| 18:12 |
<XioNoX> |
add TCP-MSS 1436 to cr1-eqiad external interfaces - T232602 |
[production] |
| 18:01 |
<bblack> |
lvs2004 - restart pybal for deploy/test of https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/536324/ |
[production] |
| 17:55 |
<mutante> |
puppetmaster1001 - add mcrouter cert for mw1298.eqiad.wmnet (T192457) |
[production] |
| 17:52 |
<@> |
helmfile [STAGING] Ran 'apply' command on namespace 'wikifeeds' for release 'staging' . |
[production] |
| 17:48 |
<krinkle@deploy1001> |
Synchronized php-1.34.0-wmf.23/extensions/AbuseFilter/includes/: T156095, 32cf50453cd (duration: 01m 04s) |
[production] |
| 17:47 |
<arlolra@deploy1001> |
Finished deploy [parsoid/deploy@77630c5]: Updating Parsoid to 6bf23c2 (duration: 08m 52s) |
[production] |
| 17:43 |
<Krinkle> |
Move whisper/MediaWiki/wanobjectcache/revision_row_1/29 to whisper/MediaWiki/wanobjectcache/revision_row_1_29 on graphite1004 and graphite2003 (T232907) |
[production] |
| 17:38 |
<arlolra@deploy1001> |
Started deploy [parsoid/deploy@77630c5]: Updating Parsoid to 6bf23c2 |
[production] |
| 17:27 |
<bblack> |
lvs2006 - restart pybal for deploy/test of https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/536324/ |
[production] |
| 17:27 |
<krinkle@deploy1001> |
Synchronized php-1.34.0-wmf.23/includes/libs/objectcache/wancache: 2e910c9d3f8c04f7db, T232907 (duration: 01m 03s) |
[production] |
| 17:23 |
<bblack> |
lvs2005 - restart pybal for deploy/test of https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/536324/ |
[production] |
| 17:19 |
<bblack> |
lvs2006 - restart pybal for deploy/test of https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/536324/ |
[production] |
| 17:16 |
<bblack> |
lvs200[456] - puppet disabled for https://gerrit.wikimedia.org/r/536324 deploy/test |
[production] |
| 17:14 |
<mholloway-shell@deploy1001> |
Finished deploy [mobileapps/deploy@69b3737]: Update mobileapps to cfc3062 (duration: 05m 42s) |
[production] |
| 17:08 |
<mholloway-shell@deploy1001> |
Started deploy [mobileapps/deploy@69b3737]: Update mobileapps to cfc3062 |
[production] |
| 16:31 |
<_joe_> |
removed manually the purge_checkuser cron from mwmaint1002, to have puppet recreate it |
[production] |
| 16:20 |
<ejegg> |
updated fundraising CiviCRM from 90db6cb5a1 to 5def62ab05 |
[production] |
| 16:15 |
<papaul> |
shutting down scs-a1-codfw for replacement |
[production] |
| 15:26 |
<moritzm> |
repooling restbase2012 after completed Cassandra bootstrap T224553 |
[production] |
| 15:25 |
<jmm@puppetmaster1001> |
conftool action : set/pooled=no; selector: cluster=restbase,service=cassandra,dc=codfw,name=restbase2012.codfw.wmnet |
[production] |
| 15:25 |
<jmm@puppetmaster1001> |
conftool action : set/pooled=yes; selector: cluster=restbase,service=restbase-backend,dc=codfw,name=restbase2012.codfw.wmnet |
[production] |
| 15:25 |
<jmm@puppetmaster1001> |
conftool action : set/pooled=yes; selector: cluster=restbase,service=restbase-ssl,dc=codfw,name=restbase2012.codfw.wmnet |
[production] |
| 15:25 |
<jmm@puppetmaster1001> |
conftool action : set/pooled=yes; selector: cluster=restbase,service=restbase,dc=codfw,name=restbase2012.codfw.wmnet |
[production] |
| 15:06 |
<jmm@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) |
[production] |
| 15:05 |
<jmm@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 14:56 |
<mholloway-shell@deploy1001> |
Finished deploy [mobileapps/deploy@16a6af1]: Increase num_workers to (ncpu * 1.5) (T229286) (duration: 05m 39s) |
[production] |
| 14:51 |
<mholloway-shell@deploy1001> |
Started deploy [mobileapps/deploy@16a6af1]: Increase num_workers to (ncpu * 1.5) (T229286) |
[production] |
| 14:47 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@44f4c79]: Remove the TID suffix in the ETag, if present, take #3 (duration: 10m 42s) |
[production] |
| 14:37 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@44f4c79]: Remove the TID suffix in the ETag, if present, take #3 |
[production] |
| 14:36 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@44f4c79]: Remove the TID suffix in the ETag, if present, take #2 (duration: 08m 24s) |
[production] |
| 14:31 |
<mobrovac> |
bootstrap restbase2012-c -- T224553 |
[production] |
| 14:28 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@44f4c79]: Remove the TID suffix in the ETag, if present, take #2 |
[production] |
| 14:28 |
<mobrovac@deploy1001> |
deploy aborted: Remove the TID suffix in the ETag, if present - T230272 (duration: 11m 20s) |
[production] |
| 14:28 |
<sbassett> |
Deployed security patch for T224203 (php-1.34.0-wmf.23) |
[production] |