5651-5700 of 10000 results (93ms)
2019-05-30 ยง
11:07 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:07 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:05 <Urbanecm> EU SWAT finished [production]
11:04 <urbanecm@deploy1001> Synchronized wmf-config/abusefilter.php: [[:gerrit:Enable abusefilter blocking ability in plwiki]] (T224617) (duration: 00m 58s) [production]
11:00 <jijiki> Disable puppet on mw* servers to merge 507939 - T219150 [production]
10:59 <wm-bot> <jeanfred> Service stop, mv logs, service start for T224651 [tools.integraality]
10:48 <arturo> T224558 drop/build a VM for tools-worker-1002. It didn't like the sssd/sudo change :-( [tools]
10:42 <jynus> upgrade and restart db1117 (temporary proxy fail for passive host, reduced redundancy for m*) [production]
10:39 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:39 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:36 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:36 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:33 <arturo> T224558 switch tools-worker-1002 to sssd/sudo. Includes drain/depool/reboot/repool [tools]
10:32 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:32 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:28 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:28 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:28 <arturo> T224558 use hiera config in prefix tools-worker for sssd/sudo [tools]
10:27 <arturo> T224558 switch tools-worker-1001 to sssd/sudo. Includes drain/depool/reboot/repool [tools]
10:25 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:25 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:22 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:22 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:19 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:19 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:18 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:18 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:15 <jbond@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
10:15 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:09 <arturo> T224558 disable puppet in all tools-worker- nodes [tools]
10:07 <jynus> upgrade and restart test-s4 hosts (db1111, db1112) [production]
10:01 <arturo> T224558 add tools-worker-1029 to the nodes pool of k8s [tools]
09:58 <arturo> T224558 reboot tools-worker-1029 after puppet changes for sssd/sudo in jessie [tools]
09:42 <jynus> stop and upgrade db1102 [production]
09:32 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:32 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:31 <_joe_> depooling mw1261 for benchmarking for T224491 [production]
09:26 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1089 with low weight (duration: 00m 55s) [production]
08:54 <jynus> stop and restart db1089 for upgrade [production]
08:50 <onimisionipe> maps2001 postgres initialization - T224395 [production]
08:44 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1089 for maintenance (duration: 00m 57s) [production]
08:32 <jynus@deploy1001> Synchronized wmf-config/db-codfw.php: Repool db2087 for maintenance (duration: 01m 00s) [production]
08:10 <mobrovac> drop old Parsoid tables from cassandra -- T223998 [production]
07:40 <mobrovac@deploy1001> Finished deploy [restbase/deploy@92591a7]: Switch to OpenAPI v3 and drop page/html/title/revision/tid - T218218 T215956 (duration: 19m 28s) [production]
07:33 <_joe_> upgraded service-checker on icinga1001,2 [production]
07:21 <mobrovac@deploy1001> Started deploy [restbase/deploy@92591a7]: Switch to OpenAPI v3 and drop page/html/title/revision/tid - T218218 T215956 [production]
02:48 <legoktm> deploying https://gerrit.wikimedia.org/r/512474 https://gerrit.wikimedia.org/r/512507 https://gerrit.wikimedia.org/r/513153 https://gerrit.wikimedia.org/r/513157 https://gerrit.wikimedia.org/r/512729 https://gerrit.wikimedia.org/r/513206 https://gerrit.wikimedia.org/r/513214 https://gerrit.wikimedia.org/r/513217 https://gerrit.wikimedia.org/r/513218 https://gerrit.wikimedia.org/r/513211 [releng]
02:35 <legoktm> deployed https://gerrit.wikimedia.org/r/513129 https://gerrit.wikimedia.org/r/513071 [releng]
00:40 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Repool db2091 - T224393 (duration: 00m 56s) [production]
00:24 <mutante> re-enabling puppet on phab1001 now that it does not have the phab role anymore (T221389) [production]