2019-05-30
ยง
|
11:07 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
11:07 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
11:05 |
<Urbanecm> |
EU SWAT finished |
[production] |
11:04 |
<urbanecm@deploy1001> |
Synchronized wmf-config/abusefilter.php: [[:gerrit:Enable abusefilter blocking ability in plwiki]] (T224617) (duration: 00m 58s) |
[production] |
11:00 |
<jijiki> |
Disable puppet on mw* servers to merge 507939 - T219150 |
[production] |
10:59 |
<wm-bot> |
<jeanfred> Service stop, mv logs, service start for T224651 |
[tools.integraality] |
10:48 |
<arturo> |
T224558 drop/build a VM for tools-worker-1002. It didn't like the sssd/sudo change :-( |
[tools] |
10:42 |
<jynus> |
upgrade and restart db1117 (temporary proxy fail for passive host, reduced redundancy for m*) |
[production] |
10:39 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
10:39 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
10:36 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
10:36 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
10:33 |
<arturo> |
T224558 switch tools-worker-1002 to sssd/sudo. Includes drain/depool/reboot/repool |
[tools] |
10:32 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
10:32 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
10:28 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
10:28 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
10:28 |
<arturo> |
T224558 use hiera config in prefix tools-worker for sssd/sudo |
[tools] |
10:27 |
<arturo> |
T224558 switch tools-worker-1001 to sssd/sudo. Includes drain/depool/reboot/repool |
[tools] |
10:25 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
10:25 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
10:22 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
10:22 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
10:19 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
10:19 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
10:18 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
10:18 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
10:15 |
<jbond@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
10:15 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
10:09 |
<arturo> |
T224558 disable puppet in all tools-worker- nodes |
[tools] |
10:07 |
<jynus> |
upgrade and restart test-s4 hosts (db1111, db1112) |
[production] |
10:01 |
<arturo> |
T224558 add tools-worker-1029 to the nodes pool of k8s |
[tools] |
09:58 |
<arturo> |
T224558 reboot tools-worker-1029 after puppet changes for sssd/sudo in jessie |
[tools] |
09:42 |
<jynus> |
stop and upgrade db1102 |
[production] |
09:32 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
09:32 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
09:31 |
<_joe_> |
depooling mw1261 for benchmarking for T224491 |
[production] |
09:26 |
<jynus@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1089 with low weight (duration: 00m 55s) |
[production] |
08:54 |
<jynus> |
stop and restart db1089 for upgrade |
[production] |
08:50 |
<onimisionipe> |
maps2001 postgres initialization - T224395 |
[production] |
08:44 |
<jynus@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1089 for maintenance (duration: 00m 57s) |
[production] |
08:32 |
<jynus@deploy1001> |
Synchronized wmf-config/db-codfw.php: Repool db2087 for maintenance (duration: 01m 00s) |
[production] |
08:10 |
<mobrovac> |
drop old Parsoid tables from cassandra -- T223998 |
[production] |
07:40 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@92591a7]: Switch to OpenAPI v3 and drop page/html/title/revision/tid - T218218 T215956 (duration: 19m 28s) |
[production] |
07:33 |
<_joe_> |
upgraded service-checker on icinga1001,2 |
[production] |
07:21 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@92591a7]: Switch to OpenAPI v3 and drop page/html/title/revision/tid - T218218 T215956 |
[production] |
02:48 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/512474 https://gerrit.wikimedia.org/r/512507 https://gerrit.wikimedia.org/r/513153 https://gerrit.wikimedia.org/r/513157 https://gerrit.wikimedia.org/r/512729 https://gerrit.wikimedia.org/r/513206 https://gerrit.wikimedia.org/r/513214 https://gerrit.wikimedia.org/r/513217 https://gerrit.wikimedia.org/r/513218 https://gerrit.wikimedia.org/r/513211 |
[releng] |
02:35 |
<legoktm> |
deployed https://gerrit.wikimedia.org/r/513129 https://gerrit.wikimedia.org/r/513071 |
[releng] |
00:40 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Repool db2091 - T224393 (duration: 00m 56s) |
[production] |
00:24 |
<mutante> |
re-enabling puppet on phab1001 now that it does not have the phab role anymore (T221389) |
[production] |