551-600 of 10000 results (26ms)
2020-11-19 ยง
16:40 <hashar@deploy1001> Started deploy [gerrit/gerrit@5a41181]: Upgrade gerrit2001 to Gerrit 3.2.5 [production]
16:35 <elukey> roll restart hadoop workers for openjdk upgrades [production]
16:35 <elukey@cumin1001> START - Cookbook sre.hadoop.roll-restart-workers [production]
16:06 <elukey@cumin1001> END (PASS) - Cookbook sre.presto.roll-restart-workers (exit_code=0) [production]
15:58 <moritzm> installing jupyter-notebook security updates on an-coord* [production]
15:56 <elukey@cumin1001> START - Cookbook sre.presto.roll-restart-workers [production]
15:52 <bblack> dns*: upgrade to gdnsd-3.4.0 on remainder of the dns fleet' [production]
15:44 <bblack> dns3001: upgrade gdnsd to 3.4.0 [production]
15:43 <elukey@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
15:41 <bblack> dns1001: upgrade gdnsd to 3.4.0 [production]
15:40 <elukey@cumin1001> START - Cookbook sre.hosts.decommission [production]
15:40 <elukey@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
15:36 <bblack> dns3002: upgrade gdnsd to 3.4.0 [production]
15:36 <elukey@cumin1001> START - Cookbook sre.hosts.decommission [production]
15:36 <elukey@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
15:31 <bblack> authdns1001: upgrade gdnsd to 3.4.0 [production]
15:30 <elukey@cumin1001> START - Cookbook sre.hosts.decommission [production]
15:29 <elukey@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
15:26 <elukey@cumin1001> START - Cookbook sre.hosts.decommission [production]
15:25 <elukey@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
15:23 <elukey@cumin1001> START - Cookbook sre.hosts.decommission [production]
15:22 <elukey@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
15:18 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
15:18 <elukey@cumin1001> START - Cookbook sre.hosts.decommission [production]
15:17 <elukey@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
15:16 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
15:11 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
15:08 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
14:57 <moritzm> installing openldap security updates on buster (client side tools/libs, slapd already updated) [production]
14:54 <elukey@cumin1001> START - Cookbook sre.hosts.decommission [production]
14:53 <elukey@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
14:50 <elukey@cumin1001> START - Cookbook sre.hosts.decommission [production]
14:49 <elukey@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
14:47 <marostegui> Sanitize enwiki on clouddb1017 T267090 [production]
14:45 <elukey@cumin1001> START - Cookbook sre.hosts.decommission [production]
14:44 <elukey@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
14:43 <volans@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
14:41 <marostegui> Sanitize enwiki on clouddb1013 T267090 [production]
14:39 <volans@cumin1001> START - Cookbook sre.hosts.decommission [production]
14:36 <elukey@cumin1001> START - Cookbook sre.hosts.decommission [production]
14:29 <moritzm> rolling restart of app server canaries to pick up latest sec updates [production]
14:21 <moritzm> installing krb5 security updates on stretch [production]
14:02 <bblack> authdns2001: upgrade gdnsd to 3.4.0 [production]
13:45 <XioNoX> push current state of audited cloud-in4 filter - T264993 [production]
13:42 <moritzm> removing stray wireshark 2.2.6 wireshark libs on Stretch [production]
13:32 <moritzm> installing wireshark security updates [production]
13:30 <bblack> dns4002: upgrade gdnsd to 3.4.0 [production]
13:28 <bblack> reprepro: updated buster-wikimedia gdnsd package to 3.4.0-1~wmf1 [production]
12:43 <moritzm> installing libproxy security updates on stretch [production]
12:38 <marostegui> Stop mysql on db1106 to clone clouddb1013 and clouddb1017 T267090 [production]