7401-7450 of 10000 results (37ms)
2020-07-31 §
17:25 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
17:21 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
17:21 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
17:13 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
17:13 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
17:12 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
17:11 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:24 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:22 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:22 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:20 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:32 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:30 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:52 <elukey> update cr1/cr2-eqiad's analytics filters (ref: https://gerrit.wikimedia.org/r/c/operations/homer/public/+/617649/) [production]
13:51 <moritzm> installing cups security updates (client-side tools/libs only) [production]
13:20 <moritzm> installing openjpeg2 security updates [production]
13:04 <kormat> proudly uploaded version 0.1 of python3-wmfmariadbpy + wmfmariadbpy [production]
11:55 <moritzm> installing mercurial security updates [production]
11:21 <jynus> restart dbstore1004 [production]
11:19 <moritzm> installing ffmpeg security updates for jessie (standard version from security.debian.org, not the VP9-enabled component) [production]
11:16 <moritzm> imported ffmpeg 3.2.15-0+deb9u1+wmf1 to component/vp9 for stretch-wikimedia T259336 [production]
07:51 <moritzm> updating lilypond on mw* servers [production]
07:50 <moritzm> uploaded lilypond 2.19.81+really-2.18.2-13~bpo9+1+wmf1 to stretch-wikimedia T256877 [production]
07:07 <elukey> stop mysql replication on db1108; update port config for mysql instances and restart them; restart replication on instances [production]
06:32 <elukey> roll restart of druid brokers on druid100[4-8] to pick up new changes [production]
06:26 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
06:26 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
05:59 <moritzm> installing qemu updates on stretch [production]
04:56 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
04:54 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
04:22 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
04:20 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
03:55 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
03:53 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
03:14 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
03:12 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
02:57 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
02:55 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
00:47 <tstarling@deploy1001> Synchronized wmf-config/CommonSettings.php: disable lilypond execution again (duration: 01m 10s) [production]
00:07 <catrope@deploy1001> Synchronized php-1.36.0-wmf.2/extensions/Echo/modules/mobile/notificationsFilterOverlay.js: T258954 (duration: 01m 06s) [production]
00:06 <catrope@deploy1001> Synchronized php-1.36.0-wmf.1/extensions/Echo/modules/mobile/notificationsFilterOverlay.js: T258954 (duration: 01m 10s) [production]
00:00 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=wtp2015.codfw.wmnet [production]
2020-07-30 §
23:56 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
23:56 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
22:59 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=wtp2014.codfw.wmnet [production]
22:34 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
22:34 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
22:27 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
22:27 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
22:12 <brennen@deploy1001> rebuilt and synchronized wikiversions files: Revert group2 wikis to 1.36.0-wmf.1 [production]