701-750 of 10000 results (28ms)
2020-11-04 ยง
11:54 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:54 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:53 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:53 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:52 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:52 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:51 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:51 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:47 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:47 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:32 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:32 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:25 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:25 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:05 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:05 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:03 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:03 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:03 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:02 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:01 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:01 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:27 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:27 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:23 <kormat@cumin1001> dbctl commit (dc=all): 'Repooling after reboot. T261389', diff saved to https://phabricator.wikimedia.org/P13185 and previous config saved to /var/cache/conftool/dbconfig/20201104-102341-kormat.json [production]
10:23 <Urbanecm> Start of `mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log` in a tmux session updateVarDumps at mwmaint1002 (wiki=fiwiki; T246539) [production]
10:17 <kormat@cumin1001> dbctl commit (dc=all): 'Rebooting for T261389', diff saved to https://phabricator.wikimedia.org/P13184 and previous config saved to /var/cache/conftool/dbconfig/20201104-101729-kormat.json [production]
10:17 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:17 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:17 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:17 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:08 <_joe_> restarting envoyproxy on all of restbase codfw, sending the command in parallel via cumin, to test poolcounter usage by the safe restart scripts [production]
10:05 <_joe_> restarting envoyproxy on restbase20{09,10} to test poolcounter usage by the safe restart scripts [production]
09:25 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:25 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:24 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:24 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:19 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.cf (exit_code=0) [production]
09:19 <ayounsi@cumin1001> START - Cookbook sre.network.cf [production]
09:01 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:01 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:00 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:00 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
08:44 <moritzm> uploaded freetype 2.5.2+deb8u4+wmf1 to apt.wikimedia.org/jessie-wikimedia [production]
08:00 <marostegui@cumin1001> dbctl commit (dc=all): 'es1028 (re)pooling @ 100%: Slowly pool es1028 after being recloned T261717', diff saved to https://phabricator.wikimedia.org/P13182 and previous config saved to /var/cache/conftool/dbconfig/20201104-080033-root.json [production]
08:00 <marostegui@cumin1001> dbctl commit (dc=all): 'es1027 (re)pooling @ 100%: Slowly pool es1027 after being recloned T261717', diff saved to https://phabricator.wikimedia.org/P13181 and previous config saved to /var/cache/conftool/dbconfig/20201104-080024-root.json [production]
07:59 <marostegui@cumin1001> dbctl commit (dc=all): 'es1026 (re)pooling @ 100%: Slowly pool es1026 after being recloned T261717', diff saved to https://phabricator.wikimedia.org/P13180 and previous config saved to /var/cache/conftool/dbconfig/20201104-075953-root.json [production]
07:45 <marostegui@cumin1001> dbctl commit (dc=all): 'es1028 (re)pooling @ 75%: Slowly pool es1028 after being recloned T261717', diff saved to https://phabricator.wikimedia.org/P13179 and previous config saved to /var/cache/conftool/dbconfig/20201104-074530-root.json [production]
07:45 <marostegui@cumin1001> dbctl commit (dc=all): 'es1027 (re)pooling @ 75%: Slowly pool es1027 after being recloned T261717', diff saved to https://phabricator.wikimedia.org/P13178 and previous config saved to /var/cache/conftool/dbconfig/20201104-074520-root.json [production]
07:44 <marostegui@cumin1001> dbctl commit (dc=all): 'es1026 (re)pooling @ 75%: Slowly pool es1026 after being recloned T261717', diff saved to https://phabricator.wikimedia.org/P13177 and previous config saved to /var/cache/conftool/dbconfig/20201104-074449-root.json [production]