8601-8650 of 10000 results (47ms)
2021-01-22 ยง
11:36 <kormat@cumin1001> dbctl commit (dc=all): 'db1136 (re)pooling @ 75%: Reboot T272255', diff saved to https://phabricator.wikimedia.org/P13914 and previous config saved to /var/cache/conftool/dbconfig/20210122-113610-kormat.json [production]
11:31 <kormat@cumin1001> dbctl commit (dc=all): 'db1134 (re)pooling @ 75%: Reboot T272255', diff saved to https://phabricator.wikimedia.org/P13913 and previous config saved to /var/cache/conftool/dbconfig/20210122-113139-kormat.json [production]
11:30 <kormat@cumin1001> dbctl commit (dc=all): 'db1141 (re)pooling @ 50%: Reboot T272255', diff saved to https://phabricator.wikimedia.org/P13912 and previous config saved to /var/cache/conftool/dbconfig/20210122-113004-kormat.json [production]
11:26 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single for host mwdebug1003.eqiad.wmnet [production]
11:24 <kormat@cumin1001> dbctl commit (dc=all): 'es1023 depooling: enable report_host T271106', diff saved to https://phabricator.wikimedia.org/P13911 and previous config saved to /var/cache/conftool/dbconfig/20210122-112424-kormat.json [production]
11:24 <hnowlan> joining restbase2009-a to cluster [production]
11:21 <kormat@cumin1001> dbctl commit (dc=all): 'db1136 (re)pooling @ 50%: Reboot T272255', diff saved to https://phabricator.wikimedia.org/P13910 and previous config saved to /var/cache/conftool/dbconfig/20210122-112106-kormat.json [production]
11:17 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host urldownloader1001.wikimedia.org [production]
11:16 <kormat@cumin1001> dbctl commit (dc=all): 'db1134 (re)pooling @ 50%: Reboot T272255', diff saved to https://phabricator.wikimedia.org/P13909 and previous config saved to /var/cache/conftool/dbconfig/20210122-111635-kormat.json [production]
11:15 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single for host urldownloader1001.wikimedia.org [production]
11:15 <kormat@cumin1001> dbctl commit (dc=all): 'db1141 (re)pooling @ 25%: Reboot T272255', diff saved to https://phabricator.wikimedia.org/P13908 and previous config saved to /var/cache/conftool/dbconfig/20210122-111500-kormat.json [production]
11:11 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host urldownloader2001.wikimedia.org [production]
11:09 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single for host urldownloader2001.wikimedia.org [production]
11:06 <kormat@cumin1001> dbctl commit (dc=all): 'db1136 (re)pooling @ 25%: Reboot T272255', diff saved to https://phabricator.wikimedia.org/P13906 and previous config saved to /var/cache/conftool/dbconfig/20210122-110603-kormat.json [production]
11:05 <jbond42> deploy cairo updates to jessie [production]
11:02 <kormat@cumin1001> dbctl commit (dc=all): 'db1141 depooling: Rebooting for T272255', diff saved to https://phabricator.wikimedia.org/P13905 and previous config saved to /var/cache/conftool/dbconfig/20210122-110229-kormat.json [production]
11:02 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:30:00 on db1141.eqiad.wmnet with reason: Rebooting for T272255 [production]
11:02 <kormat@cumin1001> START - Cookbook sre.hosts.downtime for 1:30:00 on db1141.eqiad.wmnet with reason: Rebooting for T272255 [production]
11:01 <kormat@cumin1001> dbctl commit (dc=all): 'db1134 (re)pooling @ 25%: Reboot T272255', diff saved to https://phabricator.wikimedia.org/P13904 and previous config saved to /var/cache/conftool/dbconfig/20210122-110132-kormat.json [production]
10:59 <kormat@cumin1001> dbctl commit (dc=all): 'db1136 depooling: Rebooting for T272255', diff saved to https://phabricator.wikimedia.org/P13903 and previous config saved to /var/cache/conftool/dbconfig/20210122-105952-kormat.json [production]
10:59 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:30:00 on db1136.eqiad.wmnet with reason: Rebooting for T272255 [production]
10:59 <kormat@cumin1001> START - Cookbook sre.hosts.downtime for 1:30:00 on db1136.eqiad.wmnet with reason: Rebooting for T272255 [production]
10:59 <kormat@cumin1001> dbctl commit (dc=all): 'Temporarily add db1127 to api group T272255', diff saved to https://phabricator.wikimedia.org/P13902 and previous config saved to /var/cache/conftool/dbconfig/20210122-105921-kormat.json [production]
10:56 <kormat@cumin1001> dbctl commit (dc=all): 'db1134 depooling: Rebooting for T272255', diff saved to https://phabricator.wikimedia.org/P13901 and previous config saved to /var/cache/conftool/dbconfig/20210122-105636-kormat.json [production]
10:56 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:30:00 on db1134.eqiad.wmnet with reason: Rebooting for T272255 [production]
10:56 <kormat@cumin1001> START - Cookbook sre.hosts.downtime for 1:30:00 on db1134.eqiad.wmnet with reason: Rebooting for T272255 [production]
10:53 <kormat@cumin1001> dbctl commit (dc=all): 'Remove db1088 from api group T271106', diff saved to https://phabricator.wikimedia.org/P13900 and previous config saved to /var/cache/conftool/dbconfig/20210122-105345-kormat.json [production]
10:52 <kormat@cumin1001> dbctl commit (dc=all): 'db1130 (re)pooling @ 100%: Reboot T272255', diff saved to https://phabricator.wikimedia.org/P13899 and previous config saved to /var/cache/conftool/dbconfig/20210122-105244-kormat.json [production]
10:37 <kormat@cumin1001> dbctl commit (dc=all): 'db1130 (re)pooling @ 75%: Reboot T272255', diff saved to https://phabricator.wikimedia.org/P13898 and previous config saved to /var/cache/conftool/dbconfig/20210122-103741-kormat.json [production]
10:36 <kormat@cumin1001> dbctl commit (dc=all): 'db1093 (re)pooling @ 100%: Reboot T272255', diff saved to https://phabricator.wikimedia.org/P13897 and previous config saved to /var/cache/conftool/dbconfig/20210122-103609-kormat.json [production]
10:22 <kormat@cumin1001> dbctl commit (dc=all): 'db1130 (re)pooling @ 50%: Reboot T272255', diff saved to https://phabricator.wikimedia.org/P13895 and previous config saved to /var/cache/conftool/dbconfig/20210122-102237-kormat.json [production]
10:21 <kormat@cumin1001> dbctl commit (dc=all): 'db1093 (re)pooling @ 75%: Reboot T272255', diff saved to https://phabricator.wikimedia.org/P13894 and previous config saved to /var/cache/conftool/dbconfig/20210122-102105-kormat.json [production]
10:18 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host archiva1002.wikimedia.org [production]
10:16 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single for host archiva1002.wikimedia.org [production]
10:07 <kormat@cumin1001> dbctl commit (dc=all): 'db1130 (re)pooling @ 25%: Reboot T272255', diff saved to https://phabricator.wikimedia.org/P13893 and previous config saved to /var/cache/conftool/dbconfig/20210122-100734-kormat.json [production]
10:06 <kormat@cumin1001> dbctl commit (dc=all): 'db1093 (re)pooling @ 50%: Reboot T272255', diff saved to https://phabricator.wikimedia.org/P13892 and previous config saved to /var/cache/conftool/dbconfig/20210122-100602-kormat.json [production]
10:03 <kormat@cumin1001> dbctl commit (dc=all): 'db1130 depooling: Rebooting for T272255', diff saved to https://phabricator.wikimedia.org/P13891 and previous config saved to /var/cache/conftool/dbconfig/20210122-100307-kormat.json [production]
10:03 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:30:00 on db1130.eqiad.wmnet with reason: Rebooting for T272255 [production]
10:03 <kormat@cumin1001> START - Cookbook sre.hosts.downtime for 1:30:00 on db1130.eqiad.wmnet with reason: Rebooting for T272255 [production]
10:02 <kormat@cumin1001> dbctl commit (dc=all): 'Temporarily add db1110 to api group T272255', diff saved to https://phabricator.wikimedia.org/P13890 and previous config saved to /var/cache/conftool/dbconfig/20210122-100233-kormat.json [production]
09:52 <moritzm> uploaded cairo 1.14.0-2.1+deb8u2+wmf1 to apt.wikimedia.org [production]
09:50 <kormat@cumin1001> dbctl commit (dc=all): 'db1093 (re)pooling @ 25%: Reboot T272255', diff saved to https://phabricator.wikimedia.org/P13889 and previous config saved to /var/cache/conftool/dbconfig/20210122-095058-kormat.json [production]
09:44 <kormat@cumin1001> dbctl commit (dc=all): 'db1093 depooling: Rebooting for T272255', diff saved to https://phabricator.wikimedia.org/P13888 and previous config saved to /var/cache/conftool/dbconfig/20210122-094453-kormat.json [production]
09:44 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:30:00 on db1093.eqiad.wmnet with reason: Rebooting for T272255 [production]
09:44 <kormat@cumin1001> START - Cookbook sre.hosts.downtime for 1:30:00 on db1093.eqiad.wmnet with reason: Rebooting for T272255 [production]
09:43 <kormat@cumin1001> dbctl commit (dc=all): 'Temporarily add db1088 to api group T271106', diff saved to https://phabricator.wikimedia.org/P13887 and previous config saved to /var/cache/conftool/dbconfig/20210122-094337-kormat.json [production]
08:49 <moritzm> installing PIP security updates for stretch [production]
08:44 <moritzm> installing mutt updates for stretch [production]
08:35 <XioNoX> Remove BGP for Zayo transit in ulsfo, eqiad, eqord [production]
08:33 <elukey> update puppet compiler's facts [production]