2701-2750 of 10000 results (77ms)
2022-09-07 ยง
07:52 <marostegui@cumin1001> dbctl commit (dc=all): 'db2146 (re)pooling @ 25%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34033 and previous config saved to /var/cache/conftool/dbconfig/20220907-075237-root.json [production]
07:52 <marostegui@cumin1001> dbctl commit (dc=all): 'db1172 (re)pooling @ 3%: Repooling after cloning another host', diff saved to https://phabricator.wikimedia.org/P34032 and previous config saved to /var/cache/conftool/dbconfig/20220907-075200-root.json [production]
07:49 <marostegui@cumin1001> dbctl commit (dc=all): 'db1196 (re)pooling @ 75%: Pooling for the first time', diff saved to https://phabricator.wikimedia.org/P34031 and previous config saved to /var/cache/conftool/dbconfig/20220907-074935-root.json [production]
07:48 <marostegui@cumin1001> dbctl commit (dc=all): 'db1197 (re)pooling @ 50%: Pooling for the first time', diff saved to https://phabricator.wikimedia.org/P34030 and previous config saved to /var/cache/conftool/dbconfig/20220907-074816-root.json [production]
07:47 <marostegui@cumin1001> dbctl commit (dc=all): 'db1199 (re)pooling @ 2%: Pooling for the first time in s4', diff saved to https://phabricator.wikimedia.org/P34029 and previous config saved to /var/cache/conftool/dbconfig/20220907-074746-root.json [production]
07:46 <marostegui@cumin1001> dbctl commit (dc=all): 'db1111 (re)pooling @ 100%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34028 and previous config saved to /var/cache/conftool/dbconfig/20220907-074636-root.json [production]
07:46 <topranks> Depool eqsin from user traffic in advance of core router upgrades - T295690 [production]
07:44 <jmm@cumin1001> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host cumin2002.codfw.wmnet [production]
07:40 <marostegui@cumin1001> dbctl commit (dc=all): 'db1174 (re)pooling @ 5%: Repooling after cloning another host', diff saved to https://phabricator.wikimedia.org/P34027 and previous config saved to /var/cache/conftool/dbconfig/20220907-074039-root.json [production]
07:38 <marostegui@cumin1001> dbctl commit (dc=all): 'db1198 (re)pooling @ 4%: Pooling for the first time in s3', diff saved to https://phabricator.wikimedia.org/P34026 and previous config saved to /var/cache/conftool/dbconfig/20220907-073800-root.json [production]
07:37 <marostegui@cumin1001> dbctl commit (dc=all): 'Pooling db1199 for the first time in s4 T316342', diff saved to https://phabricator.wikimedia.org/P34025 and previous config saved to /var/cache/conftool/dbconfig/20220907-073745-marostegui.json [production]
07:37 <marostegui@cumin1001> dbctl commit (dc=all): 'db2146 (re)pooling @ 10%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34024 and previous config saved to /var/cache/conftool/dbconfig/20220907-073732-root.json [production]
07:37 <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1199 to s4, depooled, T316342', diff saved to https://phabricator.wikimedia.org/P34023 and previous config saved to /var/cache/conftool/dbconfig/20220907-073727-marostegui.json [production]
07:36 <marostegui@cumin1001> dbctl commit (dc=all): 'db1172 (re)pooling @ 2%: Repooling after cloning another host', diff saved to https://phabricator.wikimedia.org/P34022 and previous config saved to /var/cache/conftool/dbconfig/20220907-073655-root.json [production]
07:34 <marostegui@cumin1001> dbctl commit (dc=all): 'db1196 (re)pooling @ 50%: Pooling for the first time', diff saved to https://phabricator.wikimedia.org/P34021 and previous config saved to /var/cache/conftool/dbconfig/20220907-073430-root.json [production]
07:33 <jmm@cumin1001> START - Cookbook sre.hosts.reboot-single for host cumin2002.codfw.wmnet [production]
07:33 <marostegui@cumin1001> dbctl commit (dc=all): 'db1197 (re)pooling @ 25%: Pooling for the first time', diff saved to https://phabricator.wikimedia.org/P34020 and previous config saved to /var/cache/conftool/dbconfig/20220907-073311-root.json [production]
07:32 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2140.codfw.wmnet with reason: Maintenance [production]
07:32 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2140.codfw.wmnet with reason: Maintenance [production]
07:31 <marostegui@cumin1001> dbctl commit (dc=all): 'db1111 (re)pooling @ 75%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34019 and previous config saved to /var/cache/conftool/dbconfig/20220907-073131-root.json [production]
07:28 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2095.codfw.wmnet with reason: Maintenance [production]
07:28 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2095.codfw.wmnet with reason: Maintenance [production]
07:22 <marostegui@cumin1001> dbctl commit (dc=all): 'db1198 (re)pooling @ 3%: Pooling for the first time in s3', diff saved to https://phabricator.wikimedia.org/P34018 and previous config saved to /var/cache/conftool/dbconfig/20220907-072255-root.json [production]
07:22 <marostegui@cumin1001> dbctl commit (dc=all): 'db2146 (re)pooling @ 5%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34017 and previous config saved to /var/cache/conftool/dbconfig/20220907-072214-root.json [production]
07:21 <marostegui@cumin1001> dbctl commit (dc=all): 'db1172 (re)pooling @ 1%: Repooling after cloning another host', diff saved to https://phabricator.wikimedia.org/P34016 and previous config saved to /var/cache/conftool/dbconfig/20220907-072151-root.json [production]
07:19 <marostegui@cumin1001> dbctl commit (dc=all): 'db1196 (re)pooling @ 25%: Pooling for the first time', diff saved to https://phabricator.wikimedia.org/P34015 and previous config saved to /var/cache/conftool/dbconfig/20220907-071925-root.json [production]
07:18 <marostegui@cumin1001> dbctl commit (dc=all): 'db1197 (re)pooling @ 10%: Pooling for the first time', diff saved to https://phabricator.wikimedia.org/P34014 and previous config saved to /var/cache/conftool/dbconfig/20220907-071806-root.json [production]
07:17 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2146 and db2122', diff saved to https://phabricator.wikimedia.org/P34013 and previous config saved to /var/cache/conftool/dbconfig/20220907-071744-root.json [production]
07:16 <marostegui@cumin1001> dbctl commit (dc=all): 'db1111 (re)pooling @ 50%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34012 and previous config saved to /var/cache/conftool/dbconfig/20220907-071627-root.json [production]
07:07 <marostegui@cumin1001> dbctl commit (dc=all): 'db1198 (re)pooling @ 2%: Pooling for the first time in s3', diff saved to https://phabricator.wikimedia.org/P34011 and previous config saved to /var/cache/conftool/dbconfig/20220907-070750-root.json [production]
07:04 <marostegui@cumin1001> dbctl commit (dc=all): 'db1196 (re)pooling @ 10%: Pooling for the first time', diff saved to https://phabricator.wikimedia.org/P34010 and previous config saved to /var/cache/conftool/dbconfig/20220907-070420-root.json [production]
07:03 <marostegui@cumin1001> dbctl commit (dc=all): 'db1197 (re)pooling @ 5%: Pooling for the first time', diff saved to https://phabricator.wikimedia.org/P34009 and previous config saved to /var/cache/conftool/dbconfig/20220907-070301-root.json [production]
07:01 <marostegui@cumin1001> dbctl commit (dc=all): 'db1111 (re)pooling @ 25%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34008 and previous config saved to /var/cache/conftool/dbconfig/20220907-070122-root.json [production]
06:49 <marostegui@cumin1001> dbctl commit (dc=all): 'db1196 (re)pooling @ 5%: Pooling for the first time', diff saved to https://phabricator.wikimedia.org/P34007 and previous config saved to /var/cache/conftool/dbconfig/20220907-064915-root.json [production]
06:48 <marostegui@cumin1001> dbctl commit (dc=all): 'Pooling db1198 for the first time in s3 T316342', diff saved to https://phabricator.wikimedia.org/P34006 and previous config saved to /var/cache/conftool/dbconfig/20220907-064831-marostegui.json [production]
06:47 <marostegui@cumin1001> dbctl commit (dc=all): 'db1197 (re)pooling @ 4%: Pooling for the first time', diff saved to https://phabricator.wikimedia.org/P34005 and previous config saved to /var/cache/conftool/dbconfig/20220907-064757-root.json [production]
06:46 <marostegui@cumin1001> dbctl commit (dc=all): 'db1111 (re)pooling @ 10%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34004 and previous config saved to /var/cache/conftool/dbconfig/20220907-064617-root.json [production]
06:45 <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1198 to s3, depooled, T316342', diff saved to https://phabricator.wikimedia.org/P34003 and previous config saved to /var/cache/conftool/dbconfig/20220907-064552-marostegui.json [production]
06:34 <marostegui@cumin1001> dbctl commit (dc=all): 'db1196 (re)pooling @ 4%: Pooling for the first time', diff saved to https://phabricator.wikimedia.org/P34002 and previous config saved to /var/cache/conftool/dbconfig/20220907-063410-root.json [production]
06:32 <marostegui@cumin1001> dbctl commit (dc=all): 'db1197 (re)pooling @ 3%: Pooling for the first time', diff saved to https://phabricator.wikimedia.org/P34001 and previous config saved to /var/cache/conftool/dbconfig/20220907-063252-root.json [production]
06:31 <marostegui@cumin1001> dbctl commit (dc=all): 'db1111 (re)pooling @ 5%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P34000 and previous config saved to /var/cache/conftool/dbconfig/20220907-063112-root.json [production]
06:19 <marostegui@cumin1001> dbctl commit (dc=all): 'db1196 (re)pooling @ 3%: Pooling for the first time', diff saved to https://phabricator.wikimedia.org/P33999 and previous config saved to /var/cache/conftool/dbconfig/20220907-061906-root.json [production]
06:17 <marostegui@cumin1001> dbctl commit (dc=all): 'db1197 (re)pooling @ 2%: Pooling for the first time', diff saved to https://phabricator.wikimedia.org/P33998 and previous config saved to /var/cache/conftool/dbconfig/20220907-061747-root.json [production]
06:16 <marostegui@cumin1001> dbctl commit (dc=all): 'db1111 (re)pooling @ 4%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P33997 and previous config saved to /var/cache/conftool/dbconfig/20220907-061607-root.json [production]
06:11 <marostegui@cumin1001> dbctl commit (dc=all): 'Pooling db1197 for the first time in s2 T316342', diff saved to https://phabricator.wikimedia.org/P33996 and previous config saved to /var/cache/conftool/dbconfig/20220907-061147-marostegui.json [production]
06:08 <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1197 to s2, depooled, T316342', diff saved to https://phabricator.wikimedia.org/P33995 and previous config saved to /var/cache/conftool/dbconfig/20220907-060828-marostegui.json [production]
06:04 <marostegui@cumin1001> dbctl commit (dc=all): 'db1196 (re)pooling @ 2%: Pooling for the first time', diff saved to https://phabricator.wikimedia.org/P33994 and previous config saved to /var/cache/conftool/dbconfig/20220907-060401-root.json [production]
06:01 <marostegui@cumin1001> dbctl commit (dc=all): 'db1111 (re)pooling @ 3%: Repooling after upgrade', diff saved to https://phabricator.wikimedia.org/P33993 and previous config saved to /var/cache/conftool/dbconfig/20220907-060102-root.json [production]
05:52 <marostegui@cumin1001> dbctl commit (dc=all): 'Pooling db1196 for the first time in s1 T316342', diff saved to https://phabricator.wikimedia.org/P33992 and previous config saved to /var/cache/conftool/dbconfig/20220907-055201-marostegui.json [production]
05:49 <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1196 to s1, depooled, T316342', diff saved to https://phabricator.wikimedia.org/P33991 and previous config saved to /var/cache/conftool/dbconfig/20220907-054910-marostegui.json [production]