2301-2350 of 10000 results (59ms)
2022-05-30 ยง
15:17 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1149 (T60674)', diff saved to https://phabricator.wikimedia.org/P29019 and previous config saved to /var/cache/conftool/dbconfig/20220530-151753-ladsgroup.json [production]
15:14 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1114', diff saved to https://phabricator.wikimedia.org/P29018 and previous config saved to /var/cache/conftool/dbconfig/20220530-151424-ladsgroup.json [production]
15:13 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1132', diff saved to https://phabricator.wikimedia.org/P29017 and previous config saved to /var/cache/conftool/dbconfig/20220530-151301-ladsgroup.json [production]
15:12 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1179 (T60674)', diff saved to https://phabricator.wikimedia.org/P29016 and previous config saved to /var/cache/conftool/dbconfig/20220530-151251-ladsgroup.json [production]
15:12 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1179.eqiad.wmnet with reason: Maintenance [production]
15:12 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1179.eqiad.wmnet with reason: Maintenance [production]
15:12 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1166 (T60674)', diff saved to https://phabricator.wikimedia.org/P29015 and previous config saved to /var/cache/conftool/dbconfig/20220530-151242-ladsgroup.json [production]
15:06 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on dbstore1003.eqiad.wmnet with reason: Maintenance [production]
15:06 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on dbstore1003.eqiad.wmnet with reason: Maintenance [production]
15:06 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1101:3317 (T60674)', diff saved to https://phabricator.wikimedia.org/P29014 and previous config saved to /var/cache/conftool/dbconfig/20220530-150612-ladsgroup.json [production]
15:02 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1149', diff saved to https://phabricator.wikimedia.org/P29013 and previous config saved to /var/cache/conftool/dbconfig/20220530-150248-ladsgroup.json [production]
14:59 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1114 (T309311)', diff saved to https://phabricator.wikimedia.org/P29012 and previous config saved to /var/cache/conftool/dbconfig/20220530-145919-ladsgroup.json [production]
14:57 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1132 (T60674)', diff saved to https://phabricator.wikimedia.org/P29011 and previous config saved to /var/cache/conftool/dbconfig/20220530-145756-ladsgroup.json [production]
14:57 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P29010 and previous config saved to /var/cache/conftool/dbconfig/20220530-145737-ladsgroup.json [production]
14:53 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1114 (T309311)', diff saved to https://phabricator.wikimedia.org/P29009 and previous config saved to /var/cache/conftool/dbconfig/20220530-145323-ladsgroup.json [production]
14:53 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1114.eqiad.wmnet with reason: Maintenance [production]
14:53 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1114.eqiad.wmnet with reason: Maintenance [production]
14:53 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1126 (T309311)', diff saved to https://phabricator.wikimedia.org/P29008 and previous config saved to /var/cache/conftool/dbconfig/20220530-145315-ladsgroup.json [production]
14:51 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1101:3317', diff saved to https://phabricator.wikimedia.org/P29007 and previous config saved to /var/cache/conftool/dbconfig/20220530-145107-ladsgroup.json [production]
14:47 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1149', diff saved to https://phabricator.wikimedia.org/P29006 and previous config saved to /var/cache/conftool/dbconfig/20220530-144743-ladsgroup.json [production]
14:42 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P29005 and previous config saved to /var/cache/conftool/dbconfig/20220530-144232-ladsgroup.json [production]
14:42 <moritzm> installing clamav security updates on otrs1001 [production]
14:38 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1126', diff saved to https://phabricator.wikimedia.org/P29004 and previous config saved to /var/cache/conftool/dbconfig/20220530-143810-ladsgroup.json [production]
14:36 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1101:3317', diff saved to https://phabricator.wikimedia.org/P29003 and previous config saved to /var/cache/conftool/dbconfig/20220530-143602-ladsgroup.json [production]
14:32 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1149 (T60674)', diff saved to https://phabricator.wikimedia.org/P29002 and previous config saved to /var/cache/conftool/dbconfig/20220530-143238-ladsgroup.json [production]
14:27 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1166 (T60674)', diff saved to https://phabricator.wikimedia.org/P29001 and previous config saved to /var/cache/conftool/dbconfig/20220530-142726-ladsgroup.json [production]
14:23 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1126', diff saved to https://phabricator.wikimedia.org/P28999 and previous config saved to /var/cache/conftool/dbconfig/20220530-142305-ladsgroup.json [production]
14:21 <marostegui@cumin1001> dbctl commit (dc=all): 'db1111 (re)pooling @ 100%: After migrating it to 10.6', diff saved to https://phabricator.wikimedia.org/P28998 and previous config saved to /var/cache/conftool/dbconfig/20220530-142105-root.json [production]
14:20 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1101:3317 (T60674)', diff saved to https://phabricator.wikimedia.org/P28997 and previous config saved to /var/cache/conftool/dbconfig/20220530-142057-ladsgroup.json [production]
14:20 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1166 (T60674)', diff saved to https://phabricator.wikimedia.org/P28996 and previous config saved to /var/cache/conftool/dbconfig/20220530-142047-ladsgroup.json [production]
14:20 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1166.eqiad.wmnet with reason: Maintenance [production]
14:20 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1166.eqiad.wmnet with reason: Maintenance [production]
14:20 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1175 (T60674)', diff saved to https://phabricator.wikimedia.org/P28995 and previous config saved to /var/cache/conftool/dbconfig/20220530-142039-ladsgroup.json [production]
14:13 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1132 (T60674)', diff saved to https://phabricator.wikimedia.org/P28994 and previous config saved to /var/cache/conftool/dbconfig/20220530-141320-ladsgroup.json [production]
14:13 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1132.eqiad.wmnet with reason: Maintenance [production]
14:13 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1132.eqiad.wmnet with reason: Maintenance [production]
14:08 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1126 (T309311)', diff saved to https://phabricator.wikimedia.org/P28993 and previous config saved to /var/cache/conftool/dbconfig/20220530-140800-ladsgroup.json [production]
14:06 <marostegui@cumin1001> dbctl commit (dc=all): 'db1111 (re)pooling @ 75%: After migrating it to 10.6', diff saved to https://phabricator.wikimedia.org/P28992 and previous config saved to /var/cache/conftool/dbconfig/20220530-140601-root.json [production]
14:05 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1175', diff saved to https://phabricator.wikimedia.org/P28991 and previous config saved to /var/cache/conftool/dbconfig/20220530-140534-ladsgroup.json [production]
14:02 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1126 (T309311)', diff saved to https://phabricator.wikimedia.org/P28990 and previous config saved to /var/cache/conftool/dbconfig/20220530-140207-ladsgroup.json [production]
14:02 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1126.eqiad.wmnet with reason: Maintenance [production]
14:02 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1126.eqiad.wmnet with reason: Maintenance [production]
14:02 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1178 (T309311)', diff saved to https://phabricator.wikimedia.org/P28989 and previous config saved to /var/cache/conftool/dbconfig/20220530-140159-ladsgroup.json [production]
13:59 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1139.eqiad.wmnet with reason: Maintenance [production]
13:59 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1139.eqiad.wmnet with reason: Maintenance [production]
13:59 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1184 (T60674)', diff saved to https://phabricator.wikimedia.org/P28988 and previous config saved to /var/cache/conftool/dbconfig/20220530-135935-ladsgroup.json [production]
13:56 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1101:3317 (T60674)', diff saved to https://phabricator.wikimedia.org/P28987 and previous config saved to /var/cache/conftool/dbconfig/20220530-135654-ladsgroup.json [production]
13:56 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1101.eqiad.wmnet with reason: Maintenance [production]
13:56 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1101.eqiad.wmnet with reason: Maintenance [production]
13:55 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1149 (T60674)', diff saved to https://phabricator.wikimedia.org/P28986 and previous config saved to /var/cache/conftool/dbconfig/20220530-135528-ladsgroup.json [production]