2551-2600 of 10000 results (50ms)
2022-03-30 ยง
05:51 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1181', diff saved to https://phabricator.wikimedia.org/P23717 and previous config saved to /var/cache/conftool/dbconfig/20220330-055145-ladsgroup.json [production]
05:50 <marostegui@cumin1001> dbctl commit (dc=all): 'db1131 (re)pooling @ 5%: After schema change', diff saved to https://phabricator.wikimedia.org/P23716 and previous config saved to /var/cache/conftool/dbconfig/20220330-055045-root.json [production]
05:45 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1160 (T298557)', diff saved to https://phabricator.wikimedia.org/P23715 and previous config saved to /var/cache/conftool/dbconfig/20220330-054548-marostegui.json [production]
05:45 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1160.eqiad.wmnet with reason: Maintenance [production]
05:45 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 8:00:00 on db1160.eqiad.wmnet with reason: Maintenance [production]
05:40 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1182', diff saved to https://phabricator.wikimedia.org/P23714 and previous config saved to /var/cache/conftool/dbconfig/20220330-054032-ladsgroup.json [production]
05:40 <marostegui@cumin1001> dbctl commit (dc=all): 'db1179 (re)pooling @ 10%: After downgrade', diff saved to https://phabricator.wikimedia.org/P23713 and previous config saved to /var/cache/conftool/dbconfig/20220330-054021-root.json [production]
05:37 <marostegui@cumin1001> dbctl commit (dc=all): 'db1160 (re)pooling @ 10%: After kernel upgrade', diff saved to https://phabricator.wikimedia.org/P23712 and previous config saved to /var/cache/conftool/dbconfig/20220330-053745-root.json [production]
05:36 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1181 (T298565)', diff saved to https://phabricator.wikimedia.org/P23711 and previous config saved to /var/cache/conftool/dbconfig/20220330-053640-ladsgroup.json [production]
05:25 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1182 (T298565)', diff saved to https://phabricator.wikimedia.org/P23710 and previous config saved to /var/cache/conftool/dbconfig/20220330-052525-ladsgroup.json [production]
05:25 <marostegui@cumin1001> dbctl commit (dc=all): 'db1179 (re)pooling @ 5%: After downgrade', diff saved to https://phabricator.wikimedia.org/P23709 and previous config saved to /var/cache/conftool/dbconfig/20220330-052516-root.json [production]
05:23 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1181 (T298565)', diff saved to https://phabricator.wikimedia.org/P23708 and previous config saved to /var/cache/conftool/dbconfig/20220330-052344-ladsgroup.json [production]
05:23 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]
05:23 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]
05:23 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1181 (T298565)', diff saved to https://phabricator.wikimedia.org/P23707 and previous config saved to /var/cache/conftool/dbconfig/20220330-052320-ladsgroup.json [production]
05:23 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1182 (T298565)', diff saved to https://phabricator.wikimedia.org/P23706 and previous config saved to /var/cache/conftool/dbconfig/20220330-052312-ladsgroup.json [production]
05:23 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1182.eqiad.wmnet with reason: Maintenance [production]
05:23 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1182.eqiad.wmnet with reason: Maintenance [production]
05:23 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance [production]
05:23 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance [production]
05:22 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1170:3312 (T298565)', diff saved to https://phabricator.wikimedia.org/P23705 and previous config saved to /var/cache/conftool/dbconfig/20220330-052259-ladsgroup.json [production]
05:22 <marostegui@cumin1001> dbctl commit (dc=all): 'db1160 (re)pooling @ 5%: After kernel upgrade', diff saved to https://phabricator.wikimedia.org/P23704 and previous config saved to /var/cache/conftool/dbconfig/20220330-052241-root.json [production]
05:15 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1160 for reboot', diff saved to https://phabricator.wikimedia.org/P23703 and previous config saved to /var/cache/conftool/dbconfig/20220330-051524-root.json [production]
05:10 <marostegui@cumin1001> dbctl commit (dc=all): 'db1179 (re)pooling @ 1%: After downgrade', diff saved to https://phabricator.wikimedia.org/P23702 and previous config saved to /var/cache/conftool/dbconfig/20220330-051012-root.json [production]
05:08 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1181', diff saved to https://phabricator.wikimedia.org/P23701 and previous config saved to /var/cache/conftool/dbconfig/20220330-050808-ladsgroup.json [production]
05:07 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1170:3312', diff saved to https://phabricator.wikimedia.org/P23700 and previous config saved to /var/cache/conftool/dbconfig/20220330-050754-ladsgroup.json [production]
05:04 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1179 for downgrade', diff saved to https://phabricator.wikimedia.org/P23699 and previous config saved to /var/cache/conftool/dbconfig/20220330-050406-root.json [production]
04:57 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1131 (T297189)', diff saved to https://phabricator.wikimedia.org/P23698 and previous config saved to /var/cache/conftool/dbconfig/20220330-045747-marostegui.json [production]
04:57 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1131.eqiad.wmnet with reason: Maintenance [production]
04:57 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 8:00:00 on db1131.eqiad.wmnet with reason: Maintenance [production]
04:53 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1181', diff saved to https://phabricator.wikimedia.org/P23697 and previous config saved to /var/cache/conftool/dbconfig/20220330-045303-ladsgroup.json [production]
04:52 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1170:3312', diff saved to https://phabricator.wikimedia.org/P23696 and previous config saved to /var/cache/conftool/dbconfig/20220330-045249-ladsgroup.json [production]
04:37 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1181 (T298565)', diff saved to https://phabricator.wikimedia.org/P23695 and previous config saved to /var/cache/conftool/dbconfig/20220330-043758-ladsgroup.json [production]
04:37 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1170:3312 (T298565)', diff saved to https://phabricator.wikimedia.org/P23694 and previous config saved to /var/cache/conftool/dbconfig/20220330-043744-ladsgroup.json [production]
04:35 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1170:3312 (T298565)', diff saved to https://phabricator.wikimedia.org/P23693 and previous config saved to /var/cache/conftool/dbconfig/20220330-043536-ladsgroup.json [production]
04:35 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1170.eqiad.wmnet with reason: Maintenance [production]
04:35 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1170.eqiad.wmnet with reason: Maintenance [production]
04:35 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1162 (T298565)', diff saved to https://phabricator.wikimedia.org/P23692 and previous config saved to /var/cache/conftool/dbconfig/20220330-043528-ladsgroup.json [production]
04:24 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1181 (T298565)', diff saved to https://phabricator.wikimedia.org/P23691 and previous config saved to /var/cache/conftool/dbconfig/20220330-042443-ladsgroup.json [production]
04:24 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]
04:24 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]
04:24 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1174 (T298565)', diff saved to https://phabricator.wikimedia.org/P23690 and previous config saved to /var/cache/conftool/dbconfig/20220330-042435-ladsgroup.json [production]
04:20 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1162', diff saved to https://phabricator.wikimedia.org/P23689 and previous config saved to /var/cache/conftool/dbconfig/20220330-042023-ladsgroup.json [production]
04:09 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1174', diff saved to https://phabricator.wikimedia.org/P23688 and previous config saved to /var/cache/conftool/dbconfig/20220330-040930-ladsgroup.json [production]
04:05 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1162', diff saved to https://phabricator.wikimedia.org/P23687 and previous config saved to /var/cache/conftool/dbconfig/20220330-040518-ladsgroup.json [production]
03:54 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1174', diff saved to https://phabricator.wikimedia.org/P23686 and previous config saved to /var/cache/conftool/dbconfig/20220330-035425-ladsgroup.json [production]
03:50 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1162 (T298565)', diff saved to https://phabricator.wikimedia.org/P23685 and previous config saved to /var/cache/conftool/dbconfig/20220330-035013-ladsgroup.json [production]
03:39 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1174 (T298565)', diff saved to https://phabricator.wikimedia.org/P23684 and previous config saved to /var/cache/conftool/dbconfig/20220330-033920-ladsgroup.json [production]
03:26 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1174 (T298565)', diff saved to https://phabricator.wikimedia.org/P23683 and previous config saved to /var/cache/conftool/dbconfig/20220330-032617-ladsgroup.json [production]
03:26 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1174.eqiad.wmnet with reason: Maintenance [production]