2023-08-22
§
|
03:11 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1130', diff saved to https://phabricator.wikimedia.org/P50717 and previous config saved to /var/cache/conftool/dbconfig/20230822-031156-ladsgroup.json |
[production] |
03:09 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db1175 (T344589)', diff saved to https://phabricator.wikimedia.org/P50716 and previous config saved to /var/cache/conftool/dbconfig/20230822-030911-ladsgroup.json |
[production] |
03:09 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1175.eqiad.wmnet with reason: Maintenance |
[production] |
03:08 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1175.eqiad.wmnet with reason: Maintenance |
[production] |
03:08 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1166 (T344589)', diff saved to https://phabricator.wikimedia.org/P50715 and previous config saved to /var/cache/conftool/dbconfig/20230822-030847-ladsgroup.json |
[production] |
03:08 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2111 (T343718)', diff saved to https://phabricator.wikimedia.org/P50714 and previous config saved to /var/cache/conftool/dbconfig/20230822-030823-ladsgroup.json |
[production] |
03:05 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db2127 (T344589)', diff saved to https://phabricator.wikimedia.org/P50713 and previous config saved to /var/cache/conftool/dbconfig/20230822-030526-ladsgroup.json |
[production] |
03:05 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2127.codfw.wmnet with reason: Maintenance |
[production] |
03:05 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2127.codfw.wmnet with reason: Maintenance |
[production] |
03:05 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2109 (T344589)', diff saved to https://phabricator.wikimedia.org/P50712 and previous config saved to /var/cache/conftool/dbconfig/20230822-030501-ladsgroup.json |
[production] |
03:02 |
<mwpresync@deploy1002> |
Started scap: testwikis wikis to 1.41.0-wmf.23 refs T343725 |
[production] |
02:56 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1130', diff saved to https://phabricator.wikimedia.org/P50711 and previous config saved to /var/cache/conftool/dbconfig/20230822-025650-ladsgroup.json |
[production] |
02:53 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P50710 and previous config saved to /var/cache/conftool/dbconfig/20230822-025341-ladsgroup.json |
[production] |
02:49 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2109', diff saved to https://phabricator.wikimedia.org/P50709 and previous config saved to /var/cache/conftool/dbconfig/20230822-024954-ladsgroup.json |
[production] |
02:48 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db2111 (T343718)', diff saved to https://phabricator.wikimedia.org/P50708 and previous config saved to /var/cache/conftool/dbconfig/20230822-024822-ladsgroup.json |
[production] |
02:48 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2111.codfw.wmnet with reason: Maintenance |
[production] |
02:48 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2111.codfw.wmnet with reason: Maintenance |
[production] |
02:41 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1130 (T343718)', diff saved to https://phabricator.wikimedia.org/P50707 and previous config saved to /var/cache/conftool/dbconfig/20230822-024144-ladsgroup.json |
[production] |
02:38 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P50706 and previous config saved to /var/cache/conftool/dbconfig/20230822-023835-ladsgroup.json |
[production] |
02:34 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2109', diff saved to https://phabricator.wikimedia.org/P50705 and previous config saved to /var/cache/conftool/dbconfig/20230822-023448-ladsgroup.json |
[production] |
02:30 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2101.codfw.wmnet with reason: Maintenance |
[production] |
02:30 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2101.codfw.wmnet with reason: Maintenance |
[production] |
02:29 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db1130 (T343718)', diff saved to https://phabricator.wikimedia.org/P50704 and previous config saved to /var/cache/conftool/dbconfig/20230822-022926-ladsgroup.json |
[production] |
02:29 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1130.eqiad.wmnet with reason: Maintenance |
[production] |
02:29 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1130.eqiad.wmnet with reason: Maintenance |
[production] |
02:23 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1166 (T344589)', diff saved to https://phabricator.wikimedia.org/P50703 and previous config saved to /var/cache/conftool/dbconfig/20230822-022328-ladsgroup.json |
[production] |
02:19 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2109 (T344589)', diff saved to https://phabricator.wikimedia.org/P50702 and previous config saved to /var/cache/conftool/dbconfig/20230822-021942-ladsgroup.json |
[production] |
02:17 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db1166 (T344589)', diff saved to https://phabricator.wikimedia.org/P50701 and previous config saved to /var/cache/conftool/dbconfig/20230822-021715-ladsgroup.json |
[production] |
02:17 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1166.eqiad.wmnet with reason: Maintenance |
[production] |
02:16 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1166.eqiad.wmnet with reason: Maintenance |
[production] |
02:13 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1140.eqiad.wmnet with reason: Maintenance |
[production] |
02:13 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1140.eqiad.wmnet with reason: Maintenance |
[production] |
02:13 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db2109 (T344589)', diff saved to https://phabricator.wikimedia.org/P50700 and previous config saved to /var/cache/conftool/dbconfig/20230822-021307-ladsgroup.json |
[production] |
02:13 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2109.codfw.wmnet with reason: Maintenance |
[production] |
02:12 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2109.codfw.wmnet with reason: Maintenance |
[production] |
00:45 |
<tzatziki> |
removing two files for legal compliance |
[production] |
00:37 |
<eileen> |
config revision changed from 322488b1 to 1ea8201f |
[production] |
00:31 |
<eileen> |
config revision changed from a05a2a82 to 322488b1 disable jobs |
[production] |
00:09 |
<brett@cumin2002> |
END (PASS) - Cookbook sre.cdn.roll-reboot (exit_code=0) rolling reboot on A:cp-text_eqsin and A:cp |
[production] |
2023-08-21
§
|
23:51 |
<brett@cumin2002> |
END (PASS) - Cookbook sre.cdn.roll-reboot (exit_code=0) rolling reboot on A:cp-upload_esams and A:cp |
[production] |
23:39 |
<pt1979@cumin2002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs2025.codfw.wmnet with OS bullseye |
[production] |
23:39 |
<pt1979@cumin2002> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - pt1979@cumin2002" |
[production] |
23:26 |
<bking@cumin1001> |
END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) |
[production] |
23:16 |
<pt1979@cumin2002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - pt1979@cumin2002" |
[production] |
23:08 |
<pt1979@cumin2002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs2024.codfw.wmnet with OS bullseye |
[production] |
23:08 |
<pt1979@cumin2002> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - pt1979@cumin2002" |
[production] |
23:07 |
<pt1979@cumin2002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - pt1979@cumin2002" |
[production] |
23:02 |
<pt1979@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs2025.codfw.wmnet with reason: host reimage |
[production] |
22:58 |
<pt1979@cumin2002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs2025.codfw.wmnet with reason: host reimage |
[production] |
22:52 |
<pt1979@cumin2002> |
START - Cookbook sre.hosts.reimage for host wdqs2025.codfw.wmnet with OS bullseye |
[production] |