1451-1500 of 10000 results (77ms)
2023-07-27 ยง
17:56 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1201.eqiad.wmnet with reason: Maintenance [production]
17:56 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1201.eqiad.wmnet with reason: Maintenance [production]
17:56 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1187 (T342617)', diff saved to https://phabricator.wikimedia.org/P49775 and previous config saved to /var/cache/conftool/dbconfig/20230727-175638-ladsgroup.json [production]
17:44 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on rdb1013.eqiad.wmnet with reason: host reimage [production]
17:41 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1187', diff saved to https://phabricator.wikimedia.org/P49774 and previous config saved to /var/cache/conftool/dbconfig/20230727-174132-ladsgroup.json [production]
17:41 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on rdb1013.eqiad.wmnet with reason: host reimage [production]
17:26 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1187', diff saved to https://phabricator.wikimedia.org/P49773 and previous config saved to /var/cache/conftool/dbconfig/20230727-172626-ladsgroup.json [production]
17:25 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host rdb1013.eqiad.wmnet with OS bullseye [production]
17:04 <bd808@deploy1002> helmfile [eqiad] DONE helmfile.d/services/developer-portal: apply [production]
17:03 <bd808@deploy1002> helmfile [eqiad] START helmfile.d/services/developer-portal: apply [production]
17:03 <bd808@deploy1002> helmfile [codfw] DONE helmfile.d/services/developer-portal: apply [production]
17:02 <bd808@deploy1002> helmfile [codfw] START helmfile.d/services/developer-portal: apply [production]
17:02 <bd808@deploy1002> helmfile [staging] DONE helmfile.d/services/developer-portal: apply [production]
17:01 <bd808@deploy1002> helmfile [staging] START helmfile.d/services/developer-portal: apply [production]
16:52 <ladsgroup@deploy1002> Finished scap: Backport for [[gerrit:941955|ores-extension: enable lw on itwiki and hewiki (T342115)]] (duration: 20m 53s) [production]
16:47 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1187 (T342617)', diff saved to https://phabricator.wikimedia.org/P49771 and previous config saved to /var/cache/conftool/dbconfig/20230727-164711-ladsgroup.json [production]
16:47 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1187.eqiad.wmnet with reason: Maintenance [production]
16:46 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1187.eqiad.wmnet with reason: Maintenance [production]
16:46 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180 (T342617)', diff saved to https://phabricator.wikimedia.org/P49770 and previous config saved to /var/cache/conftool/dbconfig/20230727-164650-ladsgroup.json [production]
16:45 <dancy@deploy1002> Installation of scap version "4.57.0" completed for 600 hosts [production]
16:44 <dancy@deploy1002> Installing scap version "4.57.0" for 600 hosts [production]
16:41 <kamila@deploy1002> helmfile [staging] DONE helmfile.d/services/benthos-cache-invalidator: apply [production]
16:41 <kamila@deploy1002> helmfile [staging] START helmfile.d/services/benthos-cache-invalidator: apply [production]
16:34 <kamila@deploy1002> helmfile [staging] DONE helmfile.d/services/benthos-cache-invalidator: apply [production]
16:34 <kamila@deploy1002> helmfile [staging] START helmfile.d/services/benthos-cache-invalidator: apply [production]
16:33 <ladsgroup@deploy1002> isaranto and ladsgroup: Backport for [[gerrit:941955|ores-extension: enable lw on itwiki and hewiki (T342115)]] synced to the testservers mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) [production]
16:31 <ladsgroup@deploy1002> Started scap: Backport for [[gerrit:941955|ores-extension: enable lw on itwiki and hewiki (T342115)]] [production]
16:31 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180', diff saved to https://phabricator.wikimedia.org/P49769 and previous config saved to /var/cache/conftool/dbconfig/20230727-163144-ladsgroup.json [production]
16:16 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180', diff saved to https://phabricator.wikimedia.org/P49768 and previous config saved to /var/cache/conftool/dbconfig/20230727-161638-ladsgroup.json [production]
16:01 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1180 (T342617)', diff saved to https://phabricator.wikimedia.org/P49766 and previous config saved to /var/cache/conftool/dbconfig/20230727-160132-ladsgroup.json [production]
15:56 <kamila@deploy1002> helmfile [staging] DONE helmfile.d/services/benthos-cache-invalidator: apply [production]
15:56 <kamila@deploy1002> helmfile [staging] START helmfile.d/services/benthos-cache-invalidator: apply [production]
15:49 <jynus> restart db2097 [production]
15:49 <kamila@deploy1002> helmfile [staging] DONE helmfile.d/services/benthos-cache-invalidator: apply [production]
15:49 <kamila@deploy1002> helmfile [staging] START helmfile.d/services/benthos-cache-invalidator: apply [production]
15:45 <zabe@deploy1002> Finished scap: Backport for [[gerrit:942466|Revert "CheckUser event table migration: Write new on group0" (T342902)]] (duration: 07m 43s) [production]
15:44 <kamila@deploy1002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
15:42 <kamila@deploy1002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
15:40 <kamila@deploy1002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
15:40 <kamila@deploy1002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
15:40 <kamila@deploy1002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
15:40 <kamila@deploy1002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
15:38 <zabe@deploy1002> zabe and dreamyjazz: Backport for [[gerrit:942466|Revert "CheckUser event table migration: Write new on group0" (T342902)]] synced to the testservers mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) [production]
15:37 <zabe@deploy1002> Started scap: Backport for [[gerrit:942466|Revert "CheckUser event table migration: Write new on group0" (T342902)]] [production]
15:36 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1180 (T342617)', diff saved to https://phabricator.wikimedia.org/P49764 and previous config saved to /var/cache/conftool/dbconfig/20230727-153649-ladsgroup.json [production]
15:36 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1180.eqiad.wmnet with reason: Maintenance [production]
15:36 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1180.eqiad.wmnet with reason: Maintenance [production]
15:36 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1173 (T342617)', diff saved to https://phabricator.wikimedia.org/P49763 and previous config saved to /var/cache/conftool/dbconfig/20230727-153629-ladsgroup.json [production]
15:21 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1173', diff saved to https://phabricator.wikimedia.org/P49762 and previous config saved to /var/cache/conftool/dbconfig/20230727-152123-ladsgroup.json [production]
15:06 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1173', diff saved to https://phabricator.wikimedia.org/P49761 and previous config saved to /var/cache/conftool/dbconfig/20230727-150616-ladsgroup.json [production]