3401-3450 of 10000 results (111ms)
2024-01-17 ยง
11:09 <Dreamy_Jazz> stopped scanning script [production]
11:03 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2178', diff saved to https://phabricator.wikimedia.org/P54799 and previous config saved to /var/cache/conftool/dbconfig/20240117-110357-marostegui.json [production]
10:49 <jiji@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc1043.eqiad.wmnet [production]
10:48 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2178 (T354336)', diff saved to https://phabricator.wikimedia.org/P54798 and previous config saved to /var/cache/conftool/dbconfig/20240117-104851-marostegui.json [production]
10:44 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2178 (T354336)', diff saved to https://phabricator.wikimedia.org/P54797 and previous config saved to /var/cache/conftool/dbconfig/20240117-104438-marostegui.json [production]
10:44 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2178.codfw.wmnet with reason: Maintenance [production]
10:44 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 8:00:00 on db2178.codfw.wmnet with reason: Maintenance [production]
10:44 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2171:3315 (T354336)', diff saved to https://phabricator.wikimedia.org/P54796 and previous config saved to /var/cache/conftool/dbconfig/20240117-104416-marostegui.json [production]
10:43 <jiji@cumin1002> START - Cookbook sre.hosts.reboot-single for host mc1043.eqiad.wmnet [production]
10:33 <jiji@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc2043.codfw.wmnet [production]
10:29 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2171:3315', diff saved to https://phabricator.wikimedia.org/P54795 and previous config saved to /var/cache/conftool/dbconfig/20240117-102909-marostegui.json [production]
10:26 <jiji@cumin1002> START - Cookbook sre.hosts.reboot-single for host mc2043.codfw.wmnet [production]
10:26 <pfischer@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
10:26 <pfischer@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
10:18 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host mc2043.codfw.wmnet [production]
10:14 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2171:3315', diff saved to https://phabricator.wikimedia.org/P54793 and previous config saved to /var/cache/conftool/dbconfig/20240117-101403-marostegui.json [production]
10:12 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host mc2043.codfw.wmnet [production]
09:58 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2171:3315 (T354336)', diff saved to https://phabricator.wikimedia.org/P54792 and previous config saved to /var/cache/conftool/dbconfig/20240117-095856-marostegui.json [production]
09:58 <pfischer@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
09:58 <pfischer@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:58 <pfischer@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:55 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2171:3315 (T354336)', diff saved to https://phabricator.wikimedia.org/P54791 and previous config saved to /var/cache/conftool/dbconfig/20240117-095544-marostegui.json [production]
09:55 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2171.codfw.wmnet with reason: Maintenance [production]
09:55 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 8:00:00 on db2171.codfw.wmnet with reason: Maintenance [production]
09:55 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2157 (T354336)', diff saved to https://phabricator.wikimedia.org/P54790 and previous config saved to /var/cache/conftool/dbconfig/20240117-095521-marostegui.json [production]
09:53 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host mc1043.eqiad.wmnet [production]
09:51 <jiji@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc2042.codfw.wmnet [production]
09:51 <jiji@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc1042.eqiad.wmnet [production]
09:46 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host mc1043.eqiad.wmnet [production]
09:45 <jiji@cumin1002> START - Cookbook sre.hosts.reboot-single for host mc1042.eqiad.wmnet [production]
09:45 <jiji@cumin1002> START - Cookbook sre.hosts.reboot-single for host mc2042.codfw.wmnet [production]
09:40 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host mc1042.eqiad.wmnet [production]
09:40 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2157', diff saved to https://phabricator.wikimedia.org/P54789 and previous config saved to /var/cache/conftool/dbconfig/20240117-094015-marostegui.json [production]
09:36 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host mc1042.eqiad.wmnet [production]
09:35 <pfischer@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
09:35 <pfischer@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:30 <jmm@cumin2002> END (FAIL) - Cookbook sre.puppet.migrate-host (exit_code=99) for host mc2042.codfw.wmnet [production]
09:29 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host mc2042.codfw.wmnet [production]
09:25 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2157', diff saved to https://phabricator.wikimedia.org/P54788 and previous config saved to /var/cache/conftool/dbconfig/20240117-092507-marostegui.json [production]
09:21 <jnuche@deploy2002> Synchronized php: group1 wikis to 1.42.0-wmf.14 refs T354432 (duration: 06m 15s) [production]
09:15 <jnuche@deploy2002> rebuilt and synchronized wikiversions files: group1 wikis to 1.42.0-wmf.14 refs T354432 [production]
09:10 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2157 (T354336)', diff saved to https://phabricator.wikimedia.org/P54787 and previous config saved to /var/cache/conftool/dbconfig/20240117-091000-marostegui.json [production]
09:08 <jmm@cumin2002> END (FAIL) - Cookbook sre.puppet.migrate-host (exit_code=99) for host mc2042.codfw.wmnet [production]
09:06 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2157 (T354336)', diff saved to https://phabricator.wikimedia.org/P54786 and previous config saved to /var/cache/conftool/dbconfig/20240117-090648-marostegui.json [production]
09:06 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2157.codfw.wmnet with reason: Maintenance [production]
09:06 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 8:00:00 on db2157.codfw.wmnet with reason: Maintenance [production]
09:06 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2137:3315 (T354336)', diff saved to https://phabricator.wikimedia.org/P54785 and previous config saved to /var/cache/conftool/dbconfig/20240117-090626-marostegui.json [production]
09:02 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host mc2042.codfw.wmnet [production]
08:56 <dcausse@deploy2002> Finished scap: Backport for [[gerrit:990718|enable page_rerender for all wikis (T351503)]] (duration: 09m 15s) [production]
08:55 <moritzm> installing Python 2.7 security updates [production]