3851-3900 of 10000 results (92ms)
2024-01-17 ยง
11:34 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-role for role: memcached [production]
11:34 <jiji@cumin1002> START - Cookbook sre.hosts.reboot-single for host mc1044.eqiad.wmnet [production]
11:34 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2192 (T354336)', diff saved to https://phabricator.wikimedia.org/P54802 and previous config saved to /var/cache/conftool/dbconfig/20240117-113432-marostegui.json [production]
11:34 <jiji@cumin1002> START - Cookbook sre.hosts.reboot-single for host mc2044.codfw.wmnet [production]
11:34 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2192.codfw.wmnet with reason: Maintenance [production]
11:34 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 8:00:00 on db2192.codfw.wmnet with reason: Maintenance [production]
11:34 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2178 (T354336)', diff saved to https://phabricator.wikimedia.org/P54801 and previous config saved to /var/cache/conftool/dbconfig/20240117-113410-marostegui.json [production]
11:19 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2178', diff saved to https://phabricator.wikimedia.org/P54800 and previous config saved to /var/cache/conftool/dbconfig/20240117-111904-marostegui.json [production]
11:09 <Dreamy_Jazz> T351400 running on a tmux session `mwscript extensions/MediaModeration/maintenance/scanFilesInScanTable.php --wiki=commonswiki --use-jobqueue --sleep 30 --verbose 2>&1 | tee ~/scan-files-in-scan-table-commonswiki-sleep-30.txt` [production]
11:09 <Dreamy_Jazz> stopped scanning script [production]
11:03 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2178', diff saved to https://phabricator.wikimedia.org/P54799 and previous config saved to /var/cache/conftool/dbconfig/20240117-110357-marostegui.json [production]
10:49 <jiji@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc1043.eqiad.wmnet [production]
10:48 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2178 (T354336)', diff saved to https://phabricator.wikimedia.org/P54798 and previous config saved to /var/cache/conftool/dbconfig/20240117-104851-marostegui.json [production]
10:44 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2178 (T354336)', diff saved to https://phabricator.wikimedia.org/P54797 and previous config saved to /var/cache/conftool/dbconfig/20240117-104438-marostegui.json [production]
10:44 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2178.codfw.wmnet with reason: Maintenance [production]
10:44 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 8:00:00 on db2178.codfw.wmnet with reason: Maintenance [production]
10:44 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2171:3315 (T354336)', diff saved to https://phabricator.wikimedia.org/P54796 and previous config saved to /var/cache/conftool/dbconfig/20240117-104416-marostegui.json [production]
10:43 <jiji@cumin1002> START - Cookbook sre.hosts.reboot-single for host mc1043.eqiad.wmnet [production]
10:33 <jiji@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc2043.codfw.wmnet [production]
10:29 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2171:3315', diff saved to https://phabricator.wikimedia.org/P54795 and previous config saved to /var/cache/conftool/dbconfig/20240117-102909-marostegui.json [production]
10:26 <jiji@cumin1002> START - Cookbook sre.hosts.reboot-single for host mc2043.codfw.wmnet [production]
10:26 <pfischer@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
10:26 <pfischer@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
10:18 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host mc2043.codfw.wmnet [production]
10:14 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2171:3315', diff saved to https://phabricator.wikimedia.org/P54793 and previous config saved to /var/cache/conftool/dbconfig/20240117-101403-marostegui.json [production]
10:12 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host mc2043.codfw.wmnet [production]
09:58 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2171:3315 (T354336)', diff saved to https://phabricator.wikimedia.org/P54792 and previous config saved to /var/cache/conftool/dbconfig/20240117-095856-marostegui.json [production]
09:58 <pfischer@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
09:58 <pfischer@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:58 <pfischer@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:55 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2171:3315 (T354336)', diff saved to https://phabricator.wikimedia.org/P54791 and previous config saved to /var/cache/conftool/dbconfig/20240117-095544-marostegui.json [production]
09:55 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2171.codfw.wmnet with reason: Maintenance [production]
09:55 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 8:00:00 on db2171.codfw.wmnet with reason: Maintenance [production]
09:55 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2157 (T354336)', diff saved to https://phabricator.wikimedia.org/P54790 and previous config saved to /var/cache/conftool/dbconfig/20240117-095521-marostegui.json [production]
09:53 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host mc1043.eqiad.wmnet [production]
09:51 <jiji@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc2042.codfw.wmnet [production]
09:51 <jiji@cumin1002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc1042.eqiad.wmnet [production]
09:46 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host mc1043.eqiad.wmnet [production]
09:45 <jiji@cumin1002> START - Cookbook sre.hosts.reboot-single for host mc1042.eqiad.wmnet [production]
09:45 <jiji@cumin1002> START - Cookbook sre.hosts.reboot-single for host mc2042.codfw.wmnet [production]
09:40 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host mc1042.eqiad.wmnet [production]
09:40 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2157', diff saved to https://phabricator.wikimedia.org/P54789 and previous config saved to /var/cache/conftool/dbconfig/20240117-094015-marostegui.json [production]
09:36 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host mc1042.eqiad.wmnet [production]
09:35 <pfischer@deploy2002> helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
09:35 <pfischer@deploy2002> helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply [production]
09:30 <jmm@cumin2002> END (FAIL) - Cookbook sre.puppet.migrate-host (exit_code=99) for host mc2042.codfw.wmnet [production]
09:29 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host mc2042.codfw.wmnet [production]
09:25 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2157', diff saved to https://phabricator.wikimedia.org/P54788 and previous config saved to /var/cache/conftool/dbconfig/20240117-092507-marostegui.json [production]
09:21 <jnuche@deploy2002> Synchronized php: group1 wikis to 1.42.0-wmf.14 refs T354432 (duration: 06m 15s) [production]
09:15 <jnuche@deploy2002> rebuilt and synchronized wikiversions files: group1 wikis to 1.42.0-wmf.14 refs T354432 [production]