8301-8350 of 10000 results (56ms)
2022-01-12 ยง
13:37 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
13:37 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
13:30 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
13:30 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:753441|Disable flaggedrevs stable template inclusion in ruwikisource (T226054)]] (duration: 01m 08s) [production]
13:26 <marostegui@cumin1001> dbctl commit (dc=all): 'db1166 (re)pooling @ 75%: repooling after schema change', diff saved to https://phabricator.wikimedia.org/P18656 and previous config saved to /var/cache/conftool/dbconfig/20220112-132600-root.json [production]
13:25 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
13:23 <elukey@cumin1001> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM orespoolcounter1004.eqiad.wmnet [production]
13:20 <urbanecm@deploy1002> Finished scap: 4b1e241: Undo update to the way the search interface is set (duration: 19m 19s) [production]
13:19 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
13:19 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
13:18 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM puppetboard1002.eqiad.wmnet [production]
13:18 <elukey@cumin1001> START - Cookbook sre.ganeti.reboot-vm for VM orespoolcounter1004.eqiad.wmnet [production]
13:14 <jmm@cumin2002> START - Cookbook sre.ganeti.reboot-vm for VM puppetboard1002.eqiad.wmnet [production]
13:12 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
13:11 <elukey@cumin1001> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM orespoolcounter1003.eqiad.wmnet [production]
13:10 <marostegui@cumin1001> dbctl commit (dc=all): 'db1166 (re)pooling @ 50%: repooling after schema change', diff saved to https://phabricator.wikimedia.org/P18655 and previous config saved to /var/cache/conftool/dbconfig/20220112-131056-root.json [production]
13:08 <elukey@cumin1001> START - Cookbook sre.ganeti.reboot-vm for VM orespoolcounter1003.eqiad.wmnet [production]
13:04 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM debmonitor1002.eqiad.wmnet [production]
13:01 <urbanecm@deploy1002> Started scap: 4b1e241: Undo update to the way the search interface is set [production]
13:00 <marostegui@cumin1001> dbctl commit (dc=all): 'Give more traffic to db1128 in s1 T295965', diff saved to https://phabricator.wikimedia.org/P18654 and previous config saved to /var/cache/conftool/dbconfig/20220112-130050-marostegui.json [production]
13:00 <jmm@cumin2002> START - Cookbook sre.ganeti.reboot-vm for VM debmonitor1002.eqiad.wmnet [production]
12:55 <marostegui@cumin1001> dbctl commit (dc=all): 'db1166 (re)pooling @ 25%: repooling after schema change', diff saved to https://phabricator.wikimedia.org/P18653 and previous config saved to /var/cache/conftool/dbconfig/20220112-125552-root.json [production]
12:54 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM failoid1002.eqiad.wmnet [production]
12:54 <marostegui@cumin1001> dbctl commit (dc=all): 'Remove watchlist group from s7 eqiad T263127', diff saved to https://phabricator.wikimedia.org/P18652 and previous config saved to /var/cache/conftool/dbconfig/20220112-125402-marostegui.json [production]
12:52 <awight> EU deployment reopened :-) [production]
12:52 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1166', diff saved to https://phabricator.wikimedia.org/P18651 and previous config saved to /var/cache/conftool/dbconfig/20220112-125208-marostegui.json [production]
12:51 <awight> EU deployment complete [production]
12:50 <awight@deploy1002> Synchronized php-1.38.0-wmf.17/extensions/TemplateData: Backport: [[gerrit:752775|Allow aliases to be integers in addition to strings (T298795)]] (duration: 01m 07s) [production]
12:50 <jmm@cumin2002> START - Cookbook sre.ganeti.reboot-vm for VM failoid1002.eqiad.wmnet [production]
12:48 <Amir1> removing orphan lint error reports in all wikis (T298782) [production]
12:45 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1175 (T297191)', diff saved to https://phabricator.wikimedia.org/P18650 and previous config saved to /var/cache/conftool/dbconfig/20220112-124514-marostegui.json [production]
12:32 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
12:31 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
12:31 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
12:30 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
12:30 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1175', diff saved to https://phabricator.wikimedia.org/P18649 and previous config saved to /var/cache/conftool/dbconfig/20220112-123010-marostegui.json [production]
12:27 <marostegui@cumin1001> dbctl commit (dc=all): 'Give more traffic to db1128 in s1 T295965', diff saved to https://phabricator.wikimedia.org/P18648 and previous config saved to /var/cache/conftool/dbconfig/20220112-122742-marostegui.json [production]
12:15 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
12:15 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1175', diff saved to https://phabricator.wikimedia.org/P18647 and previous config saved to /var/cache/conftool/dbconfig/20220112-121505-marostegui.json [production]
12:14 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
12:13 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
12:13 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: cfe389afce8037121f8e8b672f4fdf2458a068dd: fawiki: Add extendedmover usergroup (T299038) (duration: 01m 08s) [production]
12:12 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
12:10 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM doc1002.eqiad.wmnet [production]
12:09 <marostegui@cumin1001> dbctl commit (dc=all): 'Give more traffic to db1128 in s1 T295965', diff saved to https://phabricator.wikimedia.org/P18646 and previous config saved to /var/cache/conftool/dbconfig/20220112-120931-marostegui.json [production]
12:08 <jmm@cumin2002> START - Cookbook sre.ganeti.reboot-vm for VM doc1002.eqiad.wmnet [production]
12:06 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM doc1001.eqiad.wmnet [production]
12:03 <jmm@cumin2002> START - Cookbook sre.ganeti.reboot-vm for VM doc1001.eqiad.wmnet [production]
12:00 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM releases1002.eqiad.wmnet [production]
12:00 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1175 (T297191)', diff saved to https://phabricator.wikimedia.org/P18645 and previous config saved to /var/cache/conftool/dbconfig/20220112-120000-marostegui.json [production]