751-800 of 10000 results (82ms)
2024-04-17 ยง
12:12 <vgutierrez> repool ncredir2001 [production]
12:12 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2109', diff saved to https://phabricator.wikimedia.org/P60765 and previous config saved to /var/cache/conftool/dbconfig/20240417-121218-marostegui.json [production]
12:06 <moritzm> upgrading PHP on mediawiki baremetal canaries servers T362511 [production]
11:57 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2109', diff saved to https://phabricator.wikimedia.org/P60763 and previous config saved to /var/cache/conftool/dbconfig/20240417-115709-marostegui.json [production]
11:57 <stevemunene@deploy1002> helmfile [codfw] DONE helmfile.d/services/datahub: sync on main [production]
11:46 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host es2032.codfw.wmnet [production]
11:44 <vgutierrez> depool ncredir2001 [production]
11:42 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2109 (T361627)', diff saved to https://phabricator.wikimedia.org/P60762 and previous config saved to /var/cache/conftool/dbconfig/20240417-114201-marostegui.json [production]
11:36 <stevemunene@deploy1002> helmfile [codfw] START helmfile.d/services/datahub: apply on main [production]
11:33 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host es2032.codfw.wmnet [production]
11:30 <akosiaris@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
11:30 <akosiaris@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
11:29 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host es1032.eqiad.wmnet [production]
11:29 <akosiaris@deploy1002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
11:24 <akosiaris@deploy1002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
11:24 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1167 (T352010)', diff saved to https://phabricator.wikimedia.org/P60761 and previous config saved to /var/cache/conftool/dbconfig/20240417-112418-ladsgroup.json [production]
11:24 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on clouddb[1016,1020-1021].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance [production]
11:23 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 2 days, 0:00:00 on clouddb[1016,1020-1021].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance [production]
11:23 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1167.eqiad.wmnet with reason: Maintenance [production]
11:23 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1167.eqiad.wmnet with reason: Maintenance [production]
11:23 <jiji@deploy1002> Finished scap: NoOp (duration: 09m 38s) [production]
11:22 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host es1032.eqiad.wmnet [production]
11:20 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2109 (T361627)', diff saved to https://phabricator.wikimedia.org/P60760 and previous config saved to /var/cache/conftool/dbconfig/20240417-112040-marostegui.json [production]
11:20 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2109.codfw.wmnet with reason: Maintenance [production]
11:20 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 6:00:00 on db2109.codfw.wmnet with reason: Maintenance [production]
11:20 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2105 (T361627)', diff saved to https://phabricator.wikimedia.org/P60759 and previous config saved to /var/cache/conftool/dbconfig/20240417-112017-marostegui.json [production]
11:17 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host es2030.codfw.wmnet [production]
11:13 <jiji@deploy1002> Started scap: NoOp [production]
11:06 <jmm@cumin2002> START - Cookbook sre.puppet.migrate-host for host es2030.codfw.wmnet [production]
11:05 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2105', diff saved to https://phabricator.wikimedia.org/P60758 and previous config saved to /var/cache/conftool/dbconfig/20240417-110510-marostegui.json [production]
11:04 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
10:54 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
10:53 <cgoubert@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
10:53 <jiji@cumin1002> conftool action : set/pooled=true; selector: dnsdisc=mw-web-ro,name=eqiad [production]
10:53 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
10:50 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2105', diff saved to https://phabricator.wikimedia.org/P60757 and previous config saved to /var/cache/conftool/dbconfig/20240417-105002-marostegui.json [production]
10:46 <jiji@cumin1002> conftool action : set/pooled=true; selector: dnsdisc=mw-api-ext-ro,name=eqiad [production]
10:45 <effie> pool eqiad back for mw-web-ro, mw-api-int-ro and mw-api-ext-ro [production]
10:44 <jiji@cumin1002> conftool action : set/pooled=true; selector: dnsdisc=mw-api-int-ro,name=eqiad [production]
10:42 <jiji@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-wikifunctions: apply [production]
10:42 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host es1027.eqiad.wmnet [production]
10:42 <jiji@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-wikifunctions: apply [production]
10:41 <jiji@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
10:41 <jiji@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
10:40 <jiji@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply [production]
10:38 <jiji@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply [production]
10:37 <jiji@deploy1002> helmfile [eqiad] [main] DONE helmfile.d/services/mw-jobrunner : sync [production]
10:36 <jiji@deploy1002> helmfile [eqiad] [canary] DONE helmfile.d/services/mw-jobrunner : sync [production]
10:36 <jiji@deploy1002> helmfile [eqiad] [canary] START helmfile.d/services/mw-jobrunner : sync [production]
10:36 <jiji@deploy1002> helmfile [eqiad] [main] START helmfile.d/services/mw-jobrunner : sync [production]