3551-3600 of 10000 results (86ms)
2022-11-09 ยง
14:04 <lucaswerkmeister-wmde@deploy1002> lucaswerkmeister-wmde and lilients: Backport for [[gerrit:854513|Enable show nearby feature for ruwiki (T321548)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet [production]
14:04 <lucaswerkmeister-wmde@deploy1002> Started scap: Backport for [[gerrit:854513|Enable show nearby feature for ruwiki (T321548)]] [production]
14:03 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1179 (T322618)', diff saved to https://phabricator.wikimedia.org/P38824 and previous config saved to /var/cache/conftool/dbconfig/20221109-140351-ladsgroup.json [production]
13:59 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1179 (T322618)', diff saved to https://phabricator.wikimedia.org/P38823 and previous config saved to /var/cache/conftool/dbconfig/20221109-135943-ladsgroup.json [production]
13:59 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1179.eqiad.wmnet with reason: Maintenance [production]
13:59 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1179.eqiad.wmnet with reason: Maintenance [production]
13:59 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1175 (T322618)', diff saved to https://phabricator.wikimedia.org/P38822 and previous config saved to /var/cache/conftool/dbconfig/20221109-135911-ladsgroup.json [production]
13:44 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1175', diff saved to https://phabricator.wikimedia.org/P38821 and previous config saved to /var/cache/conftool/dbconfig/20221109-134404-ladsgroup.json [production]
13:28 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1175', diff saved to https://phabricator.wikimedia.org/P38820 and previous config saved to /var/cache/conftool/dbconfig/20221109-132858-ladsgroup.json [production]
13:24 <moritzm> drain ganeti1013 for eventual reimage to bullseye T311687 [production]
13:19 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2177 (T322618)', diff saved to https://phabricator.wikimedia.org/P38818 and previous config saved to /var/cache/conftool/dbconfig/20221109-131903-ladsgroup.json [production]
13:17 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host webperf1004.eqiad.wmnet [production]
13:13 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1175 (T322618)', diff saved to https://phabricator.wikimedia.org/P38817 and previous config saved to /var/cache/conftool/dbconfig/20221109-131351-ladsgroup.json [production]
13:13 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host webperf1004.eqiad.wmnet [production]
13:09 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1175 (T322618)', diff saved to https://phabricator.wikimedia.org/P38816 and previous config saved to /var/cache/conftool/dbconfig/20221109-130944-ladsgroup.json [production]
13:09 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1175.eqiad.wmnet with reason: Maintenance [production]
13:09 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1175.eqiad.wmnet with reason: Maintenance [production]
13:09 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1166 (T322618)', diff saved to https://phabricator.wikimedia.org/P38815 and previous config saved to /var/cache/conftool/dbconfig/20221109-130923-ladsgroup.json [production]
13:03 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2177', diff saved to https://phabricator.wikimedia.org/P38814 and previous config saved to /var/cache/conftool/dbconfig/20221109-130357-ladsgroup.json [production]
12:54 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P38813 and previous config saved to /var/cache/conftool/dbconfig/20221109-125416-ladsgroup.json [production]
12:54 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 63199 [production]
12:51 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/services/eventgate-main: apply [production]
12:50 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'configure' for AS: 63199 [production]
12:50 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/eventgate-main: apply [production]
12:49 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 29169 [production]
12:48 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'configure' for AS: 29169 [production]
12:48 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2177', diff saved to https://phabricator.wikimedia.org/P38812 and previous config saved to /var/cache/conftool/dbconfig/20221109-124850-ladsgroup.json [production]
12:43 <cgoubert@deploy1002> helmfile [eqiad] DONE helmfile.d/services/eventgate-main: apply [production]
12:42 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/services/eventgate-main: apply [production]
12:39 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P38811 and previous config saved to /var/cache/conftool/dbconfig/20221109-123910-ladsgroup.json [production]
12:33 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/services/eventgate-analytics: apply [production]
12:33 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2177 (T322618)', diff saved to https://phabricator.wikimedia.org/P38810 and previous config saved to /var/cache/conftool/dbconfig/20221109-123344-ladsgroup.json [production]
12:33 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/eventgate-analytics: apply [production]
12:31 <hnowlan@deploy1002> helmfile [staging] DONE helmfile.d/services/thumbor: sync [production]
12:30 <hnowlan@deploy1002> helmfile [staging] START helmfile.d/services/thumbor: sync [production]
12:28 <hnowlan@deploy1002> helmfile [staging] DONE helmfile.d/services/thumbor: sync [production]
12:28 <hnowlan@deploy1002> helmfile [staging] START helmfile.d/services/thumbor: sync [production]
12:26 <cgoubert@deploy1002> helmfile [eqiad] DONE helmfile.d/services/eventgate-analytics: apply [production]
12:26 <hashar@deploy1002> Finished deploy [gerrit/gerrit@b83625a]: gerrit1001: Gerrit JavaScript plugins as standalone files # T319378 (duration: 00m 09s) [production]
12:26 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/services/eventgate-analytics: apply [production]
12:25 <hashar@deploy1002> Started deploy [gerrit/gerrit@b83625a]: gerrit1001: Gerrit JavaScript plugins as standalone files # T319378 [production]
12:25 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db2177 (T322618)', diff saved to https://phabricator.wikimedia.org/P38809 and previous config saved to /var/cache/conftool/dbconfig/20221109-122528-ladsgroup.json [production]
12:25 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2177.codfw.wmnet with reason: Maintenance [production]
12:25 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db2177.codfw.wmnet with reason: Maintenance [production]
12:25 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2156 (T322618)', diff saved to https://phabricator.wikimedia.org/P38808 and previous config saved to /var/cache/conftool/dbconfig/20221109-122507-ladsgroup.json [production]
12:24 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1166 (T322618)', diff saved to https://phabricator.wikimedia.org/P38807 and previous config saved to /var/cache/conftool/dbconfig/20221109-122403-ladsgroup.json [production]
12:18 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/services/eventgate-logging-external: apply [production]
12:17 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/eventgate-logging-external: apply [production]
12:16 <hashar@deploy1002> Finished deploy [gerrit/gerrit@b83625a]: gerrit2002: Gerrit JavaScript plugins as standalone files # T319378 (duration: 00m 10s) [production]
12:16 <hashar@deploy1002> Started deploy [gerrit/gerrit@b83625a]: gerrit2002: Gerrit JavaScript plugins as standalone files # T319378 [production]