3101-3150 of 10000 results (91ms)
2022-12-08 ยง
15:08 <jiji@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
15:08 <jiji@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
15:08 <jiji@deploy1002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
15:08 <jiji@deploy1002> helmfile [eqiad] [main] DONE helmfile.d/services/mw-jobrunner : sync [production]
15:08 <jiji@deploy1002> helmfile [eqiad] [canary] DONE helmfile.d/services/mw-jobrunner : sync [production]
15:08 <jiji@deploy1002> helmfile [eqiad] [main] START helmfile.d/services/mw-jobrunner : sync [production]
15:08 <jiji@deploy1002> helmfile [eqiad] [canary] START helmfile.d/services/mw-jobrunner : sync [production]
15:08 <jiji@deploy1002> helmfile [codfw] [main] DONE helmfile.d/services/mw-jobrunner : sync [production]
15:08 <jiji@deploy1002> helmfile [codfw] [canary] DONE helmfile.d/services/mw-jobrunner : sync [production]
15:08 <jiji@deploy1002> helmfile [codfw] [canary] START helmfile.d/services/mw-jobrunner : sync [production]
15:08 <jiji@deploy1002> helmfile [codfw] [main] START helmfile.d/services/mw-jobrunner : sync [production]
15:08 <jiji@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-debug: apply [production]
15:07 <jiji@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-debug: apply [production]
15:07 <jiji@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-debug: apply [production]
15:05 <jiji@deploy1002> helmfile [codfw] START helmfile.d/services/mw-debug: apply [production]
15:05 <jiji@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply [production]
15:05 <jiji@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-api-int: apply [production]
15:05 <jiji@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply [production]
15:05 <jiji@deploy1002> helmfile [codfw] START helmfile.d/services/mw-api-int: apply [production]
15:05 <jiji@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply [production]
15:05 <eevans@cumin1001> START - Cookbook sre.hosts.decommission for hosts restbase-dev2001.codfw.wmnet [production]
15:05 <jiji@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply [production]
15:05 <jiji@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply [production]
15:05 <jiji@deploy1002> helmfile [codfw] START helmfile.d/services/mw-api-ext: apply [production]
15:01 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1202', diff saved to https://phabricator.wikimedia.org/P42650 and previous config saved to /var/cache/conftool/dbconfig/20221208-150109-ladsgroup.json [production]
14:59 <hashar> Restarting Gerrit replica TWICE on gerrit2002.wikimedia.org to apply `-Dh2.maxCompactTime` and get it to trigger compaction # T323754 [production]
14:54 <jiji@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
14:53 <jiji@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
14:53 <jiji@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
14:53 <jiji@deploy1002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
14:52 <jiji@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-debug: apply [production]
14:52 <jiji@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-debug: apply [production]
14:52 <jiji@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-debug: apply [production]
14:52 <jiji@deploy1002> helmfile [codfw] START helmfile.d/services/mw-debug: apply [production]
14:52 <jiji@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply [production]
14:50 <jiji@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-api-int: apply [production]
14:50 <jiji@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply [production]
14:47 <jiji@deploy1002> helmfile [codfw] START helmfile.d/services/mw-api-int: apply [production]
14:47 <jiji@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply [production]
14:47 <jiji@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply [production]
14:47 <jiji@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply [production]
14:47 <jiji@deploy1002> helmfile [codfw] START helmfile.d/services/mw-api-ext: apply [production]
14:46 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1202 (T322618)', diff saved to https://phabricator.wikimedia.org/P42649 and previous config saved to /var/cache/conftool/dbconfig/20221208-144602-ladsgroup.json [production]
14:41 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1202 (T322618)', diff saved to https://phabricator.wikimedia.org/P42648 and previous config saved to /var/cache/conftool/dbconfig/20221208-144152-ladsgroup.json [production]
14:41 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1202.eqiad.wmnet with reason: Maintenance [production]
14:41 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db1202.eqiad.wmnet with reason: Maintenance [production]
14:41 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1194 (T322618)', diff saved to https://phabricator.wikimedia.org/P42647 and previous config saved to /var/cache/conftool/dbconfig/20221208-144131-ladsgroup.json [production]
14:40 <jiji@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-debug: apply [production]
14:40 <jiji@deploy1002> helmfile [codfw] START helmfile.d/services/mw-debug: apply [production]
14:26 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1194', diff saved to https://phabricator.wikimedia.org/P42646 and previous config saved to /var/cache/conftool/dbconfig/20221208-142625-ladsgroup.json [production]