4951-5000 of 10000 results (84ms)
2022-11-30 ยง
11:14 <oblivian@deploy1002> helmfile [staging] DONE helmfile.d/services/shellbox-constraints: apply [production]
11:14 <oblivian@deploy1002> helmfile [staging] START helmfile.d/services/shellbox-constraints: apply [production]
11:13 <oblivian@deploy1002> helmfile [eqiad] DONE helmfile.d/services/shellbox-constraints: apply [production]
11:12 <oblivian@deploy1002> helmfile [eqiad] START helmfile.d/services/shellbox-constraints: apply [production]
11:12 <oblivian@deploy1002> helmfile [codfw] DONE helmfile.d/services/shellbox-constraints: apply [production]
11:12 <btullis@puppetmaster1001> conftool action : set/pooled=false; selector: dnsdisc=eventstreams,name=codfw [production]
11:11 <oblivian@deploy1002> helmfile [codfw] START helmfile.d/services/shellbox-constraints: apply [production]
11:11 <oblivian@deploy1002> helmfile [staging] DONE helmfile.d/services/shellbox-constraints: apply [production]
11:11 <oblivian@deploy1002> helmfile [staging] START helmfile.d/services/shellbox-constraints: apply [production]
11:10 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1197 (T323907)', diff saved to https://phabricator.wikimedia.org/P41874 and previous config saved to /var/cache/conftool/dbconfig/20221130-111003-ladsgroup.json [production]
11:09 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1197.eqiad.wmnet with reason: Maintenance [production]
11:09 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db1197.eqiad.wmnet with reason: Maintenance [production]
11:09 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1188 (T323907)', diff saved to https://phabricator.wikimedia.org/P41873 and previous config saved to /var/cache/conftool/dbconfig/20221130-110942-ladsgroup.json [production]
11:09 <oblivian@deploy1002> helmfile [staging] DONE helmfile.d/services/shellbox: apply [production]
11:08 <oblivian@deploy1002> helmfile [staging] START helmfile.d/services/shellbox: apply [production]
11:08 <oblivian@deploy1002> helmfile [eqiad] DONE helmfile.d/services/shellbox: apply [production]
11:08 <btullis@deploy1002> helmfile [staging] DONE helmfile.d/services/eventstreams: apply [production]
11:08 <btullis@deploy1002> helmfile [staging] START helmfile.d/services/eventstreams: apply [production]
11:07 <oblivian@deploy1002> helmfile [eqiad] START helmfile.d/services/shellbox: apply [production]
11:07 <oblivian@deploy1002> helmfile [codfw] DONE helmfile.d/services/shellbox: apply [production]
11:06 <oblivian@deploy1002> helmfile [codfw] START helmfile.d/services/shellbox: apply [production]
11:06 <oblivian@deploy1002> helmfile [codfw] DONE helmfile.d/services/toolhub: apply [production]
11:05 <oblivian@deploy1002> helmfile [codfw] START helmfile.d/services/toolhub: apply [production]
11:03 <oblivian@deploy1002> helmfile [eqiad] DONE helmfile.d/services/toolhub: apply [production]
11:02 <oblivian@deploy1002> helmfile [eqiad] START helmfile.d/services/toolhub: apply [production]
11:01 <oblivian@deploy1002> helmfile [staging] DONE helmfile.d/services/toolhub: apply [production]
11:00 <oblivian@deploy1002> helmfile [staging] START helmfile.d/services/toolhub: apply [production]
10:54 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1188', diff saved to https://phabricator.wikimedia.org/P41872 and previous config saved to /var/cache/conftool/dbconfig/20221130-105436-ladsgroup.json [production]
10:39 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1188', diff saved to https://phabricator.wikimedia.org/P41871 and previous config saved to /var/cache/conftool/dbconfig/20221130-103929-ladsgroup.json [production]
10:24 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1188 (T323907)', diff saved to https://phabricator.wikimedia.org/P41869 and previous config saved to /var/cache/conftool/dbconfig/20221130-102423-ladsgroup.json [production]
10:10 <cgoubert@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
10:09 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
10:09 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
10:07 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1188 (T323907)', diff saved to https://phabricator.wikimedia.org/P41868 and previous config saved to /var/cache/conftool/dbconfig/20221130-100718-ladsgroup.json [production]
10:07 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1188.eqiad.wmnet with reason: Maintenance [production]
10:07 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db1188.eqiad.wmnet with reason: Maintenance [production]
10:06 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1182 (T323907)', diff saved to https://phabricator.wikimedia.org/P41867 and previous config saved to /var/cache/conftool/dbconfig/20221130-100657-ladsgroup.json [production]
10:06 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
10:05 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply [production]
10:04 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/mw-api-int: apply [production]
10:04 <cgoubert@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply [production]
10:03 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply [production]
10:02 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply [production]
09:59 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/mw-api-ext: apply [production]
09:59 <cgoubert@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-jobrunner: apply [production]
09:59 <cgoubert@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-jobrunner: apply [production]
09:58 <cgoubert@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-jobrunner: apply [production]
09:58 <cgoubert@deploy1002> helmfile [codfw] START helmfile.d/services/mw-jobrunner: apply [production]
09:51 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1182', diff saved to https://phabricator.wikimedia.org/P41866 and previous config saved to /var/cache/conftool/dbconfig/20221130-095150-ladsgroup.json [production]
09:36 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1182', diff saved to https://phabricator.wikimedia.org/P41865 and previous config saved to /var/cache/conftool/dbconfig/20221130-093644-ladsgroup.json [production]