1001-1050 of 10000 results (81ms)
2022-11-22 ยง
11:02 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2122', diff saved to https://phabricator.wikimedia.org/P40524 and previous config saved to /var/cache/conftool/dbconfig/20221122-110214-ladsgroup.json [production]
11:01 <aborrero@cumin1001> START - Cookbook sre.hosts.reimage for host cloudvirt1049.eqiad.wmnet with OS bullseye [production]
11:00 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1167', diff saved to https://phabricator.wikimedia.org/P40523 and previous config saved to /var/cache/conftool/dbconfig/20221122-110040-ladsgroup.json [production]
10:58 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1029.eqiad.wmnet [production]
10:54 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1144:3315', diff saved to https://phabricator.wikimedia.org/P40522 and previous config saved to /var/cache/conftool/dbconfig/20221122-105124-marostegui.json [production]
10:54 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1029.eqiad.wmnet [production]
10:54 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1136', diff saved to https://phabricator.wikimedia.org/P40521 and previous config saved to /var/cache/conftool/dbconfig/20221122-105118-ladsgroup.json [production]
10:50 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1107 (T321130)', diff saved to https://phabricator.wikimedia.org/P40520 and previous config saved to /var/cache/conftool/dbconfig/20221122-105021-marostegui.json [production]
10:49 <jnuche@deploy1002> Finished scap: testing k8s deploys (duration: 21m 06s) [production]
10:47 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2122 (T322618)', diff saved to https://phabricator.wikimedia.org/P40519 and previous config saved to /var/cache/conftool/dbconfig/20221122-104708-ladsgroup.json [production]
10:46 <jnuche@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply [production]
10:46 <jnuche@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply [production]
10:45 <jnuche@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
10:45 <jnuche@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply [production]
10:45 <jnuche@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-jobrunner: apply [production]
10:45 <jnuche@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
10:45 <jnuche@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-jobrunner: apply [production]
10:45 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1167 (T321312)', diff saved to https://phabricator.wikimedia.org/P40518 and previous config saved to /var/cache/conftool/dbconfig/20221122-104534-ladsgroup.json [production]
10:45 <jnuche@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply [production]
10:45 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db2122 (T322618)', diff saved to https://phabricator.wikimedia.org/P40517 and previous config saved to /var/cache/conftool/dbconfig/20221122-104451-ladsgroup.json [production]
10:45 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2122.codfw.wmnet with reason: Maintenance [production]
10:45 <jnuche@deploy1002> helmfile [codfw] START helmfile.d/services/mw-jobrunner: apply [production]
10:45 <jnuche@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply [production]
10:45 <jnuche@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-jobrunner: apply [production]
10:45 <jnuche@deploy1002> helmfile [codfw] START helmfile.d/services/mw-api-ext: apply [production]
10:45 <jnuche@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-api-int: apply [production]
10:44 <jnuche@deploy1002> helmfile [codfw] START helmfile.d/services/mw-api-int: apply [production]
10:44 <jnuche@deploy1002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
10:44 <jnuche@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
10:44 <jnuche@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-api-int: apply [production]
10:44 <jnuche@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
10:44 <jnuche@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-web: apply [production]
10:44 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 6:00:00 on db2122.codfw.wmnet with reason: Maintenance [production]
10:44 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2121 (T322618)', diff saved to https://phabricator.wikimedia.org/P40516 and previous config saved to /var/cache/conftool/dbconfig/20221122-104429-ladsgroup.json [production]
10:44 <jnuche@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-api-int: apply [production]
10:44 <jnuche@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply [production]
10:44 <jnuche@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-jobrunner: apply [production]
10:44 <jnuche@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-jobrunner: apply [production]
10:44 <jnuche@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply [production]
10:44 <jnuche@deploy1002> helmfile [codfw] START helmfile.d/services/mw-jobrunner: apply [production]
10:43 <jnuche@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-web: apply [production]
10:43 <jnuche@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply [production]
10:43 <jnuche@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-jobrunner: apply [production]
10:43 <jnuche@deploy1002> helmfile [codfw] START helmfile.d/services/mw-api-ext: apply [production]
10:43 <jnuche@deploy1002> helmfile [codfw] START helmfile.d/services/mw-api-int: apply [production]
10:43 <jnuche@deploy1002> helmfile [eqiad] START helmfile.d/services/mw-api-int: apply [production]
10:43 <jnuche@deploy1002> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
10:39 <jnuche@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mw-debug: apply [production]
10:38 <jnuche@deploy1002> helmfile [codfw] DONE helmfile.d/services/mw-debug: apply [production]
10:36 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1144:3315 (T321126)', diff saved to https://phabricator.wikimedia.org/P40515 and previous config saved to /var/cache/conftool/dbconfig/20221122-103618-marostegui.json [production]