751-800 of 10000 results (114ms)
2023-06-27 ยง
10:26 <jayme@deploy1002> helmfile [staging] DONE helmfile.d/services/mathoid: apply [production]
10:25 <jayme@deploy1002> helmfile [staging] START helmfile.d/services/mathoid: apply [production]
10:23 <btullis@deploy1002> helmfile [staging] DONE helmfile.d/services/datahub: sync on main [production]
10:10 <btullis@deploy1002> helmfile [staging] START helmfile.d/services/datahub: apply on main [production]
10:07 <hnowlan@deploy1002> helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply [production]
10:07 <hnowlan@deploy1002> helmfile [codfw] START helmfile.d/services/rest-gateway: apply [production]
10:06 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply [production]
10:06 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/rest-gateway: apply [production]
10:06 <hnowlan@deploy1002> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
10:05 <hnowlan@deploy1002> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
10:04 <hnowlan@deploy1002> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
10:03 <hnowlan@deploy1002> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
10:03 <hnowlan@deploy1002> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
10:01 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-test-worker1002.eqiad.wmnet with OS bullseye [production]
10:01 <hnowlan@deploy1002> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
10:01 <hnowlan@deploy1002> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
09:56 <hnowlan@deploy1002> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
09:56 <hnowlan@deploy1002> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
09:56 <hnowlan@deploy1002> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
09:54 <hnowlan@deploy1002> helmfile [staging] DONE helmfile.d/services/rest-gateway: apply [production]
09:54 <hnowlan@deploy1002> helmfile [staging] START helmfile.d/services/rest-gateway: apply [production]
09:41 <fabfur@cumin1001> END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on A:cp-text_eqsin [production]
09:37 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-test-worker1002.eqiad.wmnet with reason: host reimage [production]
09:36 <akosiaris@deploy1002> Synchronized wmf-config/CommonSettings.php: (no justification provided) (duration: 07m 16s) [production]
09:35 <fabfur@cumin1001> END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on A:cp-upload_eqsin and not P{cp5032*} and A:cp [production]
09:34 <btullis@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on an-test-worker1002.eqiad.wmnet with reason: host reimage [production]
09:27 <jnuche@deploy1002> Finished deploy [releng/jenkins-deploy@1ddd94b] (releasing): (no justification provided) (duration: 00m 51s) [production]
09:26 <jnuche@deploy1002> Started deploy [releng/jenkins-deploy@1ddd94b] (releasing): (no justification provided) [production]
09:20 <btullis@cumin1001> START - Cookbook sre.hosts.reimage for host an-test-worker1002.eqiad.wmnet with OS bullseye [production]
09:20 <moritzm> installing libvirt bugfix updates from Bullseye point release [production]
09:12 <fabfur@cumin1001> START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on A:cp-text_eqsin [production]
09:12 <fabfur@cumin1001> START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on A:cp-upload_eqsin and not P{cp5032*} and A:cp [production]
09:11 <isaranto@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
09:11 <kart_> Updated MinT to 2023-06-27-053706-production (T339896, T340236) [production]
09:10 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply [production]
09:10 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/rest-gateway: apply [production]
09:09 <vgutierrez> repool cp1082 [production]
09:09 <hnowlan@deploy1002> helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply [production]
09:09 <hnowlan@deploy1002> helmfile [codfw] START helmfile.d/services/rest-gateway: apply [production]
09:07 <kartik@deploy1002> helmfile [eqiad] DONE helmfile.d/services/machinetranslation: apply [production]
09:02 <kartik@deploy1002> helmfile [eqiad] START helmfile.d/services/machinetranslation: apply [production]
09:00 <fabfur@cumin1001> END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on A:cp-text_ulsfo [production]
09:00 <fabfur@cumin1001> END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on A:cp-upload_ulsfo [production]
08:58 <hnowlan@puppetmaster1001> conftool action : set/weight=10; selector: service=thumbor,name=kubernetes200[0-9].codfw.wmnet [production]
08:58 <hnowlan@puppetmaster1001> conftool action : set/weight=10; selector: service=thumbor,name=kubernetes100[0-9].eqiad.wmnet [production]
08:58 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: service=thumbor,name=kubernetes100[0-9].eqiad.wmnet [production]
08:58 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes; selector: service=thumbor,name=kubernetes200[0-9].codfw.wmnet [production]
08:53 <akosiaris@deploy1002> Synchronized wmf-config/CommonSettings.php: (no justification provided) (duration: 07m 21s) [production]
08:52 <kartik@deploy1002> helmfile [codfw] DONE helmfile.d/services/machinetranslation: apply [production]
08:47 <kartik@deploy1002> helmfile [codfw] START helmfile.d/services/machinetranslation: apply [production]