6501-6550 of 10000 results (103ms)
2022-12-06 ยง
14:34 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/api-gateway: apply [production]
14:34 <elukey@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
14:34 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/api-gateway: apply [production]
14:33 <elukey@deploy1002> helmfile [ml-serve-codfw] DONE helmfile.d/admin 'sync'. [production]
14:32 <elukey@deploy1002> helmfile [ml-serve-codfw] START helmfile.d/admin 'sync'. [production]
14:32 <elukey@deploy1002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
14:31 <hnowlan@deploy1002> helmfile [codfw] DONE helmfile.d/services/api-gateway: apply [production]
14:31 <elukey@deploy1002> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
14:31 <hnowlan@deploy1002> helmfile [codfw] START helmfile.d/services/api-gateway: apply [production]
14:30 <hnowlan@deploy1002> helmfile [staging] DONE helmfile.d/services/api-gateway: apply [production]
14:30 <hnowlan@deploy1002> helmfile [staging] START helmfile.d/services/api-gateway: apply [production]
14:28 <jgiannelos@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply [production]
14:27 <jgiannelos@deploy1002> helmfile [eqiad] START helmfile.d/services/mobileapps: apply [production]
14:25 <jgiannelos@deploy1002> helmfile [codfw] DONE helmfile.d/services/mobileapps: apply [production]
14:24 <jgiannelos@deploy1002> helmfile [codfw] START helmfile.d/services/mobileapps: apply [production]
14:23 <jgiannelos@deploy1002> helmfile [staging] DONE helmfile.d/services/mobileapps: apply [production]
14:23 <jgiannelos@deploy1002> helmfile [staging] START helmfile.d/services/mobileapps: apply [production]
14:20 <kharlan@deploy1002> Finished scap: Backport for [[gerrit:864919|NewImpact: Adjust hasMainspaceEditsCache check (T324285)]] (duration: 09m 04s) [production]
14:15 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host stat1004.eqiad.wmnet [production]
14:13 <kharlan@deploy1002> kharlan and kharlan: Backport for [[gerrit:864919|NewImpact: Adjust hasMainspaceEditsCache check (T324285)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet [production]
14:11 <kharlan@deploy1002> Started scap: Backport for [[gerrit:864919|NewImpact: Adjust hasMainspaceEditsCache check (T324285)]] [production]
14:04 <btullis@cumin1001> START - Cookbook sre.hosts.reboot-single for host stat1004.eqiad.wmnet [production]
13:18 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/thumbor: apply [production]
13:17 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/thumbor: apply [production]
13:17 <hnowlan@deploy1002> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
13:16 <hnowlan@deploy1002> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
13:04 <hnowlan@deploy1002> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
13:03 <hnowlan@deploy1002> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
13:02 <jmm@cumin2002> END (PASS) - Cookbook sre.wdqs.restart-nginx (exit_code=0) rolling restart_daemons on A:wdqs-all [production]
13:00 <kharlan@deploy1002> Finished scap: Backport for [[gerrit:864912|Revert "resourceloader: Modern ES6 code should be forced to target mobile" (T323542)]] (duration: 07m 57s) [production]
12:54 <hnowlan@deploy1002> helmfile [staging] DONE helmfile.d/services/thumbor: apply [production]
12:54 <hnowlan@deploy1002> helmfile [staging] START helmfile.d/services/thumbor: apply [production]
12:54 <kharlan@deploy1002> kharlan and kharlan: Backport for [[gerrit:864912|Revert "resourceloader: Modern ES6 code should be forced to target mobile" (T323542)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet [production]
12:52 <jmm@cumin2002> START - Cookbook sre.wdqs.restart-nginx rolling restart_daemons on A:wdqs-all [production]
12:52 <kharlan@deploy1002> Started scap: Backport for [[gerrit:864912|Revert "resourceloader: Modern ES6 code should be forced to target mobile" (T323542)]] [production]
12:49 <moritzm> installing glibc security updates on buster [production]
12:43 <jmm@cumin2002> END (PASS) - Cookbook sre.wdqs.restart-nginx (exit_code=0) rolling restart_daemons on A:wcqs-public [production]
12:29 <jnuche@deploy1002> Pruned MediaWiki: 1.40.0-wmf.10 (duration: 02m 09s) [production]
12:27 <jmm@cumin2002> START - Cookbook sre.wdqs.restart-nginx rolling restart_daemons on A:wcqs-public [production]
12:27 <jmm@cumin2002> END (FAIL) - Cookbook sre.wdqs.restart-nginx (exit_code=1) rolling restart_daemons on A:wcqs-public [production]
12:27 <jnuche@deploy1002> Finished scap: testwikis wikis to 1.40.0-wmf.13 refs T320518 (duration: 05m 52s) [production]
12:21 <jnuche@deploy1002> Started scap: testwikis wikis to 1.40.0-wmf.13 refs T320518 [production]
12:14 <jnuche@deploy1002> Started scap: testwikis wikis to 1.40.0-wmf.13 refs T320518 [production]
12:10 <jmm@cumin2002> START - Cookbook sre.wdqs.restart-nginx rolling restart_daemons on A:wcqs-public [production]
11:22 <jmm@cumin2002> END (PASS) - Cookbook sre.misc-clusters.roll-restart-reboot-docker-registry (exit_code=0) rolling restart_daemons on A:docker-registry [production]
11:20 <jmm@cumin2002> START - Cookbook sre.misc-clusters.roll-restart-reboot-docker-registry rolling restart_daemons on A:docker-registry [production]
10:59 <kostajh> UTC morning deploys done [production]
10:56 <moritzm> installing freetype security updates [production]
10:48 <kharlan@deploy1002> Finished scap: Backport for [[gerrit:864910|NewImpact: Show "999+" when we could not count edits/thanks (T324286)]] (duration: 31m 25s) [production]
10:36 <kharlan@deploy1002> kharlan and kharlan: Backport for [[gerrit:864910|NewImpact: Show "999+" when we could not count edits/thanks (T324286)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]