9351-9400 of 10000 results (58ms)
2022-01-05 ยง
17:16 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
17:11 <sbassett> Deployed security fix for T298581 to wmf.16 [production]
17:04 <sbassett@deploy1002> Synchronized php-1.38.0-wmf.13/extensions/MobileFrontend/includes/specials/SpecialMobileContributions.php: Deploy security fix for T298581 (duration: 01m 08s) [production]
16:51 <jayme@deploy1002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
16:51 <jayme@deploy1002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
16:38 <andrew@deploy1002> Finished deploy [horizon/deploy@5e57e78]: sudo panel update (codfw1dev) (duration: 02m 08s) [production]
16:36 <andrew@deploy1002> Started deploy [horizon/deploy@5e57e78]: sudo panel update (codfw1dev) [production]
16:27 <andrew@deploy1002> Finished deploy [horizon/deploy@5e57e78]: sudo panel update (duration: 03m 53s) [production]
16:26 <jayme@deploy1002> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
16:26 <jayme@deploy1002> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
16:23 <andrew@deploy1002> Started deploy [horizon/deploy@5e57e78]: sudo panel update [production]
14:54 <aokoth@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:50 <aokoth@cumin1001> START - Cookbook sre.dns.netbox [production]
13:49 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
13:48 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
13:48 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
13:48 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2087:3316, db2087:3317 after reimage T295965', diff saved to https://phabricator.wikimedia.org/P18402 and previous config saved to /var/cache/conftool/dbconfig/20220105-134827-marostegui.json [production]
13:47 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
13:42 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
13:41 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
13:41 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
13:40 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dbproxy2001.codfw.wmnet with OS bullseye [production]
13:40 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
13:38 <urbanecm@deploy1002> Synchronized php-1.38.0-wmf.16/extensions/TrustedXFF/: ce7113b99712ac7ce4112cff720c669f618df6eb: Add more Zscaler ranges (T298241) (duration: 01m 09s) [production]
13:37 <urbanecm@deploy1002> Synchronized php-1.38.0-wmf.13/extensions/TrustedXFF/: d35e36f4deb7a8e2a454769f4b2d72e45318fcc9: Add more Zscaler ranges (T298241) (duration: 01m 09s) [production]
13:33 <Amir1> delete echo keys from objectchange in frwiki (T272512) [production]
13:23 <jelto@deploy1002> helmfile [staging] DONE helmfile.d/services/shellbox: sync on main [production]
13:22 <jelto@deploy1002> helmfile [staging] START helmfile.d/services/shellbox: apply on main [production]
13:11 <marostegui@cumin1001> START - Cookbook sre.hosts.reimage for host dbproxy2001.codfw.wmnet with OS bullseye [production]
13:10 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dbproxy2002.codfw.wmnet with OS bullseye [production]
12:38 <marostegui@cumin1001> START - Cookbook sre.hosts.reimage for host dbproxy2002.codfw.wmnet with OS bullseye [production]
12:24 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
12:20 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
12:20 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
12:19 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
12:18 <taavi> UTC morning deploys done [production]
12:16 <taavi@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:749890|Add akwiki as an import source for twwiki (T298296)]] (duration: 01m 09s) [production]
12:14 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
12:10 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
12:10 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
12:07 <vgutierrez> pool cp5005 running envoyproxy as TLS terminator - T271421 [production]
12:06 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
11:57 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dbproxy2003.codfw.wmnet with OS bullseye [production]
11:56 <jbond> rollout cfssl 1.6.1 [production]
11:55 <jelto@deploy1002> helmfile [staging] DONE helmfile.d/services/blubberoid: sync on staging [production]
11:55 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp5005.eqsin.wmnet with OS buster [production]
11:55 <jelto@deploy1002> helmfile [staging] DONE helmfile.d/services/blubberoid: apply on production [production]
11:55 <jelto@deploy1002> helmfile [staging] START helmfile.d/services/blubberoid: apply on staging [production]
11:34 <aokoth@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts kubestage1002.eqiad.wmnet [production]
11:24 <marostegui@cumin1001> START - Cookbook sre.hosts.reimage for host dbproxy2003.codfw.wmnet with OS bullseye [production]