5001-5050 of 10000 results (60ms)
2022-01-05 ยง
14:54 <aokoth@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:50 <aokoth@cumin1001> START - Cookbook sre.dns.netbox [production]
13:49 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
13:48 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
13:48 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
13:48 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2087:3316, db2087:3317 after reimage T295965', diff saved to https://phabricator.wikimedia.org/P18402 and previous config saved to /var/cache/conftool/dbconfig/20220105-134827-marostegui.json [production]
13:47 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
13:42 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
13:41 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
13:41 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
13:40 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dbproxy2001.codfw.wmnet with OS bullseye [production]
13:40 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
13:38 <urbanecm@deploy1002> Synchronized php-1.38.0-wmf.16/extensions/TrustedXFF/: ce7113b99712ac7ce4112cff720c669f618df6eb: Add more Zscaler ranges (T298241) (duration: 01m 09s) [production]
13:37 <urbanecm@deploy1002> Synchronized php-1.38.0-wmf.13/extensions/TrustedXFF/: d35e36f4deb7a8e2a454769f4b2d72e45318fcc9: Add more Zscaler ranges (T298241) (duration: 01m 09s) [production]
13:33 <Amir1> delete echo keys from objectchange in frwiki (T272512) [production]
13:23 <jelto@deploy1002> helmfile [staging] DONE helmfile.d/services/shellbox: sync on main [production]
13:22 <jelto@deploy1002> helmfile [staging] START helmfile.d/services/shellbox: apply on main [production]
13:11 <marostegui@cumin1001> START - Cookbook sre.hosts.reimage for host dbproxy2001.codfw.wmnet with OS bullseye [production]
13:10 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dbproxy2002.codfw.wmnet with OS bullseye [production]
12:38 <marostegui@cumin1001> START - Cookbook sre.hosts.reimage for host dbproxy2002.codfw.wmnet with OS bullseye [production]
12:24 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
12:20 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
12:20 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
12:19 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
12:18 <taavi> UTC morning deploys done [production]
12:16 <taavi@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:749890|Add akwiki as an import source for twwiki (T298296)]] (duration: 01m 09s) [production]
12:14 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
12:10 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
12:10 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
12:07 <vgutierrez> pool cp5005 running envoyproxy as TLS terminator - T271421 [production]
12:06 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
11:57 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dbproxy2003.codfw.wmnet with OS bullseye [production]
11:56 <jbond> rollout cfssl 1.6.1 [production]
11:55 <jelto@deploy1002> helmfile [staging] DONE helmfile.d/services/blubberoid: sync on staging [production]
11:55 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp5005.eqsin.wmnet with OS buster [production]
11:55 <jelto@deploy1002> helmfile [staging] DONE helmfile.d/services/blubberoid: apply on production [production]
11:55 <jelto@deploy1002> helmfile [staging] START helmfile.d/services/blubberoid: apply on staging [production]
11:34 <aokoth@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts kubestage1002.eqiad.wmnet [production]
11:24 <marostegui@cumin1001> START - Cookbook sre.hosts.reimage for host dbproxy2003.codfw.wmnet with OS bullseye [production]
11:24 <btullis> updating hive packages in reprepro for log4j update [production]
11:24 <aokoth@cumin1001> START - Cookbook sre.hosts.decommission for hosts kubestage1002.eqiad.wmnet [production]
11:20 <marostegui@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host dbproxy2003.codfw.wmnet with OS bullseye [production]
10:54 <jbond> upload cfssl 1.6.1 [production]
10:52 <marostegui@cumin1001> START - Cookbook sre.hosts.reimage for host dbproxy2003.codfw.wmnet with OS bullseye [production]
10:48 <hashar> CI: switching MediaWiki selenium from php built-in server to Apache # https://gerrit.wikimedia.org/r/751697 [production]
10:39 <aokoth@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:37 <aokoth@cumin1001> START - Cookbook sre.dns.netbox [production]
10:02 <dcausse@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . [production]
10:01 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 8137ffc33d9de0f0a835223936a93e87504a7358: pwnwiki: Enable Growth features in dark mode (T298115; 3/3) (duration: 01m 07s) [production]
10:00 <dcausse@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . [production]