4351-4400 of 10000 results (71ms)
2022-06-16 ยง
21:18 <thcipriani@deploy1002> Finished scap: noop test (duration: 04m 07s) [production]
21:14 <thcipriani@deploy1002> Started scap: noop test [production]
21:10 <thcipriani@deploy1002> Synchronized wmf-config/CommonSettings.php: Config: [[gerrit:805433|CommonSettings: clean up and simplify some code]] (duration: 03m 42s) [production]
21:06 <thcipriani@deploy1002> Synchronized multiversion/MWRealm.php: Config: [[gerrit:806249|MWRealm.php: remove unused getRealmSpecificFilename() (T171115)]] (duration: 03m 35s) [production]
21:04 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
21:01 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
21:01 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
21:00 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:58 <thcipriani@deploy1002> Finished scap: Config: [[gerrit:806248|phpcs: enable PrefixedGlobalFunctions.allowedPrefix and rename functions (T171115)]] (duration: 16m 57s) [production]
20:49 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:48 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:48 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:47 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:42 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:42 <thcipriani@deploy1002> Started scap: Config: [[gerrit:806248|phpcs: enable PrefixedGlobalFunctions.allowedPrefix and rename functions (T171115)]] [production]
20:41 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:41 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:40 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:27 <cjming@deploy1002> Synchronized phpcs.xml: Config: [[gerrit:805432|phpcs: move SpaceBeforeSingleLineComment.NewLineComment exclusions (T171115)]] (duration: 03m 27s) [production]
20:25 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:24 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:24 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:23 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:23 <cjming@deploy1002> Synchronized wmf-config/: Config: [[gerrit:805432|phpcs: move SpaceBeforeSingleLineComment.NewLineComment exclusions (T171115)]] (duration: 03m 22s) [production]
20:18 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:14 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:14 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:13 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:12 <cjming@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:805179|Turn off TOC A/B test for pilot wikis (T309683)]] (duration: 03m 37s) [production]
19:39 <aokoth@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts gitlab-runner2001.codfw.wmnet [production]
19:39 <aokoth@cumin1001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
19:23 <aokoth@cumin1001> START - Cookbook sre.dns.netbox [production]
19:03 <aokoth@cumin1001> START - Cookbook sre.hosts.decommission for hosts gitlab-runner2001.codfw.wmnet [production]
19:00 <dzahn@cumin2002> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts gitlab-runner1001.eqiad.wmnet [production]
19:00 <dzahn@cumin2002> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
18:57 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
18:57 <dzahn@cumin2002> START - Cookbook sre.dns.netbox [production]
18:55 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1158 (T302659)', diff saved to https://phabricator.wikimedia.org/P29904 and previous config saved to /var/cache/conftool/dbconfig/20220616-185520-marostegui.json [production]
18:54 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
18:54 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
18:54 <dzahn@cumin2002> START - Cookbook sre.hosts.decommission for hosts gitlab-runner1001.eqiad.wmnet [production]
18:53 <dzahn@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts gitlab-runner1001.eqiad.wmnet [production]
18:53 <dzahn@cumin2002> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
18:53 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
18:50 <dzahn@cumin2002> START - Cookbook sre.dns.netbox [production]
18:49 <brennen@deploy1002> rebuilt and synchronized wikiversions files: all wikis to 1.39.0-wmf.16 refs T308069 [production]
18:48 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
18:44 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
18:44 <brennen> train 1.39.0-wmf.16 (T308069): no current blockers - rolling to all wikis [production]
18:44 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]