4301-4350 of 10000 results (44ms)
2021-08-05 ยง
23:16 <legoktm@deploy1002> Synchronized php-1.37.0-wmf.17/includes/: Revert "Use CsrfTokenSet as CSRF token source" (T287542) (duration: 01m 03s) [production]
23:00 <pt1979@cumin2002> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on ms-be2062.codfw.wmnet with reason: REIMAGE [production]
22:58 <pt1979@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2062.codfw.wmnet with reason: REIMAGE [production]
22:53 <legoktm@deploy1002> Synchronized php-1.37.0-wmf.16/includes/: Revert "Use CsrfTokenSet as CSRF token source" (T287542) (duration: 01m 02s) [production]
22:52 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
22:51 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
22:12 <jforrester@deploy1002> Synchronized php-1.37.0-wmf.17/includes/content/: T288191: Support deprecated Content::preSaveTransform override (2/2) (duration: 00m 55s) [production]
22:11 <jforrester@deploy1002> Synchronized php-1.37.0-wmf.17/includes/content/ContentHandler.php: T288191: Support deprecated Content::preSaveTransform override (1/2) (duration: 01m 00s) [production]
22:10 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
22:07 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
21:42 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
21:41 <jforrester@deploy1002> Synchronized php-1.37.0-wmf.17/skins/MonoBook/resources/screen-common.less: T288288 Restore visualClear style to MonoBook so that footer doesn't show in the interwiki list (duration: 01m 24s) [production]
21:40 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
21:03 <ejegg> updated payments-wiki from 72fe99abb1 to a70aaa7944 [production]
20:56 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:51 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
20:48 <pt1979@cumin2002> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on ms-be2062.codfw.wmnet with reason: REIMAGE [production]
20:48 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:46 <pt1979@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2062.codfw.wmnet with reason: REIMAGE [production]
20:44 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
20:23 <dduvall> 1.37.0-wmf.17 promoted to all wikis. no new errors or concerning rates (T281158). fixes for open UBN T288191 will be handled via backport (see task discussion) [production]
20:18 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:13 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
19:24 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
19:20 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
19:18 <dduvall@deploy1002> rebuilt and synchronized wikiversions files: all wikis to 1.37.0-wmf.17 [production]
19:00 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:58 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:44 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:710328|Increase the ratio for shellbox for constraints to 42% in Wikidata (T176312)]] (duration: 01m 06s) [production]
18:38 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:37 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:28 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:710318|Increase the ratio for shellbox for constraints to 21% in Wikidata (T176312)]] (duration: 01m 06s) [production]
18:23 <topranks> Adding peering to second router of Xiber LLC - AS393950 - on cr2-eqord (Equinix IX Chicago) [production]
18:23 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: da36bc3a05101f56e357969371b91e05660b9560: DiscussionTools: Make sourcemodetoolbar available everywhere (T287927) (duration: 01m 06s) [production]
18:18 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 0a14eb418288ad8ea25c206d20f2bed589de8107: wikimediaEvents: Enable IP address copy action instrument on all wikis (T279540) (duration: 01m 07s) [production]
18:17 <urbanecm@deploy1002> Synchronized php-1.37.0-wmf.17/extensions/DiscussionTools/extension.json: 91f7c0233e2573a629e92a4b14c9b4be2b401e2f: Change sourcemodetoolbar default to enabled when available (T287927) (duration: 01m 06s) [production]
18:16 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:16 <urbanecm@deploy1002> sync-file aborted: 91f7c0233e2573a629e92a4b14c9b4be2b401e2f: Change sourcemodetoolbar default to enabled when available (T287927) (duration: 00m 04s) [production]
18:15 <urbanecm@deploy1002> Synchronized php-1.37.0-wmf.16/extensions/DiscussionTools/extension.json: 38a8658d81f16700accf0df68504a121ddf41ffb: Change sourcemodetoolbar default to enabled when available (T287927) (duration: 01m 06s) [production]
18:15 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
17:55 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
17:54 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
17:49 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:710315|Increase the shellbox ratio to 5% for wikidata (T176312)]] (duration: 01m 15s) [production]
17:43 <elukey> upgrade helm3 to 3.6.3-1 on release*, contint*, chartmuseum*, deploy2002 (1002 was already done before) [production]
17:43 <herron> rolling restart eqiad logstash cluster for java updates [production]
17:41 <ebernhardson> restart airflow-{scheduler|webserver} on an-airflow1001 to pickup deployed plugin changes [production]
17:36 <elukey@deploy1002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]
17:32 <ebernhardson@deploy1002> Finished deploy [wikimedia/discovery/analytics@9872df9]: pyspark generalization gerrit:709837 and 666774 (duration: 09m 01s) [production]
17:26 <elukey@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
17:25 <elukey@deploy1002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]