3201-3250 of 10000 results (73ms)
2020-03-12 ยง
13:21 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
12:56 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
12:33 <volans@cumin2001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
12:29 <volans@cumin2001> START - Cookbook sre.dns.netbox [production]
12:00 <tarrow> EU SWAT done [production]
12:00 <tarrow@deploy1001> Synchronized php-1.35.0-wmf.23/extensions/TwoColConflict: SWAT: [[gerrit:579221|Detect whether an edit came from VisualEditor (T245722)]] (duration: 01m 10s) [production]
11:42 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventstreams' for release 'canary' . [production]
11:42 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventstreams' for release 'production' . [production]
11:39 <volans@cumin2001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
11:38 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventstreams' for release 'canary' . [production]
11:38 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventstreams' for release 'production' . [production]
11:37 <volans@cumin2001> START - Cookbook sre.dns.netbox [production]
11:23 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventstreams' for release 'canary' . [production]
11:23 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventstreams' for release 'production' . [production]
11:09 <elukey> roll restart of krb-kdc on krb1001/krb2001 to pick up new ticket lifetime settings (10h -> 48h) [production]
11:09 <akosiaris@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'eventstreams' for release 'canary' . [production]
11:09 <akosiaris@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'eventstreams' for release 'production' . [production]
11:05 <akosiaris@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'eventstreams' for release 'canary' . [production]
11:05 <akosiaris@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'eventstreams' for release 'production' . [production]
11:02 <volans@cumin2001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
10:59 <volans@cumin2001> START - Cookbook sre.dns.netbox [production]
10:58 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventstreams' for release 'canary' . [production]
10:58 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventstreams' for release 'production' . [production]
10:39 <volans@cumin2001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
10:39 <volans@cumin2001> START - Cookbook sre.dns.netbox [production]
10:29 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
10:28 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventstreams' for release 'canary' . [production]
10:28 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventstreams' for release 'production' . [production]
10:13 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventstreams' for release 'canary' . [production]
10:13 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventstreams' for release 'production' . [production]
09:58 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventstreams' for release 'canary' . [production]
09:58 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventstreams' for release 'production' . [production]
08:55 <oblivian@deploy1001> Synchronized wmf-config/ProductionServices.php: switch ores to use envoy (duration: 01m 08s) [production]
08:36 <addshore> start "rebuild" of Q87 -> 87.5 million for T219123 [production]
08:27 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Write to new term store up to Q87.5 million, was 87 (T219123) cache bust (duration: 01m 08s) [production]
08:26 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Write to new term store up to Q87.5 million, was 87 (T219123) (duration: 01m 12s) [production]
08:12 <elukey> push new install/webproxy terms for analytics-in4/6 to cr1/cr2-eqiad [production]
07:28 <kart_> Updated cxserver charts to 0.0.13 [production]
07:26 <kartik@deploy1001> helmfile [CODFW] Ran 'apply' command on namespace 'cxserver' for release 'production' . [production]
07:24 <kartik@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'cxserver' for release 'production' . [production]
07:22 <kartik@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'cxserver' for release 'staging' . [production]
06:14 <kart_> Updated cxserver to 2020-03-12-041806-production and added sectionmapping db config (T246316, T243430, T202276) [production]
06:11 <kartik@deploy1001> helmfile [CODFW] Ran 'apply' command on namespace 'cxserver' for release 'production' . [production]
06:08 <kartik@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'cxserver' for release 'production' . [production]
06:03 <kartik@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'cxserver' for release 'staging' . [production]
01:51 <mholloway-shell@deploy1001> Synchronized php-1.35.0-wmf.22/extensions/WikimediaEditorTasks: Revert 'Fix revert counting for non-language-specific counters' (T247479) (duration: 01m 08s) [production]
01:13 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@4e2ea09]: resolve deadlock in bulk_daemon (duration: 10m 05s) [production]
01:03 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@4e2ea09]: resolve deadlock in bulk_daemon [production]
00:56 <ebernhardson@deploy1001> Synchronized php-1.35.0-wmf.22/extensions/CirrusSearch/includes/Maintenance/Reindexer.php: wait around for counts to match up in reindexer before giving up (duration: 01m 08s) [production]
00:53 <ebernhardson> wmf.23 cirrussearch: wait around for counts to match before giving up [production]