3151-3200 of 10000 results (66ms)
2020-03-12 ยง
21:19 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'production' . [production]
21:06 <foks> remove one file for legal compliance [production]
20:49 <ottomata> kafka-jumbo1006 - stopping kafka and powercycling - T247561 [production]
20:15 <brennen@deploy1001> rebuilt and synchronized wikiversions files: Revert "all wikis to 1.35.0-wmf.23" [production]
20:11 <brennen@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.23 [production]
20:10 <mutante> revoking puppet cert for doc.discovery.wmnet, re-creating with doc.wikimedia.org as SAN [production]
20:09 <eileen> civicrm revision changed from a301076871 to a1b2cbeac1, config revision is 37232d8460 [production]
19:46 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Revert "Set term store to WRITE_BOTH for all of Wikidata", take II (duration: 01m 06s) [production]
19:45 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Revert "Set term store to WRITE_BOTH for all of Wikidata" (duration: 01m 08s) [production]
19:20 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
19:18 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
18:53 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
18:51 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
18:43 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
18:40 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
18:34 <ebernhardson@deploy1001> Synchronized php-1.35.0-wmf.23/extensions/WikimediaEvents/modules/ext.wikimediaEvents/searchSatisfaction.js: cirrus: Start Glent m0 AB test (duration: 01m 07s) [production]
18:31 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: re-sync InitialiseSettings.php (duration: 01m 08s) [production]
18:29 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:579326|Set term store to WRITE_BOTH for all of Wikidata (T219123)]] (duration: 01m 07s) [production]
18:23 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:579348|Switch kowiki to use ORES for suggested edits topics]] (duration: 01m 08s) [production]
18:19 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
17:48 <elukey> increase via 'kadmin.local modprinc -maxlife 2d $user' all max ticket lifetimes of Kerberos User principals on the krb1001's KDC (changes will be propagated to codfw automatically) [production]
17:48 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
17:35 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
17:32 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
17:17 <elukey> execute modprinc -maxlife 2d krbtgt/WIKIMEDIA via kadmin.local on krb1001 (will be propagated to 2001 automatically) [production]
17:12 <volans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:06 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
17:03 <akosiaris@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'eventgate-analytics' for release 'canary' . [production]
17:03 <akosiaris@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'eventgate-analytics' for release 'production' . [production]
16:53 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-analytics' for release 'canary' . [production]
16:53 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-analytics' for release 'production' . [production]
16:41 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
16:39 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:37 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
16:36 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:28 <volans> restarting icinga, acting up on command file (frack awol and downtimes) [production]
16:20 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'canary' . [production]
16:20 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'production' . [production]
16:15 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
16:13 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
16:07 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
16:07 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:53 <rlazarus> uploading envoyproxy_1.13.1-1 (upgrade from 1.12.2) [production]
14:51 <elukey> restart kpropd daemon on krb2001 [production]
14:26 <volans@cumin2001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:23 <volans@cumin2001> START - Cookbook sre.dns.netbox [production]
14:07 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
13:35 <mvolz@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'zotero' for release 'staging' . [production]
13:26 <otto@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'eventstreams' for release 'canary' . [production]
13:26 <otto@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'eventstreams' for release 'production' . [production]