5001-5050 of 10000 results (32ms)
2020-05-13 ยง
22:26 <ryankemper> Pooled wdqs1008 given that lag has returned to normal levels and the instance is responding to queries correctly [production]
21:30 <elukey> powercycle analytics1055 [production]
21:05 <eileen> civicrm revision changed from cfb6101e39 to ed4c9522ac, config revision is 2eb75f8dff [production]
20:16 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: T242430 Stop loading the ParsoidBatchAPI extension (duration: 01m 08s) [production]
19:09 <hashar@deploy1001> Synchronized php: group1 wikis to 1.35.0-wmf.32 (duration: 01m 05s) [production]
19:08 <hashar@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.32 [production]
18:54 <twentyafterfour> restarted php-fpm on phab1001 [production]
18:53 <thcipriani> restarting gerrit [production]
18:52 <twentyafterfour> restarting apache on phab1001 for lack of a better idea [production]
18:50 <herron> restarted kafka broker on kafka-main1001 for java security updates [production]
18:22 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 38db3e0: Update production wordmarks (T252143) (duration: 01m 07s) [production]
18:17 <urbanecm@deploy1001> Synchronized static/images/mobile/copyright/: SWAT: 38db3e0: Update production wordmarks (T252143) (duration: 01m 09s) [production]
17:55 <hnowlan@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
17:53 <hnowlan@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
17:52 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
17:51 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
17:24 <ryankemper> Manually depooled wdqs2005 while lag catches up following the data xfer [production]
17:21 <ryankemper@cumin1001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
17:18 <ryankemper@cumin2001> END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) [production]
17:12 <urandom> restarted cassandra-c, restbase2017 [production]
17:04 <hnowlan@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
16:57 <hnowlan@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'changeprop' for release 'production' . [production]
16:54 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
16:11 <James_F> Running AbuseFilter updateVarDumps on group0 on mwmaint1002 T246539 [production]
16:00 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
15:58 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
15:41 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
15:38 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
15:34 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
15:32 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
15:32 <vgutierrez> upgrade ats to version 8.0.7-1wm7 on cp4032 [production]
15:30 <ryankemper@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
15:30 <jayme> imported scap 3.14.0-1 to main for buster-wikimedia [production]
15:30 <jayme> imported scap 3.14.0-1 to main for jessie-wikimedia [production]
15:29 <ryankemper> Manually de-pooling `wdqs1008.eqiad.wmnet` in preparation for wdqs data transfer [production]
15:29 <jayme> imported scap 3.14.0-1 to main for stretch-wikimedia [production]
15:26 <ryankemper@cumin2001> START - Cookbook sre.wdqs.data-transfer [production]
15:23 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . [production]
15:08 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
15:06 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
14:54 <_joe_> upgrading + restarting purged across ulsfo and codfw T133821 [production]
14:50 <filippo@deploy1001> Finished deploy [librenms/librenms@0a88d64]: Upgrade LibreNMS to 1.63 T251222 (duration: 00m 10s) [production]
14:50 <filippo@deploy1001> Started deploy [librenms/librenms@0a88d64]: Upgrade LibreNMS to 1.63 T251222 [production]
14:35 <vgutierrez> upload trafficserver 8.0.7-1wm6 to apt.wm.o (buster) - T249335 T251537 [production]
13:59 <mholloway-shell@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . [production]
13:57 <mholloway-shell@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . [production]
13:55 <mholloway-shell@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'wikifeeds' for release 'staging' . [production]
11:39 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:595881|Add *.deutsche-digitale-bibliothek.de to the wgCopyUploadsDomains (T252296)]] (duration: 01m 06s) [production]
11:17 <Amir1> EU SWAT is done [production]
11:14 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:596180|Disable wgLegacyJavaScriptGlobals on fawiki and wikidatawiki (T72470)]] (duration: 01m 06s) [production]