5551-5600 of 10000 results (36ms)
2020-07-21 §
07:13 <kormat> killing James_F('s script) on mwmaint1002 [production]
07:06 <_joe_> systemctl reset-failed on deneb, the usual known issue with releng image reporting [production]
07:03 <kormat@deploy1001> Synchronized wmf-config/db-eqiad.php: Disable writes to es4 T257847 (duration: 01m 00s) [production]
06:59 <kormat> Starting es4 failover from es1020 to es1021 T257847 [production]
06:54 <kormat@cumin1001> dbctl commit (dc=all): 'Set es1021 to weight 50 T257847', diff saved to https://phabricator.wikimedia.org/P11974 and previous config saved to /var/cache/conftool/dbconfig/20200721-065457-kormat.json [production]
06:54 <marostegui> Pool db1119 into enwiki with MCR schema change done - T238966 [production]
06:54 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1119', diff saved to https://phabricator.wikimedia.org/P11973 and previous config saved to /var/cache/conftool/dbconfig/20200721-065430-marostegui.json [production]
06:27 <_joe_> systemctl reset-failed on lists1001, a network interface was failing since 1 month [production]
06:26 <_joe_> enabling notifications for lists1001 [production]
06:23 <_joe_> systemctl reset-failed on both centrallogs [production]
02:43 <eileen> civicrm revision changed from 7f1e7d8e38 to cc5d17fbaf, config revision is 23460676f6 [production]
00:02 <ryankemper> Began Elasticsearch reindex job on index `dewiki_content` across [`eqiad`, `codfw`, `cloudelastic`], on `rkemper@mwmaint1002` under tmux session `reindex`. Should complete in <24 hours [production]
2020-07-20 §
23:49 <eileen> tools revision changed from b915d8efbd to 22550f38c5 [production]
23:34 <ejegg> updated fundraising CiviCRM from 8b09c87ce2 to 7f1e7d8e38 [production]
23:12 <urbanecm@deploy1001> Synchronized php-1.35.0-wmf.41/extensions/ProofreadPage/ProofreadPage.namespaces.php: 03ed74f0b9b8f55d01f9112c31f2f6ea17990f9c: Add ProofreadPage namespace translation for lij (T257672) (duration: 00m 57s) [production]
23:06 <Urbanecm> run mwscript namespaceDupes.php --wiki=lijwikisource -- fix (T257672) [production]
23:05 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 2147774caaa0819f8b5d71cc16bc021d94677702: Add English aliases for WS-specific namespaces to lijwikisource (T257672) (duration: 00m 57s) [production]
22:59 <ryankemper@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 613669: cirrussearch: Allow 2 dewiki->content shards/node | https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/613669 (duration: 00m 57s) [production]
22:17 <brennen> offlining integration-agent-docker-1003 for maintenance-disconnect-full-disks testing [releng]
22:02 <legoktm> onlined integration-agent-docker-1011 [releng]
22:01 <legoktm> onlined integration-agent-docker-1010 [releng]
22:00 <legoktm> onlined integration-agent-docker-1002 [releng]
21:53 <eileen> tools revision changed from 40d52a0008 to b915d8efbd [production]
21:33 <bd808> Created CNAME record for www.wmcloud.org pointing to wmcloud.org (T258415) [cloudinfra]
21:25 <bd808> Created A record for wmcloud.org pointing to proxy-proxy well known IP (T258415) [cloudinfra]
21:15 <sbassett> Revised mitigation deployed for T257687 [production]
20:45 <brennen> being testing changes to maintenance-disconnect-full-disks [releng]
20:21 <wm-bot> <bd808> Updated ingress to add $is_args when redirecting (T258444) [tools.iw]
20:20 <wm-bot> <bd808> Updated ingress to use $args rather than $request_uri when redirecting (T258444) [tools.iw]
20:13 <wm-bot> <bd808> Updated ingress to use $request_uri when redirecting (T258444) [tools.iw]
20:07 <eileen> tools revision changed from 711d671600 to 40d52a0008 [production]
19:56 <joal> kill-restart cassandra unique-devices loading daily and monthly after deploy (2020-07-20 and 2020-07-01) [analytics]
19:55 <joal> kill-restart mediawiki-history-denormalize after dpeloy (2020-07-01) [analytics]
19:55 <joal> kill-restart webrequest after dpeloy (2020-07-20T18:00) [analytics]
19:35 <halfak> deploying ores f3c44be [deployment-prep]
19:35 <halfak> deploying ores f3c44be [releng]
19:19 <mforns> finished refinery deployment (for v0.0.131) [analytics]
19:10 <mforns@deploy1001> Finished deploy [analytics/refinery@af86a05] (thin): Regular analytics weekly train THIN [analytics/refinery@af86a05be470ed8283f6585afb5cc231b26944a2] (duration: 00m 07s) [production]
19:10 <mforns@deploy1001> Started deploy [analytics/refinery@af86a05] (thin): Regular analytics weekly train THIN [analytics/refinery@af86a05be470ed8283f6585afb5cc231b26944a2] [production]
19:09 <mforns@deploy1001> Finished deploy [analytics/refinery@af86a05]: Regular analytics weekly train [analytics/refinery@af86a05be470ed8283f6585afb5cc231b26944a2] (duration: 05m 46s) [production]
19:03 <mforns@deploy1001> Started deploy [analytics/refinery@af86a05]: Regular analytics weekly train [analytics/refinery@af86a05be470ed8283f6585afb5cc231b26944a2] [production]
19:02 <mforns> starting refinery deployment (for v0.0.131) [analytics]
19:02 <mforns> deployed refinery-source v0.0.131 [analytics]
18:37 <urbanecm@deploy1001> Synchronized wmf-config/CommonSettings.php: df2584f181f08da0e1191f97e619e912e587b48d: Switch $wgUrlShortenerDomainsWhitelist --> $wgUrlShortenerAllowedDomains (T255491) (duration: 00m 57s) [production]
18:26 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: dfed4727c6f9e003f9e1949b2995a0cf0ad4f1cc: Adding rollbacker group for arzwiki (T258100) (duration: 00m 57s) [production]
18:24 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: ee7ac95e16f55e850b318f7354842795e08e0270: Change of rollbacker group settings at jawiki (T258339) (duration: 00m 57s) [production]
18:16 <joal> Rerun cassandra-daily-coord-local_group_default_T_unique_devices from 2020-07-15 to 2020-07-19 (both included) [analytics]
17:36 <ejegg> updated payments-wiki settings to point TY page at new URL [production]
16:48 <dancy> integration-agent-docker-1007 back online [releng]
16:32 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@10afb4b]: airflow: Turn off catchup on cirrus_namespace_map (duration: 00m 25s) [production]