1551-1600 of 10000 results (20ms)
2020-07-21 §
06:27 <_joe_> systemctl reset-failed on lists1001, a network interface was failing since 1 month [production]
06:26 <_joe_> enabling notifications for lists1001 [production]
06:23 <_joe_> systemctl reset-failed on both centrallogs [production]
02:43 <eileen> civicrm revision changed from 7f1e7d8e38 to cc5d17fbaf, config revision is 23460676f6 [production]
00:02 <ryankemper> Began Elasticsearch reindex job on index `dewiki_content` across [`eqiad`, `codfw`, `cloudelastic`], on `rkemper@mwmaint1002` under tmux session `reindex`. Should complete in <24 hours [production]
2020-07-20 §
23:49 <eileen> tools revision changed from b915d8efbd to 22550f38c5 [production]
23:34 <ejegg> updated fundraising CiviCRM from 8b09c87ce2 to 7f1e7d8e38 [production]
23:12 <urbanecm@deploy1001> Synchronized php-1.35.0-wmf.41/extensions/ProofreadPage/ProofreadPage.namespaces.php: 03ed74f0b9b8f55d01f9112c31f2f6ea17990f9c: Add ProofreadPage namespace translation for lij (T257672) (duration: 00m 57s) [production]
23:06 <Urbanecm> run mwscript namespaceDupes.php --wiki=lijwikisource -- fix (T257672) [production]
23:05 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 2147774caaa0819f8b5d71cc16bc021d94677702: Add English aliases for WS-specific namespaces to lijwikisource (T257672) (duration: 00m 57s) [production]
22:59 <ryankemper@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 613669: cirrussearch: Allow 2 dewiki->content shards/node | https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/613669 (duration: 00m 57s) [production]
21:53 <eileen> tools revision changed from 40d52a0008 to b915d8efbd [production]
21:15 <sbassett> Revised mitigation deployed for T257687 [production]
20:07 <eileen> tools revision changed from 711d671600 to 40d52a0008 [production]
19:10 <mforns@deploy1001> Finished deploy [analytics/refinery@af86a05] (thin): Regular analytics weekly train THIN [analytics/refinery@af86a05be470ed8283f6585afb5cc231b26944a2] (duration: 00m 07s) [production]
19:10 <mforns@deploy1001> Started deploy [analytics/refinery@af86a05] (thin): Regular analytics weekly train THIN [analytics/refinery@af86a05be470ed8283f6585afb5cc231b26944a2] [production]
19:09 <mforns@deploy1001> Finished deploy [analytics/refinery@af86a05]: Regular analytics weekly train [analytics/refinery@af86a05be470ed8283f6585afb5cc231b26944a2] (duration: 05m 46s) [production]
19:03 <mforns@deploy1001> Started deploy [analytics/refinery@af86a05]: Regular analytics weekly train [analytics/refinery@af86a05be470ed8283f6585afb5cc231b26944a2] [production]
18:37 <urbanecm@deploy1001> Synchronized wmf-config/CommonSettings.php: df2584f181f08da0e1191f97e619e912e587b48d: Switch $wgUrlShortenerDomainsWhitelist --> $wgUrlShortenerAllowedDomains (T255491) (duration: 00m 57s) [production]
18:26 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: dfed4727c6f9e003f9e1949b2995a0cf0ad4f1cc: Adding rollbacker group for arzwiki (T258100) (duration: 00m 57s) [production]
18:24 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: ee7ac95e16f55e850b318f7354842795e08e0270: Change of rollbacker group settings at jawiki (T258339) (duration: 00m 57s) [production]
17:36 <ejegg> updated payments-wiki settings to point TY page at new URL [production]
16:32 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@10afb4b]: airflow: Turn off catchup on cirrus_namespace_map (duration: 00m 25s) [production]
16:31 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@10afb4b]: airflow: Turn off catchup on cirrus_namespace_map [production]
16:27 <akosiaris> increase codfw mobileapps kubernetes traffic to 25% T218733. Take #2 [production]
16:27 <akosiaris@cumin1001> conftool action : set/weight=8; selector: dc=codfw,service=mobileapps,name=scb.* [production]
15:59 <elukey> restart airflow-webserver/scheduler to pick up TLS to mysql settings [production]
15:21 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:21 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:17 <hnowlan> draining and restarting sessionstore2002 [production]
15:17 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:17 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:16 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
15:13 <jynus> dropping and recreating nagios@localhost users on all m1 servers [production]
15:12 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
15:09 <hnowlan> draining and restarting sessionstore2001 [production]
15:09 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:09 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:09 <hnowlan@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
15:09 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:08 <moritzm> draining restbase2023 for eventual reboot for kernel security update [production]
15:04 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
15:00 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
14:56 <moritzm> draining restbase2022 for eventual reboot for kernel security update [production]
14:56 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:56 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
14:54 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
14:52 <hnowlan> draining and restarting sessionstore1003 [production]
14:52 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:52 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]