501-550 of 10000 results (20ms)
2016-06-20 §
10:44 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1071 completelly (duration: 00m 25s) [production]
10:35 <jynus> db1071 stop, backup and reimage [production]
10:31 <mobrovac> restbase started mobile-sections dump for eswiki on restbase1009 for T136964 [production]
10:05 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1073 at 100% weight; depool db1071 for reimaging (duration: 00m 27s) [production]
09:50 <moritzm> rolling reboot of restbase2001/restbase2002 for upgrade to Linux 4.4 [production]
08:57 <Amir1> deploying 5dfe738 in ores nodes [production]
08:15 <moritzm> installing libxlst security updates [production]
07:43 <gehel> rebalancing shards on elasticsearch eqiad cluster [production]
06:47 <_joe_> activating the jessie jobrunner, mw1299 [production]
05:57 <ori@tin> Synchronized wmf-config/CommonSettings.php: Id5804a80: Better cache headers for 'Powered by MediaWiki' badge (2/2) (duration: 00m 35s) [production]
05:56 <ori@tin> Synchronized static/images: Id5804a80: Better cache headers for 'Powered by MediaWiki' badge (1/2) (duration: 00m 33s) [production]
02:29 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon Jun 20 02:29:01 UTC 2016 (duration 5m 44s) [production]
02:23 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.6) (duration: 09m 54s) [production]
2016-06-19 §
12:29 <elukey> restarted hhvm on mw1138 - trace in /tmp/hhvm.25048.bt, hhvm killed by OOM [production]
12:27 <elukey> restarted hhvm on mw1114 - trace in /tmp/hhvm.11092.bt, hhvm killed by OOM [production]
02:31 <l10nupdate@tin> ResourceLoader cache refresh completed at Sun Jun 19 02:31:25 UTC 2016 (duration 5m 47s) [production]
02:25 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.6) (duration: 10m 50s) [production]
2016-06-18 §
02:32 <l10nupdate@tin> ResourceLoader cache refresh completed at Sat Jun 18 02:32:26 UTC 2016 (duration 6m 18s) [production]
02:26 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.6) (duration: 10m 04s) [production]
2016-06-17 §
21:21 <urandom> Reenabling puppet and resetting configuration on xenon.eqiad.wmnet : T137419 [production]
20:39 <urandom> Restarting Cassandra on xenon.eqiad.wmnet to apply -XX:+PreserveFramePointer : T137419 [production]
20:35 <urandom> Disabling puppet on xenon.eqiad.wmnet : T137419 [production]
20:23 <maxsem@tin> Synchronized php-1.28.0-wmf.6/extensions/WikimediaEvents/: https://gerrit.wikimedia.org/r/#/c/294958/ (duration: 00m 33s) [production]
18:56 <urandom> Restarting Cassandra on xenon.eqiad.wmnet with -XX:+PreserveFramePointer : T137419 [production]
18:32 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1073 with low weight after reimage (duration: 00m 35s) [production]
16:29 <moritzm> installing squid security updates on carbon [production]
15:59 <urandom> Starting html dumps from xenon.eqiad.wmnet and cerium.eqiad.wmnet : T137419 [production]
15:54 <urandom> Restarting Cassandra on xenon.eqiad.wmnet to enable large pages : T137419 [production]
14:55 <mobrovac> scb disabling puppet for stopping change-prop to clear transclusion queues [production]
14:16 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Increase db1072 weight after repooling (duration: 00m 36s) [production]
12:57 <jynus> stopping, backuping and reimaging db1073 [production]
12:49 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1072 with low weight, depool db1073 (duration: 00m 27s) [production]
12:49 <moritzm> rolling reboot of mw1157-mw1160 into new kernels [production]
12:27 <moritzm> restarted hhvm on mw1133 and mw1135 [production]
11:14 <moritzm> stopping puppet on hosts using service::node (restbase, sca, scb, aqs) for step-by-step rollout of two puppet patches for firejail/service::node [production]
09:31 <_joe_> powercycling mw1140, OOMd [production]
09:30 <moritzm> rolling reboot of mw1153,mw1155,mw1156 into new kernels [production]
08:29 <hashar> Restarting Jenkins on gallium. Web interface at least is deadlocked somehow [production]
07:23 <jynus> backuping and reimaging db1072 [production]
07:18 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1072 for maintenance (duration: 00m 31s) [production]
07:11 <mobrovac> restbase started mobile-sections dump on restbase1009 for T136964 [production]
07:02 <mobrovac> change-prop restarting it to apply https://gerrit.wikimedia.org/r/294880 [production]
06:40 <moritzm> installing apache update on palladium [production]
06:16 <akosiaris> _joe_ restarted zotero on sca1001 [production]
06:16 <akosiaris> restarted zotero on sca1002 [production]
06:04 <root@palladium> conftool action : set/weight=25; selector: cluster=api_appserver,name=mw127.* [production]
05:58 <root@palladium> conftool action : set/pooled=yes:weight=20; selector: cluster=api_appserver,name=mw127.* [production]
02:31 <l10nupdate@tin> ResourceLoader cache refresh completed at Fri Jun 17 02:31:00 UTC 2016 (duration 6m 26s) [production]
02:24 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.6) (duration: 09m 46s) [production]
2016-06-16 §
23:44 <ebernhardson@tin> Synchronized php-1.28.0-wmf.6/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: T137167: TextCat A/B test for Language Identification (duration: 00m 25s) [production]