1-50 of 10000 results (29ms)
2016-06-19 §
12:29 <elukey> restarted hhvm on mw1138 - trace in /tmp/hhvm.25048.bt, hhvm killed by OOM [production]
12:27 <elukey> restarted hhvm on mw1114 - trace in /tmp/hhvm.11092.bt, hhvm killed by OOM [production]
02:31 <l10nupdate@tin> ResourceLoader cache refresh completed at Sun Jun 19 02:31:25 UTC 2016 (duration 5m 47s) [production]
02:25 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.6) (duration: 10m 50s) [production]
2016-06-18 §
02:32 <l10nupdate@tin> ResourceLoader cache refresh completed at Sat Jun 18 02:32:26 UTC 2016 (duration 6m 18s) [production]
02:26 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.6) (duration: 10m 04s) [production]
2016-06-17 §
21:21 <urandom> Reenabling puppet and resetting configuration on xenon.eqiad.wmnet : T137419 [production]
20:39 <urandom> Restarting Cassandra on xenon.eqiad.wmnet to apply -XX:+PreserveFramePointer : T137419 [production]
20:35 <urandom> Disabling puppet on xenon.eqiad.wmnet : T137419 [production]
20:23 <maxsem@tin> Synchronized php-1.28.0-wmf.6/extensions/WikimediaEvents/: https://gerrit.wikimedia.org/r/#/c/294958/ (duration: 00m 33s) [production]
18:56 <urandom> Restarting Cassandra on xenon.eqiad.wmnet with -XX:+PreserveFramePointer : T137419 [production]
18:32 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1073 with low weight after reimage (duration: 00m 35s) [production]
16:29 <moritzm> installing squid security updates on carbon [production]
15:59 <urandom> Starting html dumps from xenon.eqiad.wmnet and cerium.eqiad.wmnet : T137419 [production]
15:54 <urandom> Restarting Cassandra on xenon.eqiad.wmnet to enable large pages : T137419 [production]
14:55 <mobrovac> scb disabling puppet for stopping change-prop to clear transclusion queues [production]
14:16 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Increase db1072 weight after repooling (duration: 00m 36s) [production]
12:57 <jynus> stopping, backuping and reimaging db1073 [production]
12:49 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1072 with low weight, depool db1073 (duration: 00m 27s) [production]
12:49 <moritzm> rolling reboot of mw1157-mw1160 into new kernels [production]
12:27 <moritzm> restarted hhvm on mw1133 and mw1135 [production]
11:14 <moritzm> stopping puppet on hosts using service::node (restbase, sca, scb, aqs) for step-by-step rollout of two puppet patches for firejail/service::node [production]
09:31 <_joe_> powercycling mw1140, OOMd [production]
09:30 <moritzm> rolling reboot of mw1153,mw1155,mw1156 into new kernels [production]
08:29 <hashar> Restarting Jenkins on gallium. Web interface at least is deadlocked somehow [production]
07:23 <jynus> backuping and reimaging db1072 [production]
07:18 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1072 for maintenance (duration: 00m 31s) [production]
07:11 <mobrovac> restbase started mobile-sections dump on restbase1009 for T136964 [production]
07:02 <mobrovac> change-prop restarting it to apply https://gerrit.wikimedia.org/r/294880 [production]
06:40 <moritzm> installing apache update on palladium [production]
06:16 <akosiaris> _joe_ restarted zotero on sca1001 [production]
06:16 <akosiaris> restarted zotero on sca1002 [production]
06:04 <root@palladium> conftool action : set/weight=25; selector: cluster=api_appserver,name=mw127.* [production]
05:58 <root@palladium> conftool action : set/pooled=yes:weight=20; selector: cluster=api_appserver,name=mw127.* [production]
02:31 <l10nupdate@tin> ResourceLoader cache refresh completed at Fri Jun 17 02:31:00 UTC 2016 (duration 6m 26s) [production]
02:24 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.6) (duration: 09m 46s) [production]
2016-06-16 §
23:44 <ebernhardson@tin> Synchronized php-1.28.0-wmf.6/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: T137167: TextCat A/B test for Language Identification (duration: 00m 25s) [production]
23:24 <ebernhardson@tin> Synchronized php-1.28.0-wmf.6/extensions/WikimediaEvents/extension.json: T137167: TextCat A/B test for Language Identification (duration: 00m 24s) [production]
23:19 <ebernhardson@tin> Synchronized php-1.28.0-wmf.6/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: T137167: TextCat A/B test for Language Identification (duration: 00m 24s) [production]
23:16 <ebernhardson@tin> Synchronized wmf-config/InitialiseSettings.php: T137167: search: Dependent config for textcat AB test. (duration: 00m 26s) [production]
23:11 <ebernhardson@tin> Synchronized wmf-config/InitialiseSettings.php: T137888: Two permission changes at urwiki (duration: 00m 27s) [production]
23:07 <ebernhardson@tin> Synchronized wmf-config/InitialiseSettings-labs.php: T127250: Prepare Wikidata descriptions on mobile for production rollout (duration: 00m 27s) [production]
22:33 <maxsem@tin> Synchronized php-1.28.0-wmf.6/extensions/Kartographer: https://gerrit.wikimedia.org/r/294856 https://gerrit.wikimedia.org/r/294855 (duration: 00m 30s) [production]
22:24 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/294854/ (duration: 00m 26s) [production]
21:15 <hashar@tin> Synchronized php-1.28.0-wmf.6/extensions/VisualEditor/ApiVisualEditor.php: Pass empty summary to parseAndStash() to avoid warnings T137995 (duration: 00m 39s) [production]
19:05 <hashar@tin> rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.28.0-wmf.6 [production]
18:37 <tgr> running invalidateUserSessions.php for T137799 [production]
18:22 <mobrovac> change-prop deploying bc87a1fecfa [production]
16:36 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Set all new slaves to medium weight (300) after warm up (duration: 00m 25s) [production]
15:37 <jynus> deleted sqldata.s6 from labsdb1008 - space issues caused by queries creating temporary tables [production]