7401-7450 of 10000 results (39ms)
2014-09-19 §
16:21 <bblack> restarted hhvm on mw1019 + 1021 [production]
14:57 <hashar> Jenkins friday deploy: migrate all MediaWiki extension qunit jobs to Zuul cloner. [production]
14:37 <akosiaris> initiated rsync of tridge data that is to be kept to nas1001-a [production]
13:56 <springle> killing any sleeping connection on enwiki db slaves to make room [production]
13:56 <mark> Stopped jobrunners on mw1001-1003 [production]
12:36 <springle> temporarily disable log fsync on enwiki slaves [production]
12:14 <springle> Synchronized wmf-config/db-eqiad.php: repool db1072 with ReadAheadNone (duration: 00m 09s) [production]
11:32 <springle> Synchronized wmf-config/db-eqiad.php: depool db1072. seems more susceptible to replag; find out why. (duration: 00m 10s) [production]
09:14 <_joe_> restarted hhvm on mw1053, stuck to 100% cpu since last restart (activating stats) [production]
05:01 <LocalisationUpdate> ResourceLoader cache refresh completed at Fri Sep 19 05:01:54 UTC 2014 (duration 1m 52s) [production]
03:45 <LocalisationUpdate> completed (1.24wmf22) at 2014-09-19 03:45:33+00:00 [production]
03:11 <LocalisationUpdate> completed (1.24wmf21) at 2014-09-19 03:11:43+00:00 [production]
02:38 <LocalisationUpdate> completed (1.24wmf20) at 2014-09-19 02:38:25+00:00 [production]
00:43 <cscott> updated OCG to version ce16f7adb60d7c77409e2e11ba0e5d6cce6955d5 [production]
2014-09-18 §
23:55 <ori> Started scap: Add HHVM as a beta feature [production]
23:54 <ori> Synchronized wmf-config/InitialiseSettings.php: I2466f6b6e: Add HHVM to beta feature whitelist (duration: 00m 08s) [production]
23:52 <ori> Synchronized php-1.24wmf22/extensions/WikimediaEvents: Update WikimediaEvents for cherry-picks (duration: 00m 06s) [production]
23:51 <ori> Synchronized php-1.24wmf21/extensions/WikimediaEvents: Update WikimediaEvents for cherry-picks (duration: 00m 06s) [production]
23:25 <catrope> Synchronized php-1.24wmf22/resources/lib/oojs-ui/: oojs-ui bugfixes (duration: 00m 06s) [production]
23:13 <catrope> Synchronized php-1.24wmf22/extensions/VisualEditor/: SWAT (duration: 00m 08s) [production]
23:04 <catrope> Synchronized php-1.24wmf21/extensions/UploadWizard/: SWAT (duration: 00m 08s) [production]
19:57 <Jeff_Green> iridium.wm.o exim conf checked, puppet reenabled [production]
19:54 <Jeff_Green> magnesium.wm.o exim conf checked, puppet reenabled [production]
19:50 <Jeff_Green> sodium.wm.o exim conf checked, puppet reenabled [production]
19:48 <reedy> Synchronized php-1.24wmf22/extensions/Flow/: (no message) (duration: 00m 16s) [production]
19:45 <Jeff_Green> iodine.wm.o exim conf checked, puppet reenabled [production]
19:44 <Jeff_Green> polonium.wm.o exim conf checked, puppet reenabled [production]
19:35 <Jeff_Green> lead.wm.o exim conf checked, puppet reenabled [production]
19:22 <reedy> Synchronized php-1.24wmf22: (no message) (duration: 00m 57s) [production]
19:16 <Jeff_Green> disabling puppet on polonium, lead, sodium, iridium, magnesium, and iodine to monitor rollout of https://gerrit.wikimedia.org/r/155753 [production]
19:05 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: rest of group0 to 1.24wmf22 [production]
19:01 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: Wikipedias to 1.24wmf21 [production]
18:59 <bblack> restarting apache on fenari [production]
18:49 <reedy> Finished scap: testwiki to 1.24wmf22 and build l10n cache (duration: 30m 23s) [production]
18:44 <Jeff_Green> testing exim configuration change on lead.wm.o [production]
18:19 <reedy> Started scap: testwiki to 1.24wmf22 and build l10n cache [production]
17:49 <reedy> Started scap: testwiki to 1.24wmf22 and build l10n cache [production]
17:08 <cmjohnson1> replacing failed disk es1005 [production]
17:05 <yurik> Finished scap: (no message) (duration: 23m 26s) [production]
16:43 <yurikR> yurik scaping zero - partner needs an l10n message asap [production]
16:42 <yurik> Started scap: (no message) [production]
15:38 <hashar> restarting Zuul just to be safe [production]
15:06 <anomie> Synchronized php-1.24wmf21/resources/src/mediawiki.action/mediawiki.action.view.redirectPage.css: SWAT: mediawiki.action.view.redirectPage: Correct a CSS selector [[gerrit:161239]] (duration: 00m 23s) [production]
15:02 <anomie> Synchronized php-1.24wmf21/extensions/Wikidata/: SWAT: Update Wikidata to fix broken xml api output [[gerrit:161232]] (duration: 00m 38s) [production]
11:40 <apergos> forgot to log this earlier: manually started salt minion on radon, elastic1015, searchidx1001, it wasn't running there [production]
09:00 <godog> updated authdns to 0c2225d [production]
08:56 <springle> xtrabackup clone db1016 to db2010 [production]
07:48 <godog> re-enabled icinga notifications for ms-be1001 [production]
07:10 <bblack> removing pybal cfg "eqiad/misc_web_https" (unused now, https://gerrit.wikimedia.org/r/161183) [production]
06:53 <bblack> removing pybal cfg "esams/wikimedialbsecure" (unused, points at maerlant) [production]