6451-6500 of 10000 results (38ms)
2014-06-25 §
13:30 <Krinkle> Depooling integration-slave1003 as almost every other -npm build on this node fails due to corrupted ~/.npm cache [production]
12:52 <manybubbles> cirrus rebuild update: starting from mediawiki reindex step for all alphabetical wikis that have finished so far [production]
12:25 <hashar> Upgraded Zuul 9839edb..b7fc126 Brings patchset 20 of Zuul cloner ( https://review.openstack.org/#/c/70373/ ) [production]
12:02 <akosiaris> upgraded etherpad.wikimedia.org to etherpad-lite 1.4.0 [production]
11:12 <paravoid> switching inbound email for wikimedia.org to polonium/mchenry [production]
10:35 <_joe_> restarted lucene on search1016 as it was stuck there as well, once search1015 is up and running [production]
10:06 <_joe_> restarted lucene on search1015, it was stuck [production]
07:37 <springle> Synchronized wmf-config/db-eqiad.php: incremental LB bump on db1009 and db1021 traffic samplers (duration: 00m 07s) [production]
06:31 <springle> Synchronized wmf-config/db-eqiad.php: repool db1021 with traffic sampling (duration: 00m 09s) [production]
06:01 <springle> Synchronized wmf-config/db-eqiad.php: depool db1021, db1049 to normal load (duration: 00m 07s) [production]
05:05 <springle> Synchronized wmf-config/db-eqiad.php: repool db1049, warm up (duration: 00m 08s) [production]
02:50 <LocalisationUpdate> ResourceLoader cache refresh completed at Wed Jun 25 02:48:53 UTC 2014 (duration 48m 52s) [production]
02:39 <springle> xtrabackup clone db1005 to db1049 [production]
02:27 <LocalisationUpdate> completed (1.24wmf10) at 2014-06-25 02:25:57+00:00 [production]
02:19 <springle> Synchronized wmf-config/db-eqiad.php: depool db1049 (duration: 00m 11s) [production]
02:14 <LocalisationUpdate> completed (1.24wmf9) at 2014-06-25 02:13:27+00:00 [production]
00:57 <chasemp> added dns for wikimania 2015 (gerrit 140186) [production]
2014-06-24 §
23:28 <ori> apache-graceful-all was for Ifc9596cc7 [production]
23:28 <ori> gracefulled all apaches [production]
23:12 <maxsem> Synchronized visualeditor.dblist: https://gerrit.wikimedia.org/r/141702 (duration: 00m 03s) [production]
23:11 <maxsem> Synchronized php-1.24wmf10/extensions/MultimediaViewer: (no message) (duration: 00m 05s) [production]
23:02 <ori> apache graceful done by me for I543efda24, I29b34689e, and I1c269433e [production]
23:00 <root> gracefulled all apaches [production]
20:53 <hashar> Jenkins / Zuul deploying experimental pipeline {{gerrit|141827}} [production]
20:29 <RoanKattouw> Restarting Apache on mw1220, getting lots of "Unable to allocate memory for pool" errors [production]
20:29 <ottomata> rebooting analytics1021 [production]
20:25 <ottomata> reinitializing varnish topics with replication factor of 3 [production]
20:02 <hashar> updated our Jenkins Job Builder copy 416ee7d..e9db73d [production]
19:58 <hashar> Upgraded Zuul on gallium.wikimedia.org to install the zuul-cloner of doom. 4f9fd51..9839edb Tagged wmf-deploy-20140624-1 in our repo. [production]
19:39 <manybubbles> rebuilding search index for group1 wikis after upgrade today [production]
18:27 <reedy> Synchronized docroot and w: (no message) (duration: 00m 14s) [production]
18:25 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: Non Wikipedias to 1.24wmf10 [production]
17:53 <manybubbles> Synchronized wmf-config: Drop Cirrus indexes to five shards on rebuild and switch all wikis to new highlighter (duration: 00m 04s) [production]
17:44 <aaron> Synchronized wmf-config/InitialiseSettings.php: Maintenance reports limit incremental increase (duration: 00m 08s) [production]
17:37 <springle> Synchronized wmf-config/db-eqiad.php: reduce db1021 load (duration: 00m 10s) [production]
17:06 <akosiaris> restarted hadoop yarn on analytics1013 [production]
15:37 <bblack> VCL compilation is now in-sync everywhere but bits caches... [production]
15:21 <manybubbles> Synchronized php-1.24wmf9/extensions/CirrusSearch/: SWAT Stop Cirrus from breaking RandomRootPage (duration: 00m 06s) [production]
15:15 <manybubbles> Synchronized php-1.24wmf10/extensions/CirrusSearch/: SWAT Stop Cirrus from breaking RandomRootPage (duration: 00m 04s) [production]
15:06 <manybubbles> Synchronized wmf-config/: SWAT - visual editor config changes and retire some beta features (duration: 00m 04s) [production]
15:05 <manybubbles> Synchronized visualeditor-default.dblist: SWAT - Enable VisualEditor by default on Wikimania 2014 wiki (duration: 00m 04s) [production]
15:05 <manybubbles> Synchronized visualeditor.dblist: SWAT - Enable VisualEditor by default on Wikimania 2014 wiki (duration: 00m 06s) [production]
15:03 <manybubbles> Synchronized php-1.24wmf10/includes/config/GlobalVarConfig.php: SWAT - GlobalVarConfig should not throw exceptions for null-valued config settings (duration: 00m 05s) [production]
14:54 <hoo> Synchronized wmf-config/CommonSettings.php: Enable Wikibase property suggester on beta (duration: 00m 07s) [production]
14:15 <hashar> Jenkins set SMTP server to wiki-mail.wikimedia.org smtp.pmtpa.wmnet got deleted [production]
14:07 <hashar> Jenkins is back [production]
13:59 <Krinkle> Build logs in Jenkins incorrectly render ansi color codes since it was upgraded to 0.4.0. Downgrading to 0.3.1 and restarting Jenkins. [production]
09:55 <godog> removing old salt master cache on palladium, moved yesterday out of the way [production]
06:59 <springle> Synchronized wmf-config/db-eqiad.php: repool db1049 (duration: 00m 08s) [production]
06:24 <Nemo_bis> FYI no gerrit mail since yesterday 15 UTC, https://bugzilla.wikimedia.org/show_bug.cgi?id=67018 [production]