551-600 of 10000 results (9ms)
2013-10-22 §
18:35 <bsitu> synchronized wmf-config/InitialiseSettings.php 'touch' [production]
18:09 <bsitu> synchronized echowikis.dblist 'Enable Echo and Thanks on all wikis except dewiki and itwiki' [production]
18:08 <bsitu> synchronized wmf-config/InitialiseSettings.php 'Enable Echo and Thanks on all wikis except dewiki and itwiki' [production]
18:01 <mutante> restarting a few Apaches that didnt get restarted by graceful-all (hrmmpf) [production]
17:51 <awight> civicrm updated 41b621ab759fbafc9dcc9cf8323d1bdd973dfb72 to 6f370cccad7f963dd1cfbc2fdd9c68a5b2288836 [production]
17:23 <mark> Banned Content-Type == "application/x-httpd-php" in text Varnish (eqiad) [production]
17:19 <mutante> apache graceful-all [production]
17:06 <mutante> sync-apache, graceful to unify www portal docroots [production]
16:31 <demon> synchronized wmf-config/InitialiseSettings.php 'Touch' [production]
16:26 <demon> synchronized cirrus.dblist 'foundationwiki gets cirrus' [production]
16:19 <reedy> synchronized docroot/wwwportal [production]
10:09 <apergos> powercycled sq80, hung on mgmt console [production]
09:42 <hashar> Zuul: no more voting on code-review label {{bug|55757}} {{gerrit|91157}}. Will make the database happier I guess [production]
09:30 <springle> synchronized wmf-config/db-eqiad.php 'repool db1018' [production]
03:46 <springle> synchronized wmf-config/db-eqiad.php 'repool db1007, warm up db1041' [production]
03:06 <LocalisationUpdate> ResourceLoader cache refresh completed at Tue Oct 22 03:06:46 UTC 2013 [production]
03:00 <springle> upgrading db1017 to precise [production]
02:39 <LocalisationUpdate> completed (1.22wmf21) at Tue Oct 22 02:39:32 UTC 2013 [production]
02:25 <LocalisationUpdate> completed (1.22wmf22) at Tue Oct 22 02:25:12 UTC 2013 [production]
01:41 <springle> start xtrabackup clone db1007 to db1041 [production]
01:26 <springle> start xtrabackup clone db1018 to db1034 [production]
01:07 <springle> upgrading db1034 & db1041 to precise [production]
00:53 <springle> synchronized wmf-config/db-eqiad.php 'depool db1007 while cloning' [production]
00:46 <awight> crm schema change: wmf_civicrm 6008->6009 [production]
00:40 <springle> synchronized wmf-config/db-eqiad.php 'depool db1018 while cloning' [production]
00:36 <awight> manual schema change on crm: update system set schema_version=6008 where name='wmf_civicrm'; [production]
00:24 <awight> fundraising-crm updated from 9247de6335d74d32447944eef467960edc74ae84 to 41b621ab759fbafc9dcc9cf8323d1bdd973dfb72 [production]
2013-10-21 §
23:22 <mwalker> synchronized php-1.22wmf21/extensions/CentralNotice/ 'Reverting earlier change' [production]
23:21 <mwalker> synchronized php-1.22wmf22/extensions/CentralNotice/ 'Reverting earlier change' [production]
23:17 <mwalker> CentralNotice deploy had an issue where we are now pushing ALL traffic to the mobile site for CN -- ganglia reports a spike and I'm now reverting the change [production]
23:09 <^demon|lunch> elastic: index created for bnwiki, running force indexing in 4 processes on terbium [production]
23:07 <demon> synchronized wmf-config/InitialiseSettings.php 'bnwiki gets cirrus as secondary' [production]
23:05 <mwalker> synchronized php-1.22wmf22/extensions/CentralNotice/ 'Updating CentralNotice to master' [production]
23:05 <mwalker> synchronized php-1.22wmf21/extensions/CentralNotice/ 'Updating CentralNotice to master' [production]
22:49 <paravoid> powercycling ms-be1004, locked up(?) [production]
22:13 <maxsem> synchronized php-1.22wmf22/extensions/MobileFrontend/ 'https://gerrit.wikimedia.org/r/91065' [production]
22:04 <AaronSchulz> Running syncFilebackend on all wikis (should reduce sync errors; a few a popping up in the logs) [production]
21:34 <aaron> synchronized wmf-config/filebackend.php 'Added eqiad swift to multiwrite backends' [production]
21:06 <cmjohnson1> morebots are you working? [production]
21:04 <cmjohnson1> dns update [production]
20:05 <cmjohnson1> dns update [production]
19:38 <cmjohnson1> dns update [production]
18:40 <reedy> synchronized wmf-config/interwiki.cdb 'Updating interwiki cache' [production]
18:34 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: Non wikipedias to 1.22wmf22 [production]
18:29 <reedy> synchronized wmf-config/InitialiseSettings.php [production]
17:44 <cmjohnson1> reclaiming cp1021-36, cp1041-42 per RT5981 [production]
17:24 <Reedy> The @Wikimedia Operations team is seeking proposals for a new datacenter in the midwestern/western US: https://blog.wikimedia.org/2013/10/21/rfp-new-datacenter-continental-us/ [production]
16:30 <ori-l> ran sync-apache for I1113b9594 & Ie73ce6213; verified on mw60; gracefuling. [production]
16:26 <demon> synchronized wmf-config/CirrusSearch-production.php 'LVS for cirrus on all wikis' [production]
16:11 <demon> synchronized wmf-config/CirrusSearch-production.php 'LVS for cirrus on test2wiki' [production]