2013-10-22
§
|
19:23 |
<cmjohnson1> |
dns update |
[production] |
18:42 |
<bsitu> |
synchronized php-1.22wmf21/extensions/Echo/modules/overlay 'touch' |
[production] |
18:35 |
<bsitu> |
synchronized wmf-config/InitialiseSettings.php 'touch' |
[production] |
18:09 |
<bsitu> |
synchronized echowikis.dblist 'Enable Echo and Thanks on all wikis except dewiki and itwiki' |
[production] |
18:08 |
<bsitu> |
synchronized wmf-config/InitialiseSettings.php 'Enable Echo and Thanks on all wikis except dewiki and itwiki' |
[production] |
18:01 |
<mutante> |
restarting a few Apaches that didnt get restarted by graceful-all (hrmmpf) |
[production] |
17:51 |
<awight> |
civicrm updated 41b621ab759fbafc9dcc9cf8323d1bdd973dfb72 to 6f370cccad7f963dd1cfbc2fdd9c68a5b2288836 |
[production] |
17:23 |
<mark> |
Banned Content-Type == "application/x-httpd-php" in text Varnish (eqiad) |
[production] |
17:19 |
<mutante> |
apache graceful-all |
[production] |
17:06 |
<mutante> |
sync-apache, graceful to unify www portal docroots |
[production] |
16:31 |
<demon> |
synchronized wmf-config/InitialiseSettings.php 'Touch' |
[production] |
16:26 |
<demon> |
synchronized cirrus.dblist 'foundationwiki gets cirrus' |
[production] |
16:19 |
<reedy> |
synchronized docroot/wwwportal |
[production] |
10:09 |
<apergos> |
powercycled sq80, hung on mgmt console |
[production] |
09:42 |
<hashar> |
Zuul: no more voting on code-review label {{bug|55757}} {{gerrit|91157}}. Will make the database happier I guess |
[production] |
09:30 |
<springle> |
synchronized wmf-config/db-eqiad.php 'repool db1018' |
[production] |
03:46 |
<springle> |
synchronized wmf-config/db-eqiad.php 'repool db1007, warm up db1041' |
[production] |
03:06 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Tue Oct 22 03:06:46 UTC 2013 |
[production] |
03:00 |
<springle> |
upgrading db1017 to precise |
[production] |
02:39 |
<LocalisationUpdate> |
completed (1.22wmf21) at Tue Oct 22 02:39:32 UTC 2013 |
[production] |
02:25 |
<LocalisationUpdate> |
completed (1.22wmf22) at Tue Oct 22 02:25:12 UTC 2013 |
[production] |
01:41 |
<springle> |
start xtrabackup clone db1007 to db1041 |
[production] |
01:26 |
<springle> |
start xtrabackup clone db1018 to db1034 |
[production] |
01:07 |
<springle> |
upgrading db1034 & db1041 to precise |
[production] |
00:53 |
<springle> |
synchronized wmf-config/db-eqiad.php 'depool db1007 while cloning' |
[production] |
00:46 |
<awight> |
crm schema change: wmf_civicrm 6008->6009 |
[production] |
00:40 |
<springle> |
synchronized wmf-config/db-eqiad.php 'depool db1018 while cloning' |
[production] |
00:36 |
<awight> |
manual schema change on crm: update system set schema_version=6008 where name='wmf_civicrm'; |
[production] |
00:24 |
<awight> |
fundraising-crm updated from 9247de6335d74d32447944eef467960edc74ae84 to 41b621ab759fbafc9dcc9cf8323d1bdd973dfb72 |
[production] |
2013-10-21
§
|
23:22 |
<mwalker> |
synchronized php-1.22wmf21/extensions/CentralNotice/ 'Reverting earlier change' |
[production] |
23:21 |
<mwalker> |
synchronized php-1.22wmf22/extensions/CentralNotice/ 'Reverting earlier change' |
[production] |
23:17 |
<mwalker> |
CentralNotice deploy had an issue where we are now pushing ALL traffic to the mobile site for CN -- ganglia reports a spike and I'm now reverting the change |
[production] |
23:09 |
<^demon|lunch> |
elastic: index created for bnwiki, running force indexing in 4 processes on terbium |
[production] |
23:07 |
<demon> |
synchronized wmf-config/InitialiseSettings.php 'bnwiki gets cirrus as secondary' |
[production] |
23:05 |
<mwalker> |
synchronized php-1.22wmf22/extensions/CentralNotice/ 'Updating CentralNotice to master' |
[production] |
23:05 |
<mwalker> |
synchronized php-1.22wmf21/extensions/CentralNotice/ 'Updating CentralNotice to master' |
[production] |
22:49 |
<paravoid> |
powercycling ms-be1004, locked up(?) |
[production] |
22:13 |
<maxsem> |
synchronized php-1.22wmf22/extensions/MobileFrontend/ 'https://gerrit.wikimedia.org/r/91065' |
[production] |
22:04 |
<AaronSchulz> |
Running syncFilebackend on all wikis (should reduce sync errors; a few a popping up in the logs) |
[production] |
21:34 |
<aaron> |
synchronized wmf-config/filebackend.php 'Added eqiad swift to multiwrite backends' |
[production] |
21:06 |
<cmjohnson1> |
morebots are you working? |
[production] |
21:04 |
<cmjohnson1> |
dns update |
[production] |
20:05 |
<cmjohnson1> |
dns update |
[production] |
19:38 |
<cmjohnson1> |
dns update |
[production] |
18:40 |
<reedy> |
synchronized wmf-config/interwiki.cdb 'Updating interwiki cache' |
[production] |
18:34 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: Non wikipedias to 1.22wmf22 |
[production] |
18:29 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php |
[production] |
17:44 |
<cmjohnson1> |
reclaiming cp1021-36, cp1041-42 per RT5981 |
[production] |
17:24 |
<Reedy> |
The @Wikimedia Operations team is seeking proposals for a new datacenter in the midwestern/western US: https://blog.wikimedia.org/2013/10/21/rfp-new-datacenter-continental-us/ |
[production] |
16:30 |
<ori-l> |
ran sync-apache for I1113b9594 & Ie73ce6213; verified on mw60; gracefuling. |
[production] |