|
2012-12-19
§
|
| 07:06 |
<apergos> |
shot a bunch of converts on the image scalers, looks like a couple started flapping about 7-8 hours ago |
[production] |
| 04:03 |
<bsitu> |
synchronized wmf-config/InitialiseSettings.php 'Enable Echo on test2 and mediawiki' |
[production] |
| 03:59 |
<kaldari> |
Finished syncing Wikimedia installation... : |
[production] |
| 03:31 |
<LocalisationUpdate> |
completed (1.21wmf5) at Wed Dec 19 03:31:24 UTC 2012 |
[production] |
| 03:24 |
<kaldari> |
Started syncing Wikimedia installation... : |
[production] |
| 02:48 |
<LocalisationUpdate> |
completed (1.21wmf6) at Wed Dec 19 02:48:16 UTC 2012 |
[production] |
| 02:02 |
<awjrichards> |
synchronized php-1.21wmf5/extensions/MobileFrontend/javascripts/modules/mf-toggle.js 'touch file |
[production] |
| 02:01 |
<awjrichards> |
synchronized php-1.21wmf5/extensions/MobileFrontend/javascripts/common/main.js |
[production] |
| 01:44 |
<awjrichards> |
synchronized php-1.21wmf6/extensions/MobileFrontend/stylesheets/modules/mf-cleanuptemplates.css 'touch file' |
[production] |
| 01:44 |
<Ryan_Lane> |
finished upgrading salt on all production minions |
[production] |
| 01:41 |
<awjrichards> |
synchronized php-1.21wmf6/extensions/MobileFrontend/javascripts/modules/mf-cleanuptemplates.js |
[production] |
| 01:16 |
<bsitu> |
synchronized wmf-config/InitialiseSettings.php 'Enable Echo on test server' |
[production] |
| 01:14 |
<demon> |
synchronized php-1.21wmf6/extensions/Wikibase/lib/resources/templates.js 'Deploying I641725a2' |
[production] |
| 00:46 |
<notpeter> |
taking down for another reinstall (this time with raid!) |
[production] |
| 00:33 |
<awjrichards> |
synchronized php-1.21wmf6/extensions/MobileFrontend/javascripts/common/main.js 'touch file' |
[production] |
| 00:26 |
<Ryan_Lane> |
make that modifying project groups in labs by running syncProjectGroups.php maintenance script in OpenStackManager |
[production] |
| 00:25 |
<Ryan_Lane> |
modifying project groups |
[production] |
|
2012-12-18
§
|
| 23:40 |
<maxsem> |
Finished syncing Wikimedia installation... : https://www.mediawiki.org/wiki/Extension:MobileFrontend/Deployments/2012-12-18 |
[production] |
| 22:59 |
<notpeter> |
temp putting ganglia.w.o behind htaccess for sec reasons |
[production] |
| 22:54 |
<maxsem> |
Started syncing Wikimedia installation... : https://www.mediawiki.org/wiki/Extension:MobileFrontend/Deployments/2012-12-18 |
[production] |
| 22:46 |
<aaron> |
synchronized wmf-config/CommonSettings.php 'switched new captcha setting from testwiki -> test2wiki' |
[production] |
| 22:43 |
<aaron> |
synchronized wmf-config/filebackend.php 'set captcha directory.' |
[production] |
| 22:43 |
<Ryan_Lane> |
deploying Andrew Otto's group changes to OpenStackManager to labsconsole |
[production] |
| 22:07 |
<aaron> |
synchronized php-1.21wmf6/extensions/ConfirmEdit/captcha.py |
[production] |
| 21:32 |
<cmjohnson1> |
authdns-update new dns entries for frack bastion host (tellurium) |
[production] |
| 21:08 |
<bsitu> |
synchronized wmf-config/InitialiseSettings.php 'Turns off Echo temporarily on test and test2' |
[production] |
| 20:48 |
<bsitu> |
synchronized wmf-config/CommonSettings.php 'Update Echo config file' |
[production] |
| 20:47 |
<py> |
gracefulled all apaches |
[production] |
| 20:45 |
<notpeter> |
gracefulling all apaches to pick up https://gerrit.wikimedia.org/r/#/c/38521/ (tested good on srv193) |
[production] |
| 20:44 |
<hashar> |
running puppet on gallium. |
[production] |
| 20:44 |
<hashar> |
Zuul: applying "filters events by user email" to our Zuul deployment https://review.openstack.org/#/c/17609/ |
[production] |
| 20:27 |
<bsitu> |
synchronized wmf-config/CommonSettings.php |
[production] |
| 20:26 |
<bsitu> |
synchronized wmf-config/InitialiseSettings.php |
[production] |
| 18:31 |
<LeslieCarr> |
asw-c-eqiad ae bundles went down, working on fixing |
[production] |
| 15:45 |
<MaxSem> |
Testing done, 40 concurrent processes hitting around the worst-case point kept the load on yttrium at 20%. Average response time ~430ms |
[production] |
| 15:19 |
<MaxSem> |
Load-testing spatial search |
[production] |
| 14:14 |
<hashar> |
restarting Zuul with https://gerrit.wikimedia.org/r/39082 so it starts voting Verified+2 |
[production] |
| 14:13 |
<^demon> |
restarting gerrit on manganese to pick up VRIF+2 |
[production] |
| 13:50 |
<hashar> |
restarted puppet on gallium (some apt-get process was a zombie) |
[production] |
| 09:25 |
<nikerabbit> |
synchronized wmf-config/CommonSettings.php 'Bug 43075' |
[production] |
| 06:30 |
<andrewbogott> |
switched all labs instances to mount /home via gluster on next reboot |
[production] |
| 06:29 |
<andrewbogott> |
rsynced all labs homedirs to gluster volumes |
[production] |
| 02:46 |
<LocalisationUpdate> |
completed (1.21wmf5) at Tue Dec 18 02:45:58 UTC 2012 |
[production] |
| 02:25 |
<LocalisationUpdate> |
completed (1.21wmf6) at Tue Dec 18 02:25:22 UTC 2012 |
[production] |
| 01:28 |
<mutante> |
fixing duplicate UID issue on stat1 for maryana |
[production] |
| 00:57 |
<LeslieCarr> |
asw-c-eqiad unreachable due to lacp issue |
[production] |
| 00:32 |
<mutante> |
fixing fenari permissions for gwicke.. (pre-puppet age UID) |
[production] |
| 00:26 |
<LeslieCarr> |
starting upgrade of asw-c-eqiad.mgmt - connectivity to row c machines may be affected |
[production] |
| 00:11 |
<notpeter> |
temp stopping lsave on es1009 and es1010 for upcoming networking downtime |
[production] |