|
2011-07-05
§
|
| 16:04 |
<mark> |
Put OSPF/OSPFv3 on csw1-sdtpa:e14/1 in active mode again; appears stable so far |
[production] |
| 15:45 |
<mark> |
Reenabled csw1-sdtpa:e14/1 with OSPF/OSPFv3 in passive mode and high metric |
[production] |
| 15:31 |
<mark> |
Shutdown csw1-sdtpa:e14/1 (l3 wave) |
[production] |
| 15:24 |
<mark> |
Disabled IP load-sharing on csw1-esams (out of next-hops), disabled e14/1 (10G wave L3), reenabled it |
[production] |
| 13:38 |
<mark> |
Rebooting streber; dpkg hung |
[production] |
| 08:34 |
<mark> |
Rerouted traffic AS14907 -> AS43821 via 2828 |
[production] |
| 07:11 |
<Tim> |
creating 256 tables on db40 for DBOC |
[production] |
| 07:08 |
<tstarling> |
synchronized php-1.17/wmf-config/CommonSettings.php 'config change for the next DBOC trial, unused at present' |
[production] |
| 07:04 |
<tstarling> |
synchronized php-1.17/includes/objectcache/SqlBagOStuff.php 'r91442: MySQL parser cache fix, ready for a new trial' |
[production] |
| 06:54 |
<root> |
synchronizing Wikimedia installation... Revision: 91441: |
[production] |
| 06:53 |
<tstarling> |
synchronized php-1.17/includes/AutoLoader.php |
[production] |
| 06:53 |
<tstarling> |
synchronized php-1.17/includes/libs/IEUrlExtension.php |
[production] |
| 06:48 |
<Tim> |
doing svn up/scap to get r91440 |
[production] |
|
2011-07-01
§
|
| 20:18 |
<hashar:> |
ci.tesla: installed exiv2 (required for some Api tests) |
[production] |
| 20:13 |
<andrewS> |
mw1-mw22 racked and drac setup |
[production] |
| 19:49 |
<RobH> |
typo in my number sequence update for the new 74 mw servers, updating dns to fix |
[production] |
| 19:09 |
<Ryan_Lane> |
Changing text backend for https in esams to textsvc IP instead of text.esams.wikimedia.org IP |
[production] |
| 18:49 |
<Ryan_Lane> |
restarting pybal on amslvs1 and amslvs3 |
[production] |
| 18:34 |
<midom> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'removing mysql from pcache, need to repartition, current scheme too costly on memory' |
[production] |
| 18:25 |
<Ryan_Lane> |
adding textsvc.esams IP to amssq and knsq, and amslvs servers |
[production] |
| 18:23 |
<hashar:> |
ci.tesla install wbritish-small package to get a word list in /usr/share/dict |
[production] |
| 18:08 |
<Ryan_Lane> |
restarting pybal on lvs2 to add textsvc service |
[production] |
| 17:40 |
<andrewS> |
Rob Halsell is a Wizard. Period. |
[production] |
| 17:39 |
<midom> |
synchronized php-1.17/wmf-config/InitialiseSettings.php |
[production] |
| 17:29 |
<midom> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'adding enwiki to the mix' |
[production] |
| 17:27 |
<midom> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'sending a bit lower cache load to db40, though I guess that was initial shock before' |
[production] |
| 17:25 |
<RobH> |
Aware that #wikipedia is down and fixed, in less than a minute, woot |
[production] |
| 17:25 |
<midom> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'oops, should have started with lower load, opentable cache..' |
[production] |
| 17:23 |
<midom> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'sending cache load again to db40' |
[production] |
| 17:16 |
<Ryan_Lane> |
adding text.svc address to pmtpa text squids and lvs2 |
[production] |
| 17:08 |
<Ryan_Lane> |
adding text.svc private address to esams and pmtpa DNS |
[production] |
| 14:56 |
<RobH> |
pdns crash after rehup on ns1.wikimedia.org, restarting pdns |
[production] |
| 14:49 |
<RobH> |
dns updated to remove the mgmt ip addresses for srv302+ and replace them with mw1-mw74 |
[production] |
| 14:33 |
<RobH> |
updating dns, removing entries for non-existent srv302+ and replacing them with mw1-mw74 |
[production] |
| 11:18 |
<andrewS> |
motion sensors are being installed today in sdtpa that are going to trip the lights when there is movement. not sure how this will affect cameras. will update once their work is done later today. |
[production] |
| 07:33 |
<andrewS> |
the 3 new racks in pmtpa have power plugs running to them now. |
[production] |
| 05:51 |
<apergos> |
cron job set up on snapshot1 to dump central auth tables (in subdir by date just like all the private wikis) on weekly basis, runs as backup user |
[production] |
| 00:01 |
<RobH> |
disabled the notify requesters on resolve in the hw-decommission queue in RT |
[production] |
|
2011-06-30
§
|
| 20:43 |
<awjrichards> |
synchronized php-1.17/extensions/CentralNotice/special/SpecialBannerLoader.php 'r91218' |
[production] |
| 20:42 |
<awjrichards> |
synchronized php-1.17/extensions/CentralNotice/special/SpecialBannerController.php 'r91218' |
[production] |
| 18:39 |
<RoanKattouw> |
Running extensions/Vector/switchExperimentPrefs.php on enwiki to disable WikiLove for those with the "Exclude from experiments" preference |
[production] |
| 18:38 |
<catrope> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'Enable WikiLove by default on enwiki' |
[production] |
| 18:28 |
<catrope> |
synchronized php-1.17/wmf-config/InitialiseSettings.php 'Enable WikiLove on enwiki, non-default initially' |
[production] |
| 18:18 |
<catrope> |
synchronizing Wikimedia installation... Revision: 91190: |
[production] |
| 18:17 |
<RoanKattouw> |
Deploying updates for ArticleFeedback and WikiLove |
[production] |
| 18:09 |
<RobH> |
srv169 still offline, do not repool (set to false in pybal on lvs3) |
[production] |
| 18:00 |
<RobH> |
doing reboot testing on srv169 and puppet testing. server is depooled, disregard notices. |
[production] |