|
2012-11-08
§
|
| 09:49 |
<mark> |
Killed show_bug.cgi processes on kaulen |
[production] |
| 09:21 |
<mark> |
Power cycled cp1041 |
[production] |
| 07:20 |
<apergos> |
restarted lucene search on search1015 |
[production] |
| 06:26 |
<apergos> |
restarted lucene search on searchpool1016 |
[production] |
| 03:03 |
<logmsgbot_> |
aaron synchronized php-1.21wmf3/includes/objectcache/MemcachedPeclBagOStuff.php 'deployed efda0b27befc28ec13dae23f48e8baea42f4a7f3' |
[production] |
| 02:00 |
<logmsgbot_> |
LocalisationUpdate failed: git pull of extensions failed |
[production] |
| 00:52 |
<logmsgbot_> |
reedy synchronized wmf-config/ |
[production] |
| 00:42 |
<notpeter> |
repooling palladium |
[production] |
| 00:40 |
<mutante> |
wikivoyage imports: "fr" - done |
[production] |
| 00:39 |
<logmsgbot_> |
aaron synchronized php-1.21wmf3/extensions/SwiftCloudFiles/php-cloudfiles-wmf/cloudfiles.php 'removed debug logging' |
[production] |
| 00:37 |
<logmsgbot_> |
reedy synchronized all.dblist |
[production] |
| 00:35 |
<logmsgbot_> |
aaron synchronized php-1.21wmf3/extensions/SwiftCloudFiles/php-cloudfiles-wmf/cloudfiles.php |
[production] |
| 00:34 |
<paravoid> |
temporarily stopping {account,container,object}-server on ms-be3 while it syncs up from its downtime |
[production] |
| 00:34 |
<paravoid> |
starting memcached on virt0 |
[production] |
| 00:30 |
<logmsgbot_> |
aaron synchronized php-1.21wmf3/extensions/SwiftCloudFiles/php-cloudfiles-wmf/cloudfiles.php |
[production] |
| 00:26 |
<logmsgbot_> |
dzahn gracefulled all apaches |
[production] |
| 00:26 |
<paravoid> |
powercycling ms-be3 |
[production] |
|
2012-11-07
§
|
| 23:48 |
<notpeter> |
removing palladium from eqiad bits cache pool for upgrade to precise |
[production] |
| 23:43 |
<notpeter> |
repooling niobium |
[production] |
| 23:02 |
<notpeter> |
removing niobium from eqiad bits cache pool for upgrade to precise |
[production] |
| 22:59 |
<logmsgbot_> |
asher synchronized wmf-config/db.php 'returning db64 to s3' |
[production] |
| 22:51 |
<logmsgbot_> |
asher synchronized wmf-config/CommonSettings.php 'move redis to the front of the session multiwrite array' |
[production] |
| 22:41 |
<notpeter> |
re-pooling strontium |
[production] |
| 22:28 |
<logmsgbot_> |
asher synchronized wmf-config/db.php 'pulling db64' |
[production] |
| 22:08 |
<mutante> |
powercycling db64 (frozen) |
[production] |
| 22:02 |
<logmsgbot_> |
aaron synchronized wmf-config/filebackend.php |
[production] |
| 21:57 |
<notpeter> |
removing strontium from eqiad bits cache pool for upgrade to precise |
[production] |
| 21:30 |
<logmsgbot_> |
asher synchronized wmf-config/mc.php 'disable persistent connections for memcached-pecl' |
[production] |
| 21:26 |
<logmsgbot_> |
asher synchronized wmf-config/mc.php 'persistent connections for memcached-pecl' |
[production] |
| 21:10 |
<logmsgbot_> |
asher synchronized wmf-config/CommonSettings.php 'enabling session multiwrite to redis on mc1-16' |
[production] |
| 20:59 |
<mutante> |
wikivoyage imports: "ru" - done |
[production] |
| 20:54 |
<binasher> |
upgraded redis on mc1-16 |
[production] |
| 20:50 |
<logmsgbot_> |
aaron synchronized php-1.21wmf3/includes/filerepo/file/LocalFile.php 'debug logging.' |
[production] |
| 20:45 |
<mutante> |
wikivoyage imports: "sv" - done |
[production] |
| 20:42 |
<binasher> |
added new redis-2.6.3 pkg to precise-wikimedia and upgraded mc1 |
[production] |
| 20:34 |
<mutante> |
wikivoyage imports: "nl" - done |
[production] |
| 20:31 |
<logmsgbot_> |
reedy synchronized php-1.21wmf3/extensions/TimedMediaHandler |
[production] |
| 20:09 |
<logmsgbot_> |
asher synchronized wmf-config/CommonSettings.php 'disabling session multiwrite to redis on mc1' |
[production] |
| 19:56 |
<logmsgbot_> |
reedy rebuilt wikiversions.cdb and synchronized wikiversions files: |
[production] |
| 19:53 |
<paravoid> |
powercycling zinc, unresponsive to network and serial console |
[production] |
| 19:51 |
<logmsgbot_> |
reedy rebuilt wikiversions.cdb and synchronized wikiversions files: Everything else to 1.21wmf3 |
[production] |
| 19:46 |
<mutante> |
point wlm.wikimedia.org to the cluster rather than stand-alone host yttrium |
[production] |
| 19:25 |
<notpeter> |
re-adding arsenic to bits cache pool |
[production] |
| 19:00 |
<logmsgbot_> |
dzahn gracefulled all apaches |
[production] |
| 18:42 |
<sbernardin> |
racking new ms-be6 to row B sdtpa |
[production] |
| 17:43 |
<cmjohnson1> |
racking ms-be6 (720xd) |
[production] |
| 17:36 |
<Reedy> |
Creating transcode_key_idx on all transcode tables on all wikis |
[production] |
| 17:08 |
<logmsgbot_> |
demon synchronized wmf-config/InitialiseSettings.php 'Enabling TMH for commonswiki' |
[production] |
| 17:08 |
<logmsgbot_> |
demon synchronized wmf-config/CommonSettings.php 'Enabling TMH for commonswiki' |
[production] |
| 15:23 |
<paravoid> |
reactivating tele2 ipv6 peering and re-exporting routes to it |
[production] |