|
2013-03-01
§
|
| 18:59 |
<Ryan_Lane> |
binasher: resharding search-pool4 in pmtpa - restarted lsearchd on all local nodes and indexers on searchidx2 |
[production] |
| 18:59 |
<mwalker> |
... therefore the payments cluster is now running dced5328fd6ae4b395622abc41d2afa0ccad21c8 |
[production] |
| 18:59 |
<mutante> |
restart nagios-nrpe,gmond,apache,salt-minion on bastion hosts |
[production] |
| 18:59 |
<Ryan_Lane> |
binasher: rebuilding db35 from a hotbackup of db55 (s5); testing a new build of mariadb 5.5.29 |
[production] |
| 18:59 |
<Ryan_Lane> |
reedy synchronized php-1.21wmf10/cache/interwiki.cdb 'Updating 1.21wmf10 interwiki cache' |
[production] |
| 18:59 |
<Ryan_Lane> |
reedy synchronized php-1.21wmf10/cache/interwiki.cdb 'Updating 1.21wmf10 interwiki cache' |
[production] |
| 18:58 |
<Ryan_Lane> |
reedy synchronized php-1.21wmf10/extensions/WikimediaMaintenance |
[production] |
| 18:58 |
<Ryan_Lane> |
apergos: restarted icinga (not sure why it stopped, log file simply said 'caught TERM signal', in any case it complained that Error: Could not create external command file '/var/lib/nagios/rw/nagios.cmd' as named pipe ) |
[production] |
| 18:58 |
<mwalker> |
enabled sofort forms for CH and DE on the payments cluster |
[production] |
| 18:39 |
<mutante> |
installing package upgrades on bast1001 |
[production] |
| 18:37 |
<mutante> |
installing package upgrades on fenari |
[production] |
| 17:40 |
<^demon> |
rescanned all trackingids for gerrit on manganese |
[production] |
| 17:31 |
<^demon> |
upgrading gerrit to 2.5.2-1506-g278aa9a on manganese/formey |
[production] |
| 17:07 |
<Ryan_Lane> |
test |
[production] |
|
2013-02-28
§
|
| 06:28 |
<apergos> |
stabbed searchpool4 and restarted lucene search etc gah hate hate hate |
[production] |
| 03:40 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php |
[production] |
| 03:30 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php |
[production] |
| 03:12 |
<reedy> |
synchronized docroot |
[production] |
| 03:10 |
<reedy> |
synchronized docroot |
[production] |
| 03:09 |
<reedy> |
synchronized docroot |
[production] |
| 02:30 |
<LocalisationUpdate> |
completed (1.21wmf10) at Thu Feb 28 02:30:14 UTC 2013 |
[production] |
| 01:12 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php |
[production] |
| 00:58 |
<RobH> |
dsh restarted eqiad apaches in progress |
[production] |
| 00:57 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php |
[production] |
| 00:57 |
<robh> |
gracefulled all apaches |
[production] |
| 00:54 |
<reedy> |
synchronized wmf-config/ |
[production] |
| 00:32 |
<RobH> |
authdns-update to support wikinews.de |
[production] |
| 00:27 |
<reedy> |
synchronized wmf-config/ |
[production] |
| 00:02 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Lowering throttle to 5/day for new users, and' |
[production] |
|
2013-02-27
§
|
| 23:26 |
<Reedy> |
Running sync-common on mw1111. Reporting failed opening wmf-config/mc.php |
[production] |
| 22:57 |
<mutante> |
rebooting zirconium (planet) |
[production] |
| 22:54 |
<mutante> |
installing package upgrades on zirconium |
[production] |
| 22:52 |
<reedy> |
synchronized wmf-config/ |
[production] |
| 22:46 |
<mutante> |
rebooting bast1001 |
[production] |
| 22:36 |
<mutante> |
installing package upgrades on bast1001 |
[production] |
| 22:16 |
<reedy> |
synchronized wmf-config/ |
[production] |
| 21:44 |
<RobH> |
rdb1001 & rdb1002 allocated, network setup, and ready for handoff, per rt4608 |
[production] |
| 21:36 |
<RobH> |
authdns-update for rdb1001-1002 |
[production] |
| 21:36 |
<RobH> |
authdns-update for sdb1001-1002 |
[production] |
| 21:31 |
<Tim> |
running resetUserTokens.php on all wikis, in screen on hume, to fix user_token field corruption ([[bugzilla:41586|bug 41586]]) |
[production] |
| 21:26 |
<tstarling> |
synchronized php-1.21wmf10/includes/User.php 'user_token fixes' |
[production] |
| 20:05 |
<K4-713> |
updated payments cluster to fcbf9211c9836b |
[production] |
| 19:04 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: Everything else to 1.21wmf10 |
[production] |
| 18:55 |
<LeslieCarr> |
rebooting arsenic |
[production] |
| 18:42 |
<reedy> |
Finished syncing Wikimedia installation... : Rebuild message cache for EducationProgram |
[production] |
| 18:25 |
<reedy> |
Started syncing Wikimedia installation... : Rebuild message cache for EducationProgram |
[production] |
| 17:57 |
<reedy> |
synchronized php-1.21wmf10/extensions/EducationProgram/ |
[production] |
| 17:51 |
<K4-713> |
updated payments cluster to eab489d0889a |
[production] |
| 17:13 |
<mutante> |
rebooting fenari for kernel upgrade |
[production] |
| 08:33 |
<apergos> |
restarted lucene search on search1015 |
[production] |