|
2012-06-12
ยง
|
| 23:58 |
<maplebed> |
started swift container listing loop to compare purge timing when listings are fresh |
[production] |
| 23:16 |
<logmsgbot_> |
preilly synchronized php-1.20wmf5/extensions/MobileFrontend/ 'try again' |
[production] |
| 23:15 |
<logmsgbot_> |
preilly synchronized php-1.20wmf4/extensions/MobileFrontend/ 'try again' |
[production] |
| 22:58 |
<logmsgbot_> |
maxsem synchronized php-1.20wmf4/extensions/MobileFrontend/ 'Updating MobileFrontend' |
[production] |
| 22:53 |
<logmsgbot_> |
maxsem synchronized php-1.20wmf4/extensions/ZeroRatedMobileAccess/ 'Updating ZeroRatedMobileAccess' |
[production] |
| 22:52 |
<logmsgbot_> |
maxsem synchronized php-1.20wmf4/extensions/MobileFrontend/ 'Updating MobileFrontend' |
[production] |
| 22:50 |
<logmsgbot_> |
maxsem synchronized php-1.20wmf5/extensions/ZeroRatedMobileAccess/ 'Updating ZeroRatedMobileAccess' |
[production] |
| 22:49 |
<logmsgbot_> |
maxsem synchronized php-1.20wmf5/extensions/MobileFrontend/ 'Updating MobileFrontend' |
[production] |
| 20:28 |
<RoanKattouw> |
Correction: the /usr/local/apache filesystem is full on hume, the root fs is not |
[production] |
| 20:27 |
<RoanKattouw> |
hume has a full disk |
[production] |
| 20:23 |
<RoanKattouw> |
Fixed ownership of php-1.20wmf{4,5}/cache/l10n , should be l10nupdate:wikidev . The wmf4 copy had wrong ownership causing rebuildLocalisationCache.php to fail for shell users (e.g. from scap) |
[production] |
| 19:40 |
<logmsgbot_> |
mlitn Finished syncing Wikimedia installation... : |
[production] |
| 19:13 |
<logmsgbot_> |
mlitn Started syncing Wikimedia installation... : |
[production] |
| 18:09 |
<logmsgbot_> |
py synchronized wmf-config/db.php 're-adding db25 to pool after kern upgares' |
[production] |
| 18:02 |
<notpeter> |
halting owa3 for repairs |
[production] |
| 16:44 |
<logmsgbot_> |
py synchronized wmf-config/db.php 'removing db25 from pools for kern upgares' |
[production] |
| 16:27 |
<logmsgbot_> |
py synchronized wmf-config/db.php 're-adding dbs 33, 34, 36, 50, 55, 56 to pools after kern upgares' |
[production] |
| 15:55 |
<RobH> |
virt1001 and virt1002 rebooting, disregard |
[production] |
| 15:48 |
<cmjohnson1_> |
shutting down search32 to run a diagnostic test |
[production] |
| 15:45 |
<binasher> |
migrating enwiki.bv2009_edits (?) to innodb |
[production] |
| 15:41 |
<binasher> |
migrating enwiki.moodbar_feedback to innodb |
[production] |
| 15:39 |
<binasher> |
migrating enwiki.aft_article_filter_count to innodb |
[production] |
| 15:33 |
<logmsgbot_> |
py synchronized wmf-config/db.php 'removing dbs 33, 34, 36, 50, 55, 56 from pools for kern upgares' |
[production] |
| 15:31 |
<notpeter> |
doing another round of DB kernel upgrades |
[production] |
| 15:25 |
<logmsgbot_> |
py synchronized wmf-config/db.php |
[production] |
| 15:14 |
<logmsgbot_> |
asher synchronized wmf-config/CommonSettings.php 'reenabling mysql pcache' |
[production] |
| 15:00 |
<binasher> |
rebooting db40 |
[production] |
| 14:52 |
<binasher> |
set innodb_max_dirty_pages_pct = 0 on db40 in prep for shutdown |
[production] |
| 14:48 |
<logmsgbot_> |
asher synchronized wmf-config/CommonSettings.php 'disabling mysql parsercache (db40) in order to perform maintenance' |
[production] |
| 14:45 |
<notpeter> |
putting kern-upgraded DBs back into pools |
[production] |
| 14:44 |
<binasher> |
resumed replication on es3, es1002 after cluster23 sync completed |
[production] |
| 13:41 |
<Jeff_Green> |
added awight to fr-tech@wikimedia.org email alias |
[production] |
| 12:06 |
<mutante> |
gerrit create-project --name=mediawiki/extensions/UniversalLanguageSelector --parent=mediawiki/extensions |
[production] |
| 11:28 |
<mutante> |
powercycling downed srv232 (also cause for check_all_memcached crit) |
[production] |
| 11:08 |
<mutante> |
powercycled mw1042 to check for hardware issues and fscked. appears to be just unused (though down since ~3d like mw1071 per nagios) |
[production] |
| 10:38 |
<mutante> |
test [[RT:3100]] foo |
[production] |
| 10:31 |
<hashar> |
incubatorwiki.translate_messageindex on db39 uses MyISAM engine. See {{rt|3100}} |
[production] |
| 10:25 |
<logmsgbot_> |
hashar synchronized wmf-config/InitialiseSettings.php '[[bugzilla:37391|bug 37391]] , take 2 - Install Translate extension on be.wikimedia.org' |
[production] |
| 10:24 |
<logmsgbot_> |
hashar synchronized wmf-config/InitialiseSettings.php '[[bugzilla:37391|bug 37391]] , take 2 - Install Translate extension on be.wikimedia.org' |
[production] |
| 10:23 |
<hashar> |
Compared translate% tables schema on bewikimedia with incubatorwiki. diff prove they are the same so the schema changes made early are successful. |
[production] |
| 10:17 |
<hashar> |
bewikimedia (db39) : dropped tables translate_tmf , translate_tms and translate_tmt I have incorrectly added |
[production] |
| 09:59 |
<logmsgbot_> |
hashar synchronized wmf-config/InitialiseSettings.php 'revert translate extension on be.wikimedia.org, need DB update' |
[production] |
| 09:58 |
<logmsgbot_> |
hashar synchronized wmf-config/InitialiseSettings.php '[[bugzilla:37391|bug 37391]] - Install Translate extension on be.wikimedia.org' |
[production] |
| 02:34 |
<logmsgbot_> |
LocalisationUpdate completed (1.20wmf5) at Tue Jun 12 02:34:49 UTC 2012 |
[production] |
| 02:25 |
<logmsgbot_> |
LocalisationUpdate completed (1.20wmf4) at Tue Jun 12 02:25:21 UTC 2012 |
[production] |
| 01:35 |
<binasher> |
passes the dba mantel to notpeter |
[production] |
| 01:22 |
<notpeter> |
removing one slave from each db shard to upgrade/restart |
[production] |
| 00:24 |
<binasher> |
shutdown mysql on es3. stopped slaving on es1002, rsyncing cluster23 tables to es3 |
[production] |
| 00:09 |
<binasher> |
pointed es3 to MASTER_LOG_FILE='es1-bin.000788', MASTER_LOG_POS=453509865 |
[production] |
| 00:05 |
<binasher> |
es3:~# rm -rf /usr/local/mysql* |
[production] |