2012-06-12
§
|
15:31 |
<notpeter> |
doing another round of DB kernel upgrades |
[production] |
15:25 |
<logmsgbot_> |
py synchronized wmf-config/db.php |
[production] |
15:14 |
<logmsgbot_> |
asher synchronized wmf-config/CommonSettings.php 'reenabling mysql pcache' |
[production] |
15:00 |
<binasher> |
rebooting db40 |
[production] |
14:52 |
<binasher> |
set innodb_max_dirty_pages_pct = 0 on db40 in prep for shutdown |
[production] |
14:48 |
<logmsgbot_> |
asher synchronized wmf-config/CommonSettings.php 'disabling mysql parsercache (db40) in order to perform maintenance' |
[production] |
14:45 |
<notpeter> |
putting kern-upgraded DBs back into pools |
[production] |
14:44 |
<binasher> |
resumed replication on es3, es1002 after cluster23 sync completed |
[production] |
13:41 |
<Jeff_Green> |
added awight to fr-tech@wikimedia.org email alias |
[production] |
12:06 |
<mutante> |
gerrit create-project --name=mediawiki/extensions/UniversalLanguageSelector --parent=mediawiki/extensions |
[production] |
11:28 |
<mutante> |
powercycling downed srv232 (also cause for check_all_memcached crit) |
[production] |
11:08 |
<mutante> |
powercycled mw1042 to check for hardware issues and fscked. appears to be just unused (though down since ~3d like mw1071 per nagios) |
[production] |
10:38 |
<mutante> |
test [[RT:3100]] foo |
[production] |
10:31 |
<hashar> |
incubatorwiki.translate_messageindex on db39 uses MyISAM engine. See {{rt|3100}} |
[production] |
10:25 |
<logmsgbot_> |
hashar synchronized wmf-config/InitialiseSettings.php '[[bugzilla:37391|bug 37391]] , take 2 - Install Translate extension on be.wikimedia.org' |
[production] |
10:24 |
<logmsgbot_> |
hashar synchronized wmf-config/InitialiseSettings.php '[[bugzilla:37391|bug 37391]] , take 2 - Install Translate extension on be.wikimedia.org' |
[production] |
10:23 |
<hashar> |
Compared translate% tables schema on bewikimedia with incubatorwiki. diff prove they are the same so the schema changes made early are successful. |
[production] |
10:17 |
<hashar> |
bewikimedia (db39) : dropped tables translate_tmf , translate_tms and translate_tmt I have incorrectly added |
[production] |
09:59 |
<logmsgbot_> |
hashar synchronized wmf-config/InitialiseSettings.php 'revert translate extension on be.wikimedia.org, need DB update' |
[production] |
09:58 |
<logmsgbot_> |
hashar synchronized wmf-config/InitialiseSettings.php '[[bugzilla:37391|bug 37391]] - Install Translate extension on be.wikimedia.org' |
[production] |
02:34 |
<logmsgbot_> |
LocalisationUpdate completed (1.20wmf5) at Tue Jun 12 02:34:49 UTC 2012 |
[production] |
02:25 |
<logmsgbot_> |
LocalisationUpdate completed (1.20wmf4) at Tue Jun 12 02:25:21 UTC 2012 |
[production] |
01:35 |
<binasher> |
passes the dba mantel to notpeter |
[production] |
01:22 |
<notpeter> |
removing one slave from each db shard to upgrade/restart |
[production] |
00:24 |
<binasher> |
shutdown mysql on es3. stopped slaving on es1002, rsyncing cluster23 tables to es3 |
[production] |
00:09 |
<binasher> |
pointed es3 to MASTER_LOG_FILE='es1-bin.000788', MASTER_LOG_POS=453509865 |
[production] |
00:05 |
<binasher> |
es3:~# rm -rf /usr/local/mysql* |
[production] |
2012-06-11
§
|
23:54 |
<logmsgbot_> |
asher synchronized wmf-config/db.php 'fully commenting out es3' |
[production] |
23:52 |
<logmsgbot_> |
asher synchronized wmf-config/db.php 'making es1 the master for blobs cluster 23' |
[production] |
23:51 |
<binasher> |
es1 is the new master, now switching mw conf |
[production] |
23:48 |
<binasher> |
preparing to switch es master to es1 |
[production] |
23:31 |
<logmsgbot_> |
reedy synchronized wmf-config/InitialiseSettings.php 'Bug 27706 - enable RSS extension on uawikimedia' |
[production] |
23:12 |
<logmsgbot_> |
reedy Finished syncing Wikimedia installation... : |
[production] |
21:49 |
<Reedy> |
Applied PageTriage schema updates to testwiki and enwiki |
[production] |
20:54 |
<logmsgbot_> |
reedy Started syncing Wikimedia installation... : |
[production] |
20:07 |
<logmsgbot_> |
reedy synchronized php-1.20wmf5/ |
[production] |
19:20 |
<logmsgbot_> |
reedy rebuilt wikiversions.cdb and synchronized wikiversions files: mediawikiwiki to 1.20wmf5 |
[production] |
18:54 |
<logmsgbot_> |
reedy rebuilt wikiversions.cdb and synchronized wikiversions files: testwiki to 1.20wmf5 also |
[production] |
18:52 |
<logmsgbot_> |
reedy synchronized php-1.20wmf5/ 'Now we have some more space...' |
[production] |
18:50 |
<logmsgbot_> |
reedy synchronized php-1.20wmf3/cache/l10n/ 'Kill l10ncache for php-1.20wmf3 as its not needed' |
[production] |
18:45 |
<logmsgbot_> |
reedy synchronized php-1.20wmf2/cache/l10n/ 'Kill l10ncache for php-1.20wmf2 as its not needed' |
[production] |
18:44 |
<logmsgbot_> |
reedy synchronized php-1.20wmf5/ 'Scap is taking an age, just ensure deployment files are in sync' |
[production] |
18:42 |
<binasher> |
resuming coversion of es1004 to innodb, using compact row format after testing dynamic and compressed |
[production] |
18:03 |
<logmsgbot_> |
reedy Started syncing Wikimedia installation... : Consistency |
[production] |
17:56 |
<Ryan_Lane> |
enabling TitleBlacklist on labsconsole |
[production] |
17:28 |
<notpeter> |
moving /usr/local/apache to /a/apche with symbolic link on searchidx1001 as a temp measure until it can be reimaged |
[production] |
16:58 |
<logmsgbot_> |
reedy Started syncing Wikimedia installation... : Running scap to ensure consistency |
[production] |
16:53 |
<logmsgbot_> |
reedy synchronized php-1.20wmf5/cache/l10n/ |
[production] |
16:28 |
<mutante> |
installing security upgrades on sodium |
[production] |
16:19 |
<logmsgbot_> |
reedy Started syncing Wikimedia installation... : Rebuild messagecache for 1.20wmf5 |
[production] |