551-600 of 10000 results (8ms)
2012-02-07 §
00:02 <binasher> shutting down mysql on db35, rebuild fail [production]
00:00 <asher> synchronized wmf-config/db.php 'pulling db35' [production]
2012-02-06 §
22:10 <binasher> pulled db38 from enwiki, running normal "alter table revision add rev_sha1" and on db1043, the pt-online-schema-change equiv (with --chunk-size=1000, --sleep=0.1) to compare timing [production]
22:03 <asher> synchronized wmf-config/db.php 'pulling db38 from enwiki for revision alter timing' [production]
21:38 <maplebed> initial deploy of swift to serve thumbnails is complete [production]
21:27 <maplebed> deployed new squid.conf to enable swift for all thumbs with /a/a2 in the URL [production]
20:04 <binasher> running mk-slave-prefetch on db1018 which was down for 5 days to see if it can catch up [production]
19:28 <maplebed> swift deploy aborted due to squid config issues [production]
18:42 <maplebed> deploying squid config change to put swift in service for all thumbnails with /a/a2 in the URL [production]
16:49 <reedy> synchronized wmf-config/InitialiseSettings.php 'Bug 34043 - Change logo at Indonesian Wikibooks' [production]
16:46 <reedy> synchronized wmf-config/InitialiseSettings.php 'Bug 34009 - Translation of project namespace and site-name for ta.wikiquote' [production]
16:22 <Reedy> Updated user_former_groups.ufg_group to 32 characters [production]
16:07 <nikerabbit> synchronized wmf-config/CommonSettings.php 'Do not add translation reviewers group' [production]
15:58 <reedy> synchronized wmf-config/CommonSettings.php 'add r' [production]
15:57 <reedy> synchronized wmf-config/CommonSettings.php 'unset( $wgGroupPermissions[translate-proof] )' [production]
15:55 <reedy> synchronized wmf-config/InitialiseSettings.php 'Bug 34124 - Create a Project namespace on Russian Wikipedia' [production]
15:19 <Nikerabbit> that was Bug 34213 - Enabling of Extension:Translate on the Wikimedia Incubator [production]
15:18 <nikerabbit> synchronized wmf-config/InitialiseSettings.php [production]
15:14 <reedy> synchronized wmf-config/InitialiseSettings.php 'Bug 34219 - Disable Babel autocreation of categories at the Portuguese Wiktionary' [production]
14:59 <Nikerabbit> creating Translate db tables for incubator [production]
11:32 <demon> synchronized wmf-config/InitialiseSettings.php 'Fixing vepwiki logo - [[bugzilla:34222|bug 34222]]' [production]
11:28 <demon> synchronized wmf-config/InitialiseSettings.php 'Fixing vepwiki logo - [[bugzilla:34222|bug 34222]]' [production]
11:04 <nikerabbit> synchronized php-1.18/extensions/Translate/ 'i18ndeploy [[rev:110738|r110738]] Translate fixes' [production]
06:29 <binasher> rotated all eqiad + anayltic enwiki slaves to replicate from db1017 after db1001 hardware failure [production]
02:32 <LocalisationUpdate> completed (1.18) at Mon Feb 6 02:32:41 UTC 2012 [production]
2012-02-05 §
18:29 <reedy> synchronized php-1.18/includes/api [production]
16:58 <maplebed> restarted lsearchd on search6 [production]
16:38 <binasher> running alter table add column on db1017 enwiki.revision to benchmark [production]
16:34 <asher> synchronized wmf-config/db.php 'returning db35 to service' [production]
14:23 <reedy> synchronized php/cache/interwiki.cdb 'Updating interwiki cache' [production]
13:10 <mutante> stopped and started lsearchd once again on search6 [production]
12:51 <mutante> restarted lsearchd on search6 [production]
02:25 <LocalisationUpdate> completed (1.18) at Sun Feb 5 02:25:51 UTC 2012 [production]
02:11 <reedy> synchronized wmf-config/InitialiseSettings.php 'touch' [production]
2012-02-04 §
21:30 <pgehres> switched cc-status back to enabled on donate.wikimedia.org per nagios and GC email [production]
21:25 <pgehres> switched cc-status on donate.wikimedia.org to disable per GlobalCollect outage notice [production]
02:25 <LocalisationUpdate> completed (1.18) at Sat Feb 4 02:25:24 UTC 2012 [production]
00:02 <LeslieCarr> applying loopback filter on cr2-pmtpa [production]
2012-02-03 §
23:59 <LeslieCarr> applying loopback filter on cr1-sdtpa [production]
23:21 <binasher> timing the same operation as a normal alter on db1005. expect db lag to get backed up by hours [production]
23:16 <binasher> testing and timing pt-online-schema change to dewiki.revision on db1021 (not in rotation) [production]
23:07 <LeslieCarr> applying loopback filter on cr2-eqiad [production]
23:06 <binasher> upgrading percona-toolkit to 2.02 on all coredbs [production]
22:43 <asher> synchronized wmf-config/db.php 'returning db33, 39, 46 to prod' [production]
22:39 <binasher> db35 had an iblogfile size inconsistent with other s5 hosts. streaming a hotbacking of db1034 to db35 [production]
22:23 <binasher> rebooted db35, db39 [production]
21:55 <asher> synchronized wmf-config/db.php 'pulling db35, 39, 46 for upgrades' [production]
20:52 <K4-713> updated production civicrm to [[rev:1295|r1295]] [production]
20:45 <asher> synchronized wmf-config/db.php 'adding back dbs 13,18,25' [production]
20:32 <binasher> upgraded mysql on dbs 13,18,25,33 [production]