|
2013-08-29
§
|
| 09:39 |
<springle> |
killing long-running research transaction on db1047, and setting innodb_max_purge_lag to reduce history list length |
[production] |
| 09:32 |
<mark> |
Powercycled lanthanum |
[production] |
| 08:52 |
<hashar> |
rebooting lanthanum.eqiad.wmnet (high sys cpu) |
[production] |
| 08:33 |
<hashar> |
apt-get upgrade on gallium.wikimedia.org |
[production] |
| 08:29 |
<hashar> |
apt-get upgrade on lanthanum.eqiad.wmnet |
[production] |
| 07:27 |
<springle> |
relaxed slave delay warnings to warn 150 crit 300 |
[production] |
| 02:40 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Thu Aug 29 02:40:47 UTC 2013 |
[production] |
| 02:26 |
<LocalisationUpdate> |
completed (1.22wmf13) at Thu Aug 29 02:26:16 UTC 2013 |
[production] |
| 02:14 |
<LocalisationUpdate> |
completed (1.22wmf14) at Thu Aug 29 02:14:03 UTC 2013 |
[production] |
| 01:40 |
<mwalker> |
fundraising delete query on db1025 ran 1:10minutes -- serious lag on db1008 and db43 now expected for same |
[production] |
| 00:30 |
<mwalker> |
clearing ~14M rows from db1025.pgehres.bannerimpressions and bannerimpression_raw |
[production] |
|
2013-08-28
§
|
| 23:28 |
<bsitu> |
synchronized wmf-config/InitialiseSettings.php 'Disable the job queue that processes echo notification' |
[production] |
| 23:16 |
<rmoen> |
synchronized php-1.22wmf14/extensions/VisualEditor/ 'Update VisualEditor to master' |
[production] |
| 22:48 |
<demon> |
synchronized php-1.22wmf14/extensions/CentralAuth |
[production] |
| 22:47 |
<demon> |
synchronized php-1.22wmf13/extensions/CentralAuth |
[production] |
| 20:40 |
<demon> |
synchronized wmf-config/InitialiseSettings.php 'All wikis to secure login' |
[production] |
| 20:36 |
<demon> |
Finished syncing Wikimedia installation... : Secure login on alllllll the wikis |
[production] |
| 20:23 |
<demon> |
Started syncing Wikimedia installation... : Secure login on alllllll the wikis |
[production] |
| 19:29 |
<awight> |
synchronized php-1.22wmf14/extensions/CentralNotice 'Updating CentralNotice to wmf_deploy' |
[production] |
| 19:28 |
<awight> |
synchronized php-1.22wmf13/extensions/CentralNotice 'Updating CentralNotice to wmf_deploy' |
[production] |
| 18:36 |
<csteipp> |
synchronized php-1.22wmf13/extensions/Wikibase |
[production] |
| 18:35 |
<csteipp> |
synchronized php-1.22wmf13/extensions/CheckUser |
[production] |
| 18:34 |
<csteipp> |
synchronized php-1.22wmf14/extensions/CheckUser |
[production] |
| 18:34 |
<csteipp> |
synchronized php-1.22wmf14/extensions/Wikibase |
[production] |
| 18:32 |
<csteipp> |
synchronized php-1.22wmf14/extensions/OAuth |
[production] |
| 17:48 |
<ottomata> |
restarting some datanodes |
[production] |
| 17:46 |
<reedy> |
synchronized php-1.22wmf14/extensions/CirrusSearch/ 'Fix bug 53487' |
[production] |
| 16:48 |
<demon> |
synchronized php-1.22wmf14/extensions/CirrusSearch/forceSearchIndex.php 'Fix for reindexer' |
[production] |
| 16:46 |
<demon> |
synchronized wmf-config/InitialiseSettings.php |
[production] |
| 16:25 |
<demon> |
synchronized wmf-config/InitialiseSettings.php 'Move mw.org to primary backend as Cirrus to test my theory' |
[production] |
| 16:20 |
<Reedy> |
Created EducationProgram tables on ptwiki |
[production] |
| 16:07 |
<^d> |
ES: indexing mediawikiwiki in screen on terbium |
[production] |
| 16:07 |
<^d> |
ES: created mediawikiwiki index |
[production] |
| 16:05 |
<demon> |
synchronized wmf-config/InitialiseSettings.php 'CirrusSearch on mediawiki.org \\o/' |
[production] |
| 15:46 |
<gwicke> |
updated Parsoid to ca3f45f |
[production] |
| 15:39 |
<demon> |
synchronized php-1.22wmf14/extensions/CirrusSearch 'CirrusSearch to master' |
[production] |
| 15:02 |
<springle> |
restarting slave threads on db55, db58, db43. will lag for a while. |
[production] |
| 14:34 |
<paravoid> |
authdns-update: switching Middle-East to esams |
[production] |
| 14:15 |
<paravoid> |
authdns-update: switching Africa to esams |
[production] |
| 13:58 |
<hashar> |
jenkins: renamed OAuth jobs from Oauth to OAuth |
[production] |
| 13:55 |
<hashar> |
jenkins: renamed Editcount jobs from EditCount to Editcount |
[production] |
| 13:43 |
<springle> |
same purge situation for db58 and db43, and remedy |
[production] |
| 13:35 |
<springle> |
stopped db55 slave threads while purge catches up; killed long running research user transaction apparently doing nothing but holding locks |
[production] |
| 13:20 |
<springle> |
temporarily changing innodb purge settings on db55 (massive growing history list) |
[production] |
| 12:32 |
<hashar> |
jenkins: updated various jobs to use $ZUUL_PROJECT when determining the git repository to fetch from {{bug|53470}} |
[production] |
| 02:45 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Wed Aug 28 02:45:49 UTC 2013 |
[production] |
| 02:30 |
<LocalisationUpdate> |
completed (1.22wmf13) at Wed Aug 28 02:30:40 UTC 2013 |
[production] |
| 02:16 |
<LocalisationUpdate> |
completed (1.22wmf14) at Wed Aug 28 02:16:15 UTC 2013 |
[production] |