|
2013-02-21
§
|
| 10:51 |
<hashar> |
huge CPU spike on manganese (gerrit host) |
[production] |
| 10:06 |
<hashar> |
Jenkins: reseting git branch specifier :-/ |
[production] |
| 09:32 |
<hashar> |
Jenkins: removing git branch specifier from all mediawiki-core jobs. |
[production] |
| 05:50 |
<tstarling> |
synchronized wmf-config/CommonSettings.php 'shell cgroup' |
[production] |
| 02:54 |
<LocalisationUpdate> |
completed (1.21wmf9) at Thu Feb 21 02:54:17 UTC 2013 |
[production] |
| 02:30 |
<asher> |
synchronized wmf-config/db-pmtpa.php 'new extension1 shard (as an externalload config) - initially for AFTv5' |
[production] |
| 02:30 |
<asher> |
synchronized wmf-config/db-eqiad.php 'new extension1 shard (as an externalload config) - initially for AFTv5' |
[production] |
| 02:28 |
<LocalisationUpdate> |
completed (1.21wmf10) at Thu Feb 21 02:28:20 UTC 2013 |
[production] |
| 00:53 |
<RobH> |
issues with new mw servers 86+, took back out of pybal until i can troubleshoot |
[production] |
| 00:49 |
<reedy> |
synchronized php-1.21wmf9/extensions/WikimediaMaintenance/ |
[production] |
| 00:48 |
<reedy> |
synchronized php-1.21wmf10/extensions/WikimediaMaintenance/ |
[production] |
| 00:34 |
<binasher> |
moved wikidatawiki tables on s3 to wikidatawiki_old to keep around for a time just in case; then "drop database wikidatawiki" |
[production] |
| 00:20 |
<asher> |
synchronized wmf-config 'enabling wikidatawiki on shard s5' |
[production] |
| 00:18 |
<asher> |
synchronized s5.dblist 'adding wikidatawiki' |
[production] |
| 00:17 |
<asher> |
synchronized s3.dblist 'removing wikidatawiki' |
[production] |
|
2013-02-20
§
|
| 22:48 |
<RobH> |
authdns-update |
[production] |
| 22:35 |
<binasher> |
importing wikidatawiki with schema changes into the s5 master, with sql_log_bin disabled |
[production] |
| 22:24 |
<binasher> |
importing wikidatawiki with schema changes into the inactive pmtpa side of the s5 shard, with replication of the import just in pmtpa. ignore repl warnings for db{35,44,45,55} |
[production] |
| 21:48 |
<RobH> |
authdns-update for wtp1002-1004 |
[production] |
| 21:45 |
<maxsem> |
synchronized wmf-config/CommonSettings.php 'Take pmtpa Solr servers out of rotation, increase load on master: https://gerrit.wikimedia.org/r/#/c/50056/' |
[production] |
| 21:41 |
<RobH> |
ignore db66 errors, asher is working on it |
[production] |
| 21:25 |
<binasher> |
running wikidata wb_items / wb_items_per_site schema migrations in parallel on the db66 slave (creating primary keys, cannot be done via online-schema-change) |
[production] |
| 21:24 |
<RobH> |
kicked knsq23 to clear puppet freshness alarm |
[production] |
| 21:24 |
<RobH> |
maerlant still offline (200 days?). dropped esams ticket for onsite troubleshooting, as mgmt is offline. |
[production] |
| 21:20 |
<asher> |
synchronized wmf-config/InitialiseSettings.php 'setting wgReadOnly for wikidatawiki durring maintenance' |
[production] |
| 21:18 |
<RobH> |
forced puppet run on lardner, was tired of it showing error for no runs |
[production] |
| 21:13 |
<RobH> |
mw112-125 now in service as api apaches in tampa |
[production] |
| 20:58 |
<reedy> |
synchronized wmf-config/CommonSettings.php |
[production] |
| 20:38 |
<RobH> |
mw86-mw111 tested ok, pushing into apache service in pmtpa |
[production] |
| 20:32 |
<RobH> |
mw86-mw111 being added to nodelists, ignore errors on them for next few minutes |
[production] |
| 19:40 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wikibooks to 1.21wmf10 |
[production] |
| 19:37 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wikiversity, wikisource and wikiquote to 1.21wmf10 |
[production] |
| 19:29 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wikivoyage, wikinews and wiktionary to 1.21wmf10 |
[production] |
| 19:25 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: closed, special, wikimedia, private and fishbowl to 1.21wmf10 |
[production] |
| 05:34 |
<tstarling> |
synchronized wmf-config/CommonSettings.php 're-enable Scribunto profiler' |
[production] |
| 04:32 |
<Tim> |
updating luasandbox to version 1.2, with profiler bug fixes |
[production] |
| 02:53 |
<LocalisationUpdate> |
completed (1.21wmf10) at Wed Feb 20 02:53:32 UTC 2013 |
[production] |
| 02:29 |
<LocalisationUpdate> |
completed (1.21wmf9) at Wed Feb 20 02:29:11 UTC 2013 |
[production] |
| 01:28 |
<RobH> |
mw1161-1208 have wrong power setting, changing all to system.power.hotspare.enable 0 |
[production] |
| 01:00 |
<notpeter> |
do-release-upgrade-ing on db58 |
[production] |
| 00:57 |
<py> |
synchronized wmf-config/db-pmtpa.php 'removing db58 from db-secondary for upgrades and maria, replacing db43' |
[production] |
|
2013-02-19
§
|
| 23:47 |
<notpeter> |
do-release-upgrade-ing on db43 |
[production] |
| 23:38 |
<py> |
synchronized wmf-config/db-pmtpa.php 'removing db43 from db-secondary for upgrades and maria' |
[production] |
| 23:21 |
<maxsem> |
synchronized wmf-config 'https://gerrit.wikimedia.org/r/#/c/49946/' |
[production] |
| 23:04 |
<maxsem> |
Finished syncing Wikimedia installation... : Weekly mobile deployment |
[production] |
| 23:03 |
<maxsem> |
synchronized php-1.21wmf9/extensions/MobileFrontend/ |
[production] |
| 22:49 |
<maxsem> |
Started syncing Wikimedia installation... : Weekly mobile deployment |
[production] |
| 22:41 |
<preilly> |
synchronized php-1.21wmf9/extensions/ArticleFeedback 'fix MAX call with GREATEST' |
[production] |
| 22:29 |
<RobH> |
sq41 offline, rt 4550 |
[production] |
| 22:20 |
<RobH> |
sq41 puppet freshness bad, wont accept ssh connections, serial redirection results in no output. will need to reboot it |
[production] |