2013-02-21
§
|
11:04 |
<hashar> |
Ariel saved Gerrit by restarting it! |
[production] |
10:51 |
<hashar> |
huge CPU spike on manganese (gerrit host) |
[production] |
10:06 |
<hashar> |
Jenkins: reseting git branch specifier :-/ |
[production] |
09:32 |
<hashar> |
Jenkins: removing git branch specifier from all mediawiki-core jobs. |
[production] |
05:50 |
<tstarling> |
synchronized wmf-config/CommonSettings.php 'shell cgroup' |
[production] |
02:54 |
<LocalisationUpdate> |
completed (1.21wmf9) at Thu Feb 21 02:54:17 UTC 2013 |
[production] |
02:30 |
<asher> |
synchronized wmf-config/db-pmtpa.php 'new extension1 shard (as an externalload config) - initially for AFTv5' |
[production] |
02:30 |
<asher> |
synchronized wmf-config/db-eqiad.php 'new extension1 shard (as an externalload config) - initially for AFTv5' |
[production] |
02:28 |
<LocalisationUpdate> |
completed (1.21wmf10) at Thu Feb 21 02:28:20 UTC 2013 |
[production] |
00:53 |
<RobH> |
issues with new mw servers 86+, took back out of pybal until i can troubleshoot |
[production] |
00:49 |
<reedy> |
synchronized php-1.21wmf9/extensions/WikimediaMaintenance/ |
[production] |
00:48 |
<reedy> |
synchronized php-1.21wmf10/extensions/WikimediaMaintenance/ |
[production] |
00:34 |
<binasher> |
moved wikidatawiki tables on s3 to wikidatawiki_old to keep around for a time just in case; then "drop database wikidatawiki" |
[production] |
00:20 |
<asher> |
synchronized wmf-config 'enabling wikidatawiki on shard s5' |
[production] |
00:18 |
<asher> |
synchronized s5.dblist 'adding wikidatawiki' |
[production] |
00:17 |
<asher> |
synchronized s3.dblist 'removing wikidatawiki' |
[production] |
2013-02-20
§
|
22:48 |
<RobH> |
authdns-update |
[production] |
22:35 |
<binasher> |
importing wikidatawiki with schema changes into the s5 master, with sql_log_bin disabled |
[production] |
22:24 |
<binasher> |
importing wikidatawiki with schema changes into the inactive pmtpa side of the s5 shard, with replication of the import just in pmtpa. ignore repl warnings for db{35,44,45,55} |
[production] |
21:48 |
<RobH> |
authdns-update for wtp1002-1004 |
[production] |
21:45 |
<maxsem> |
synchronized wmf-config/CommonSettings.php 'Take pmtpa Solr servers out of rotation, increase load on master: https://gerrit.wikimedia.org/r/#/c/50056/' |
[production] |
21:41 |
<RobH> |
ignore db66 errors, asher is working on it |
[production] |
21:25 |
<binasher> |
running wikidata wb_items / wb_items_per_site schema migrations in parallel on the db66 slave (creating primary keys, cannot be done via online-schema-change) |
[production] |
21:24 |
<RobH> |
kicked knsq23 to clear puppet freshness alarm |
[production] |
21:24 |
<RobH> |
maerlant still offline (200 days?). dropped esams ticket for onsite troubleshooting, as mgmt is offline. |
[production] |
21:20 |
<asher> |
synchronized wmf-config/InitialiseSettings.php 'setting wgReadOnly for wikidatawiki durring maintenance' |
[production] |
21:18 |
<RobH> |
forced puppet run on lardner, was tired of it showing error for no runs |
[production] |
21:13 |
<RobH> |
mw112-125 now in service as api apaches in tampa |
[production] |
20:58 |
<reedy> |
synchronized wmf-config/CommonSettings.php |
[production] |
20:38 |
<RobH> |
mw86-mw111 tested ok, pushing into apache service in pmtpa |
[production] |
20:32 |
<RobH> |
mw86-mw111 being added to nodelists, ignore errors on them for next few minutes |
[production] |
19:40 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wikibooks to 1.21wmf10 |
[production] |
19:37 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wikiversity, wikisource and wikiquote to 1.21wmf10 |
[production] |
19:29 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wikivoyage, wikinews and wiktionary to 1.21wmf10 |
[production] |
19:25 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: closed, special, wikimedia, private and fishbowl to 1.21wmf10 |
[production] |
05:34 |
<tstarling> |
synchronized wmf-config/CommonSettings.php 're-enable Scribunto profiler' |
[production] |
04:32 |
<Tim> |
updating luasandbox to version 1.2, with profiler bug fixes |
[production] |
02:53 |
<LocalisationUpdate> |
completed (1.21wmf10) at Wed Feb 20 02:53:32 UTC 2013 |
[production] |
02:29 |
<LocalisationUpdate> |
completed (1.21wmf9) at Wed Feb 20 02:29:11 UTC 2013 |
[production] |
01:28 |
<RobH> |
mw1161-1208 have wrong power setting, changing all to system.power.hotspare.enable 0 |
[production] |
01:00 |
<notpeter> |
do-release-upgrade-ing on db58 |
[production] |
00:57 |
<py> |
synchronized wmf-config/db-pmtpa.php 'removing db58 from db-secondary for upgrades and maria, replacing db43' |
[production] |