|
2013-02-20
§
|
| 21:41 |
<RobH> |
ignore db66 errors, asher is working on it |
[production] |
| 21:25 |
<binasher> |
running wikidata wb_items / wb_items_per_site schema migrations in parallel on the db66 slave (creating primary keys, cannot be done via online-schema-change) |
[production] |
| 21:24 |
<RobH> |
kicked knsq23 to clear puppet freshness alarm |
[production] |
| 21:24 |
<RobH> |
maerlant still offline (200 days?). dropped esams ticket for onsite troubleshooting, as mgmt is offline. |
[production] |
| 21:20 |
<asher> |
synchronized wmf-config/InitialiseSettings.php 'setting wgReadOnly for wikidatawiki durring maintenance' |
[production] |
| 21:18 |
<RobH> |
forced puppet run on lardner, was tired of it showing error for no runs |
[production] |
| 21:13 |
<RobH> |
mw112-125 now in service as api apaches in tampa |
[production] |
| 20:58 |
<reedy> |
synchronized wmf-config/CommonSettings.php |
[production] |
| 20:38 |
<RobH> |
mw86-mw111 tested ok, pushing into apache service in pmtpa |
[production] |
| 20:32 |
<RobH> |
mw86-mw111 being added to nodelists, ignore errors on them for next few minutes |
[production] |
| 19:40 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wikibooks to 1.21wmf10 |
[production] |
| 19:37 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wikiversity, wikisource and wikiquote to 1.21wmf10 |
[production] |
| 19:29 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wikivoyage, wikinews and wiktionary to 1.21wmf10 |
[production] |
| 19:25 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: closed, special, wikimedia, private and fishbowl to 1.21wmf10 |
[production] |
| 05:34 |
<tstarling> |
synchronized wmf-config/CommonSettings.php 're-enable Scribunto profiler' |
[production] |
| 04:32 |
<Tim> |
updating luasandbox to version 1.2, with profiler bug fixes |
[production] |
| 02:53 |
<LocalisationUpdate> |
completed (1.21wmf10) at Wed Feb 20 02:53:32 UTC 2013 |
[production] |
| 02:29 |
<LocalisationUpdate> |
completed (1.21wmf9) at Wed Feb 20 02:29:11 UTC 2013 |
[production] |
| 01:28 |
<RobH> |
mw1161-1208 have wrong power setting, changing all to system.power.hotspare.enable 0 |
[production] |
| 01:00 |
<notpeter> |
do-release-upgrade-ing on db58 |
[production] |
| 00:57 |
<py> |
synchronized wmf-config/db-pmtpa.php 'removing db58 from db-secondary for upgrades and maria, replacing db43' |
[production] |
|
2013-02-19
§
|
| 23:47 |
<notpeter> |
do-release-upgrade-ing on db43 |
[production] |
| 23:38 |
<py> |
synchronized wmf-config/db-pmtpa.php 'removing db43 from db-secondary for upgrades and maria' |
[production] |
| 23:21 |
<maxsem> |
synchronized wmf-config 'https://gerrit.wikimedia.org/r/#/c/49946/' |
[production] |
| 23:04 |
<maxsem> |
Finished syncing Wikimedia installation... : Weekly mobile deployment |
[production] |
| 23:03 |
<maxsem> |
synchronized php-1.21wmf9/extensions/MobileFrontend/ |
[production] |
| 22:49 |
<maxsem> |
Started syncing Wikimedia installation... : Weekly mobile deployment |
[production] |
| 22:41 |
<preilly> |
synchronized php-1.21wmf9/extensions/ArticleFeedback 'fix MAX call with GREATEST' |
[production] |
| 22:29 |
<RobH> |
sq41 offline, rt 4550 |
[production] |
| 22:20 |
<RobH> |
sq41 puppet freshness bad, wont accept ssh connections, serial redirection results in no output. will need to reboot it |
[production] |
| 22:17 |
<RobH> |
sq41 not allowing ssh, drac resetting |
[production] |
| 22:15 |
<sbernardin> |
taking down ms-be12 for hardware replacement per: https://rt.wikimedia.org/Ticket/Display.html?id=4546 |
[production] |
| 22:15 |
<RobH> |
sq79/80 puppet in locked state, manually restarted puppet, removed lock file, ran manually |
[production] |
| 22:11 |
<preilly> |
synchronized php-1.21wmf9/extensions/ArticleFeedback 'fix mysql 5.5 / ansi sql incompatibility' |
[production] |
| 21:54 |
<RobH> |
mw48 was set to puppet agent disabled, re-enabled and fired puppet run |
[production] |
| 20:04 |
<mflaschen> |
synchronized . 'Syncing GuidedTour submodule omitted when new branch cut was first cloned.' |
[production] |
| 19:59 |
<Ryan_Lane> |
disabling project storage volumes for all labs projects with no instances |
[production] |
| 15:02 |
<hashar> |
restarting jenkins to enable some startup setting |
[production] |
| 14:58 |
<hashar> |
manganese CPU spike ongoing. Started roughly at 14:40 UTC |
[production] |
| 13:29 |
<mutante> |
wikimedia.jp.net now redirects to wikimedia.org | wikimediacommons.jp.net now redirects to commons.wm |
[production] |
| 13:27 |
<mutante> |
DNS update - adding wikimedia.jp.net |
[production] |
| 13:25 |
<dzahn> |
gracefulled all apaches |
[production] |
| 13:20 |
<mutante> |
gracefulling eqiad Apaches via dsh to push redirect change for .jp.net domains |
[production] |
| 12:39 |
<apergos> |
powercycling ms-be7 (unresponsive to ping or from console) |
[production] |
| 11:29 |
<mutante> |
installing package upgrads on neon/icinga |
[production] |
| 02:49 |
<LocalisationUpdate> |
completed (1.21wmf10) at Tue Feb 19 02:49:32 UTC 2013 |
[production] |
| 02:28 |
<LocalisationUpdate> |
completed (1.21wmf9) at Tue Feb 19 02:28:25 UTC 2013 |
[production] |
| 01:12 |
<anomie> |
synchronized php-1.21wmf10/includes/api/ApiQuerySiteinfo.php 'Backport fix for ugly API bug' |
[production] |
| 00:42 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: |
[production] |
| 00:30 |
<tstarling> |
synchronized wmf-config/InitialiseSettings.php |
[production] |