|
2015-06-18
§
|
| 17:13 |
<gwicke> |
bouncing cassandra on restbase1002 |
[production] |
| 17:11 |
<godog> |
restart cassandra on restbase1004 |
[production] |
| 15:53 |
<gwicke> |
updated restbase to 7ffaf94b |
[production] |
| 15:13 |
<thcipriani> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Hovercards: Disable test release on Catalan and Greek Wikipedias [[gerrit:215932]] (duration: 00m 13s) |
[production] |
| 15:06 |
<thcipriani> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: CX: Add wikis for deployment on 20150618 [[gerrit:218886]] (duration: 00m 14s) |
[production] |
| 11:14 |
<akosiaris> |
powercycling labstore2001 |
[production] |
| 09:08 |
<moritzm> |
added firejail_0.9.26-1~wmfjessie1 and firejail_0.9.26-1~wmftrusty1 to apt.wikimedia.org |
[production] |
| 08:45 |
<jynus> |
very brief replication stop for s7, already corrected |
[production] |
| 06:51 |
<Coren> |
rebooting labstore2001 |
[production] |
| 06:32 |
<legoktm> |
live hacking mw1017 for T102915 |
[production] |
| 05:26 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Thu Jun 18 05:26:01 UTC 2015 (duration 26m 0s) |
[production] |
| 02:48 |
<LocalisationUpdate> |
completed (1.26wmf10) at 2015-06-18 02:48:44+00:00 |
[production] |
| 02:46 |
<l10nupdate> |
Synchronized php-1.26wmf10/cache/l10n: (no message) (duration: 05m 03s) |
[production] |
| 02:32 |
<LocalisationUpdate> |
completed (1.26wmf9) at 2015-06-18 02:32:45+00:00 |
[production] |
| 02:28 |
<l10nupdate> |
Synchronized php-1.26wmf9/cache/l10n: (no message) (duration: 05m 56s) |
[production] |
| 02:04 |
<springle> |
applied T99941 scema change to all remaining affected (ie, old) wikis |
[production] |
| 02:02 |
<tgr> |
ran https://gerrit.wikimedia.org/r/#/c/159350/7/backend/schema/mysql/developer_agreement.sql on mediawikiwiki |
[production] |
| 01:32 |
<ejegg> |
updated payments from f33d0a8687a120a2057a7e6acad67da63b17f97e to a17ee221db0dbde70c92e24fc188379b6dbad613 |
[production] |
| 01:20 |
<ori> |
Synchronized php-1.26wmf10/resources/src/mediawiki.action/mediawiki.action.edit.stash.js: 0c21a14a6e: Revert StashEdit: Use postWithToken (duration: 00m 13s) |
[production] |
| 01:06 |
<twentyafterfour> |
applied hotfix for T102276 and restarted apache on iridium |
[production] |
| 00:01 |
<twentyafterfour> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.26wmf10 |
[production] |
|
2015-06-17
§
|
| 23:35 |
<catrope> |
Synchronized php-1.26wmf10/extensions/Gather: SWAT (duration: 00m 14s) |
[production] |
| 23:35 |
<gwicke> |
rolled back restbase to 90817c2a |
[production] |
| 23:24 |
<catrope> |
Synchronized php-1.26wmf9/extensions/MobileFrontend: SWAT (duration: 00m 15s) |
[production] |
| 23:23 |
<catrope> |
Synchronized php-1.26wmf9/extensions/Flow: SWAT (duration: 00m 15s) |
[production] |
| 22:45 |
<gwicke> |
rolling restart of cassandra nodes |
[production] |
| 22:09 |
<gwicke> |
rolling restart of restbase instances to apply puppet change after puppet actually ran on all nodes |
[production] |
| 21:58 |
<gwicke> |
rolling restart of restbase instances to apply config change |
[production] |
| 21:56 |
<godog> |
restart nutcracker on mw1145 |
[production] |
| 21:35 |
<gwicke> |
restarting cassandra on restbase1005 |
[production] |
| 20:47 |
<mutante> |
temp. stopped icinga-wm |
[production] |
| 20:37 |
<gwicke> |
deployed RESTBase 7ffaf94bfc |
[production] |
| 20:25 |
<cscott> |
updated Parsoid to version 402ddf66 |
[production] |
| 20:01 |
<ottomata> |
resized antimony's / LV from 30G to 100G. looks like /var/lib/git was getting filled up |
[production] |
| 19:43 |
<jynus> |
rolling schema changes on hewiki |
[production] |
| 19:29 |
<godog> |
downgrade and restart cassandra to 2.1.3 on restbase1001, metrics not being pushed to graphite with 2.1.6 |
[production] |
| 19:05 |
<godog> |
bounce cassandra on xenon |
[production] |
| 18:46 |
<ori> |
Synchronized wmf-config/InitialiseSettings.php: Ic03b152de: Make $wgUploadPath for commons https only for benefit instant commons (duration: 00m 14s) |
[production] |
| 18:11 |
<twentyafterfour> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group1 wikis to 1.26wmf10 |
[production] |
| 17:45 |
<godog> |
bounce cassandra on restbase1001 |
[production] |
| 17:39 |
<mutante> |
repooled mw1234 |
[production] |
| 17:24 |
<ottomata> |
starting reinstall of Zookeeper analytics nodes (analytics102[345]): https://phabricator.wikimedia.org/T101713 |
[production] |
| 17:16 |
<godog> |
bounce cassandra on restbase1001 |
[production] |
| 17:14 |
<jynus> |
rolling schema changes on ruwiki master |
[production] |
| 17:13 |
<mutante> |
running puppet via salt on api appservers in batches, switch to ganglia_new and carbon |
[production] |
| 17:12 |
<godog> |
cassandra stopped sending graphite metrics after restart, investigating (test cluster works fine tho) |
[production] |
| 16:58 |
<jynus> |
rolling schema changes on ruwiki slaves |
[production] |
| 16:28 |
<godog> |
start upgrading restbase1001 to cassandra 2.1.6 T102015 |
[production] |
| 16:02 |
<thcipriani> |
Finished scap: Wikitech-Ldap host record roll-out (duration: 24m 35s) |
[production] |
| 15:37 |
<thcipriani> |
Started scap: Wikitech-Ldap host record roll-out |
[production] |