|
2015-09-01
§
|
| 15:04 |
<mark> |
labstore1002: mdadm --zero-superblock /dev/sdax1 && mdadm /dev/md/slice15 --re-add /dev/sdax |
[production] |
| 15:03 |
<krenair@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/231465/ - VE for all new enwiki accounts (duration: 00m 13s) |
[production] |
| 14:58 |
<mark> |
labstore1002: mdadm /dev/md/slice15 --re-add /dev/sday |
[production] |
| 14:58 |
<mark> |
labstore1002: mdadm --zero-superblock /dev/sday1 |
[production] |
| 14:53 |
<mark> |
labstore1002: mdadm --stop /dev/md3 |
[production] |
| 14:37 |
<ebernhardson> |
reset elasticsearch cluster.routing.allocation.disk.high back to 90% |
[production] |
| 13:38 |
<krinkle@tin> |
Synchronized w/: Remove rl-test.php (duration: 00m 13s) |
[production] |
| 13:17 |
<moritzm> |
enabled ferm on db1048 |
[production] |
| 13:09 |
<moritzm> |
enabled ferm on labsdb100[467] |
[production] |
| 12:01 |
<YuviPanda> |
disable puppet on labsdb1006 |
[production] |
| 08:58 |
<moritzm> |
enabled ferm on labsdb1001 |
[production] |
| 08:58 |
<godog> |
fixup current graphite retention for metrics under "servers" hierarchy T96662 |
[production] |
| 08:51 |
<moritzm> |
enabled ferm on labsdb1002 |
[production] |
| 08:31 |
<moritzm> |
enabled ferm on labsdb1003 |
[production] |
| 08:29 |
<godog> |
repool mw1125 mw1142 after nutcracker failures |
[production] |
| 07:45 |
<jynus> |
cloning mysql data from es1010 to es1017 [ETA: 6h] |
[production] |
| 07:23 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Depool es1010 (duration: 00m 12s) |
[production] |
| 07:13 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool es1007, pool es1013 (duration: 00m 13s) |
[production] |
| 06:36 |
<mutante> |
uploaded survey2012 to dumps/dataset1001; ownership as it is for survey2011; - T110746 in time for midnight PST |
[production] |
| 05:18 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Tue Sep 1 05:18:09 UTC 2015 (duration 18m 8s) |
[production] |
| 02:28 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.26wmf20) at 2015-09-01 02:28:30+00:00 |
[production] |
| 02:25 |
<l10nupdate@tin> |
Synchronized php-1.26wmf20/cache/l10n: l10nupdate for 1.26wmf20 (duration: 06m 00s) |
[production] |
|
2015-08-31
§
|
| 23:56 |
<krenair@tin> |
Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/233665/ (duration: 00m 11s) |
[production] |
| 23:49 |
<ebernhardson@tin> |
Synchronized wmf-config/InitialiseSettings.php: reenable config changes for cirrus experimental completion api (duration: 00m 12s) |
[production] |
| 23:40 |
<ori@tin> |
Synchronized php-1.26wmf20/extensions/EducationProgram: 97ab82eab2: Updated mediawiki/core Project: mediawiki/extensions/EducationProgram 85a7d3932c1a4ad28f1a8dd05704f4e524152349 (duration: 00m 14s) |
[production] |
| 23:27 |
<ebernhardson@tin> |
Synchronized php-1.26wmf20/extensions/CirrusSearch/: (no message) (duration: 00m 12s) |
[production] |
| 23:25 |
<ebernhardson@tin> |
Synchronized wmf-config/InitialiseSettings.php: revert update for cirrussearch experimental suggestions api (duration: 00m 12s) |
[production] |
| 23:21 |
<ebernhardson@tin> |
Synchronized wmf-config/InitialiseSettings.php: update config of cirrussearch experimental suggestions api (duration: 00m 12s) |
[production] |
| 22:45 |
<chasemp> |
disabled puppet on elastic hosts temporarily to safely roll out fw change. elastic seems to have not taken it well and I'm holding for green cluster state. |
[production] |
| 21:20 |
<mutante> |
installing package upgrades on argon |
[production] |
| 20:58 |
<ori> |
imported pybal_1.08_amd64.changes to jessie-wikimedia |
[production] |
| 20:44 |
<chasemp> |
ferm for elastic100[4-7] and adjust ferm to include wikitech source |
[production] |
| 20:21 |
<subbu> |
deployed parsoid version c3e4df5e |
[production] |
| 16:22 |
<godog> |
depool mw1125 + mw1142 from api, nutcracker client connections exceeded |
[production] |
| 16:06 |
<thcipriani@tin> |
Finished scap: SWAT: Ask the user to log in if the session is lost [[gerrit:234228]] (duration: 27m 07s) |
[production] |
| 15:59 |
<jynus> |
restarting hhvm on mw2187 |
[production] |
| 15:39 |
<thcipriani@tin> |
Started scap: SWAT: Ask the user to log in if the session is lost [[gerrit:234228]] |
[production] |
| 15:33 |
<mutante> |
terbium - Could not find dependent Service[nscd] for File[/etc/ldap/ldap.conf] |
[production] |
| 15:28 |
<thcipriani@tin> |
Synchronized closed-labs.dblist: SWAT: Creating closed-labs.dblist and closing es.wikipedia.beta.wmflabs.org [[gerrit:234594]] (duration: 00m 13s) |
[production] |
| 15:25 |
<thcipriani@tin> |
Synchronized wmf-config/CirrusSearch-common.php: SWAT: Remove files from Commons from search results on wikimediafoundation.org [[gerrit:234040]] (duration: 00m 11s) |
[production] |
| 15:25 |
<ottomata> |
starting varnishkafka instances on frontend caches to produce eventlogging client side events to kafka |
[production] |
| 15:21 |
<thcipriani@tin> |
Synchronized php-1.26wmf20/extensions/Wikidata: SWAT: Update Wikidata - Fix formatting of client edit summaries [[gerrit:234991]] (duration: 00m 21s) |
[production] |
| 15:16 |
<thcipriani@tin> |
Synchronized php-1.26wmf20/extensions/UploadWizard/resources/controller/uw.controller.Step.js: SWAT: Keep the uploads sorted in the order they were created in initially [[gerrit:234553]] (duration: 00m 12s) |
[production] |
| 14:43 |
<ebernhardson> |
elasticsearch cluster.routing.allocation.disk.watermark.high set to 75% to force elastic1022 to reduce its disk usage |
[production] |
| 14:41 |
<urandom> |
bouncing Cassandra on restbase1001 to apply temporary GC setting |
[production] |
| 14:06 |
<akosiaris> |
rebooted krypton. was reporting 100% cpu steal time |
[production] |
| 13:40 |
<paravoid> |
running puppet on newly-installed mc2001 |
[production] |
| 13:40 |
<paravoid> |
restarting hhvm on mw1065 |
[production] |
| 11:10 |
<moritzm> |
restart salt-master on palladium |
[production] |
| 10:45 |
<paravoid> |
reenabling asw2-a5-eqiad:xe-0/0/36 (T107635) |
[production] |