|
2016-05-06
§
|
| 12:40 |
<moritzm> |
restarted hhvm on mw1226 (hhvm-dump-debug output available) |
[production] |
| 12:28 |
<mobrovac> |
restbase rolling restart in eqiad for openssl update |
[production] |
| 11:52 |
<moritzm> |
rolling restart of restbase in codfw for openssl update |
[production] |
| 11:47 |
<elukey> |
restarting aqs on aqs100[123] for security upgrades. |
[production] |
| 11:15 |
<moritzm> |
restarting slapd on dubnium to pick up openssl update |
[production] |
| 11:10 |
<hoo> |
Reverted the property suggester data to data from the 20160411 dump (done testing T132839) |
[production] |
| 11:02 |
<hoo> |
Overwrote property suggester data with data from the 20160215 dump (T132839) |
[production] |
| 10:59 |
<moritzm> |
restarting slapd on pollux to pick up openssl update |
[production] |
| 09:17 |
<moritzm> |
restarted hhvm on mw1148 |
[production] |
| 08:36 |
<gehel> |
restarting elasticsearch server elastic1012.eqiad.wmnet (T110236) |
[production] |
| 08:13 |
<godog> |
delete blacklisted cassandra metrics for restbase meta tables T134016 |
[production] |
| 08:05 |
<gehel> |
restarting elasticsearch server elastic1011.eqiad.wmnet (T110236) |
[production] |
| 07:12 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1065 after maintenance; repool db1023 with low weight (duration: 00m 34s) |
[production] |
| 05:57 |
<gehel> |
restarting elasticsearch server elastic1010.eqiad.wmnet (T110236) |
[production] |
| 05:05 |
<kart_> |
Update cxserver to 155c2d4 |
[production] |
| 04:35 |
<ori@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: Wikipedias back to wmf.22 due to page load performance regression |
[production] |
|
2016-05-05
§
|
| 21:37 |
<gehel> |
restarting elasticsearch server elastic1009.eqiad.wmnet (T110236) |
[production] |
| 19:30 |
<csteipp> |
deployed patch for T132874 |
[production] |
| 19:07 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: wikipedias to wmf.23 |
[production] |
| 18:47 |
<csteipp> |
deployed patch for T133507 |
[production] |
| 18:44 |
<robh> |
mr1-ulsfo power cable reroute complete |
[production] |
| 18:43 |
<robh> |
mr1-ulsfo going to flap as i reroute the power cable |
[production] |
| 18:23 |
<csteipp> |
deployed patch for T130947 |
[production] |
| 18:17 |
<csteipp> |
deployed revert/new patches for core & extension for T129506 |
[production] |
| 17:40 |
<_joe_> |
restarted ocg after packet capture |
[production] |
| 17:40 |
<ejegg> |
updated payments-wiki from 8962b558b5eb5a4dba91be7ed7649b532fa4ee35 to b16c3cb0e12aacb49b91974d693c401dcaa9cca9 |
[production] |
| 17:36 |
<_joe_> |
temporarily stopping ocg on ocg1003 to better debug cleanup cache |
[production] |
| 17:23 |
<urandom> |
Rolling restart of cassandra-metrics-collector in RESTBase test cluster : T134016 |
[production] |
| 17:19 |
<urandom> |
Rolling restart of cassandra-metrics-collector in RESTBase cluster : T134016 |
[production] |
| 17:09 |
<_joe_> |
clearing ocg cache entries for ocg1003 |
[production] |
| 17:06 |
<oblivian@palladium> |
conftool action : set/pooled=no; selector: name=ocg1003.* |
[production] |
| 16:55 |
<godog> |
restart cassandra-metrics-collector on restbase2001 to test white/black listing |
[production] |
| 16:31 |
<mdholloway> |
mobileapps finished no-op test deploy |
[production] |
| 16:22 |
<mdholloway> |
mobileapps starting no-op deploy on scb1001 |
[production] |
| 16:01 |
<jynus> |
restarting db1023 for reimage to jessie |
[production] |
| 15:10 |
<anomie@tin> |
Synchronized php-1.27.0-wmf.23/extensions/CentralAuth/: SWAT: Use master CentralAuthUser instances when writing [[gerrit:287079]] (duration: 00m 32s) |
[production] |
| 15:05 |
<anomie@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Commons: Restrict changetags userright [[gerrit:286522]] (duration: 00m 29s) |
[production] |
| 15:03 |
<anomie@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Grant groups from flaggedrevs the patrol rights at test2wiki [[gerrit:287090]] (duration: 00m 47s) |
[production] |
| 15:02 |
<jynus> |
stopping db1065 for hardware maintenance |
[production] |
| 14:42 |
<elukey> |
restarted memcached on mc1008 as part of a performance test (T129963) |
[production] |
| 14:39 |
<elukey> |
memcached on mc1009 is running now with new parameters only available for 1.4.25-2~wmf1 - part of a performance test (T129963) |
[production] |
| 14:28 |
<elukey> |
memcached 1.4.25-2~wmf1 manually installed on mc1009 as part of a performance test (T129963) |
[production] |
| 14:02 |
<andrewbogott> |
stopping nova-api on labnet1002 |
[production] |
| 13:55 |
<andrewbogott> |
downtimed labservices1001, holmium, labcontrol1001 for one hour, disabled puppet as per https://phabricator.wikimedia.org/T128737 |
[production] |
| 13:14 |
<akosiaris> |
set ganeti2006 as drained (excluded from allocation operations) |
[production] |
| 11:32 |
<gehel> |
restarting blazegraph on wdqs1001 |
[production] |
| 10:40 |
<akosiaris> |
rebooted labsdb1004 |
[production] |
| 10:40 |
<akosiaris> |
fix problems with url_downloader created by PEBKAC |
[production] |
| 10:23 |
<jynus> |
stopping mysql & backuping db1023 in preparation for reimage |
[production] |
| 09:59 |
<jynus> |
SET GLOBAL thread_pool_stall_limit = 10; on db1057 |
[production] |