2014-11-10
§
|
15:50 |
<reedy> |
Synchronized wmf-config/interwiki.cdb: Updating interwiki cache (duration: 00m 14s) |
[production] |
11:54 |
<oblivian> |
Synchronized wmf-config/CommonSettings.php: Open HHVM to 15% of anons (duration: 00m 06s) |
[production] |
10:06 |
<_joe_> |
upgraded hhvm on the whole cluster |
[production] |
09:19 |
<hashar> |
Restarting Jenkins to java 7 |
[production] |
09:17 |
<_joe_> |
upgrading hhvm across the fleet with new package with debug symbols |
[production] |
09:14 |
<hashar> |
Jenkins: switching from Java 6 to Java 7 {{gerrit|153764}} |
[production] |
09:02 |
<_joe_> |
repooling mw1189 at reduced load |
[production] |
08:52 |
<_joe_> |
dist-upgrading mw1189 to use the latest kernel available, then rebooting |
[production] |
08:32 |
<YuviPanda> |
ran mklost+found on /srv/postgres for reducing cronspam |
[production] |
08:21 |
<paravoid> |
force-rebooting ms-be2011, kernel "xfs stuck" |
[production] |
01:55 |
<ori> |
depooled mw1114 after it became unresponsive, likely <https://phabricator.wikimedia.org/T1195> |
[production] |
2014-11-07
§
|
20:53 |
<ebernhardson> |
Synchronized php-1.25wmf7/extensions/Flow: Bump flow submodule for bug 71858 (duration: 00m 08s) |
[production] |
20:33 |
<ori> |
Synchronized php-1.25wmf6/includes/WebResponse.php: I569b2ebbc: Add WebResponse::getHeader() (duration: 00m 09s) |
[production] |
20:13 |
<ori> |
Synchronized php-1.25wmf7/includes/WebResponse.php: I569b2ebbc: Add WebResponse::getHeader() (duration: 00m 07s) |
[production] |
20:03 |
<YuviPanda> |
restarted gitblit on antimony |
[production] |
19:36 |
<YuviPanda> |
upgraded php5-fss to 1.0-2 on virt1000 to prevent cronspam |
[production] |
19:36 |
<demon> |
Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 04s) |
[production] |
16:27 |
<godog> |
shut db1017 briefly for cmjohnson to look |
[production] |
14:46 |
<_joe_> |
installing hhvm package built with full debug symbols on mw1114 |
[production] |
09:00 |
<oblivian> |
Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 07s) |
[production] |
08:00 |
<_joe_> |
powercycled mw1169, console unresponsive, not responding to pings |
[production] |
07:52 |
<_joe_> |
killed the master apache process on mw1191, stuck in a futex wait, restarted apache |
[production] |
07:44 |
<_joe_> |
upgrading the hhvm appservers to the new package version, it seems stable enough |
[production] |
01:01 |
<reedy> |
Synchronized php-1.25wmf7/extensions/Flow/: (no message) (duration: 00m 16s) |
[production] |
00:49 |
<reedy> |
Synchronized php-1.25wmf6/includes/api/: (no message) (duration: 00m 14s) |
[production] |
00:36 |
<reedy> |
Synchronized php-1.25wmf7/extensions/MobileFrontend/: (no message) (duration: 00m 16s) |
[production] |
00:27 |
<reedy> |
Synchronized php-1.25wmf7/extensions/VisualEditor/: (no message) (duration: 00m 15s) |
[production] |
00:26 |
<reedy> |
Synchronized php-1.25wmf6/extensions/GeoData: (no message) (duration: 00m 14s) |
[production] |
00:03 |
<Reedy> |
running foreachwikiindblist wikidataclient.dblist extensions/Wikidata/extensions/Wikibase/lib/maintenance/populateSitesTable.php --strip-protocols |
[production] |
00:00 |
<reedy> |
Synchronized wmf-config/InitialiseSettings.php: touch (duration: 00m 14s) |
[production] |
00:00 |
<reedy> |
Synchronized langlist: mai (duration: 00m 14s) |
[production] |
2014-11-06
§
|
23:26 |
<bd808> |
deleted corrupt mediawki/core clone in workspace/mwext-MobileFrontend-qunit-mobile on gallium |
[production] |
23:24 |
<bd808> |
Killed 3 hung /usr/local/bin/logstash_optimize_index.sh processes on logstash1002 |
[production] |
23:22 |
<bd808> |
restarted logstash on logstash1002 |
[production] |
23:21 |
<bd808> |
restarted logstash on logstash1003 |
[production] |
23:02 |
<bd808> |
restarted logstash on logstash1001 for the usual reason (no events making it to elasticsearch) |
[production] |
22:19 |
<subbu> |
updated parsoid to d23d2be6 (+ a hotfix to the production localsettings config file) |
[production] |
21:26 |
<ottomata> |
added Range header field to varnishkafka webrequest logs |
[production] |
19:45 |
<andrewbogott> |
restarted ntp on labstore1001 |
[production] |
19:33 |
<manybubbles> |
manybubbles is done with SWAT |
[production] |
16:11 |
<manybubbles> |
Synchronized php-1.25wmf7/extensions/MultimediaViewer/: SWAT revert layout changes (duration: 00m 06s) |
[production] |