|
2016-05-23
§
|
| 14:44 |
<godog> |
reboot restbase2005 in single user mode for T113714 |
[production] |
| 14:43 |
<filippo@palladium> |
conftool action : set/pooled=no; selector: restbase2005.codfw.wmnet |
[production] |
| 12:57 |
<moritzm> |
rolling restart of cassandra on maps-test cluster for openjdk security update |
[production] |
| 12:44 |
<mobrovac> |
restbase restarting to apply https://gerrit.wikimedia.org/r/#/c/289092/ |
[production] |
| 12:33 |
<jynus> |
stopping, backing up and reimage db1016 T135973 (it will also affect db2010 lag) |
[production] |
| 12:15 |
<filippo@palladium> |
conftool action : set/pooled=yes; selector: restbase2009.codfw.wmnet |
[production] |
| 12:15 |
<filippo@palladium> |
conftool action : set/pooled=yes; selector: restbase2008.codfw.wmnet |
[production] |
| 12:15 |
<filippo@palladium> |
conftool action : set/pooled=yes; selector: restbase2007.codfw.wmnet |
[production] |
| 11:42 |
<mobrovac> |
restbase deploying 75a94ee to restbase2009 |
[production] |
| 11:24 |
<godog> |
run puppet and roll-restart cassandra-metrics-collector on restbase codfw/eqiad |
[production] |
| 11:20 |
<godog> |
deploy new version of cassandra-metrics-collector T135385 |
[production] |
| 10:57 |
<moritzm> |
restarting hhvm on app servers in codfw for librsvg update |
[production] |
| 10:32 |
<_joe_> |
running updateCollations.php --force on ptwiki, T58041 |
[production] |
| 10:24 |
<moritzm> |
rolling restart of restbase1* for openjdk-8 update |
[production] |
| 10:00 |
<moritzm> |
reverted net.netfilter.nf_conntrack_tcp_timeout_time_wait on kafka1013 back to 65 (as set by default by puppet) |
[production] |
| 08:56 |
<jynus> |
stopping, backing up and reimage db2010 T135973 |
[production] |
| 08:44 |
<moritzm> |
rolling restart of restbase2* for openjdk-8 update |
[production] |
| 08:20 |
<moritzm> |
install restarting hhvm on canary systems for librsvg update |
[production] |
| 08:01 |
<jynus> |
performing schema change on s7 T130692 |
[production] |
| 07:00 |
<_joe_> |
installed the new hhvm package on mw2017, T86096 |
[production] |
| 06:55 |
<_joe_> |
uploaded a new hhvm package for trusty linked to libicu52, T86096 |
[production] |
| 06:42 |
<elukey> |
Removed Kafka temp. override for webrequest_upload retention.ms after freeing some disk space. |
[production] |
| 06:31 |
<elukey> |
Set kafka retention.ms=172800000 for the topic webrequest_upload to free some disk space on kafka1022 |
[production] |
| 02:33 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Mon May 23 02:33:00 UTC 2016 (duration 8m 38s) |
[production] |
| 02:24 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.2) (duration: 10m 41s) |
[production] |
|
2016-05-20
§
|
| 20:36 |
<chasemp> |
restart rabbitmq on labcontrol1001 |
[production] |
| 17:05 |
<moritzm> |
uploaded librsvg 2.40.2-1+wm2 for trusty-wikimedia to carbon (backported patches from librsvg DSA to our custom trusty build) |
[production] |
| 16:54 |
<bd808> |
Cleaned up /tmp/mw-cache-1.27.0-wmf.2* cache files on tin |
[production] |
| 16:50 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Fri May 20 16:50:25 UTC 2016 (duration 9m 38s) |
[production] |
| 16:40 |
<bd808@tin> |
scap sync-l10n completed (1.28.0-wmf.2) (duration: 10m 06s) |
[production] |
| 16:18 |
<bd808> |
kicking off manual l10nupdate run on tin |
[production] |
| 16:11 |
<mwdeploy@tin> |
sync-l10n completed (1.27.0-wmf.23) (duration: 20990m 58s) |
[production] |
| 15:52 |
<jynus> |
performing schema change on s5 T130692 |
[production] |
| 15:16 |
<godog> |
roll-restart cassandra-metrics-collector in eqiad for T135385 |
[production] |
| 15:05 |
<gehel> |
starting cluster rejoining for cassandra onmaps-test2001 |
[production] |
| 15:03 |
<godog> |
roll-restart cassandra-metrics-collector in codfw for T135385 |
[production] |
| 15:02 |
<moritzm> |
uploaded librsvg 2.40.5-1+deb8u2+wmf1 for jessie-wikimedia to carbon (rebase of locally patched package on top of latest security update) |
[production] |
| 14:50 |
<gehel> |
shutting down kartotherian on maps-test2001 (accidental data deletion) |
[production] |
| 14:22 |
<gehel> |
cassandra downgraded on maps2*.codfw.wmnet |
[production] |
| 14:04 |
<_joe_> |
removing libicu48 from trusty archives, kept a copy of the packages in my homedir on carbon |
[production] |
| 13:45 |
<mark> |
Enabled cr2-codfw et-0/* interfaces, reenabling OSPF/OSPF3 |
[production] |