|
2016-06-06
§
|
| 10:46 |
<elukey> |
re-added kafka1001 to eventbus.svc.eqiad.wmflabs without rebooting since some concerns were raised from the Services team. Will have a discussion with them before proceeding. |
[production] |
| 10:44 |
<elukey@palladium> |
conftool action : set/pooled=yes; selector: kafka1001.eqiad.wmnet |
[production] |
| 10:33 |
<moritzm> |
installing perl updates (bugfixes and CVE-2015-8853) |
[production] |
| 10:27 |
<elukey@palladium> |
conftool action : set/pooled=no; selector: kafka1001.eqiad.wmnet |
[production] |
| 10:25 |
<elukey> |
rebooting kafka100[12] for kernel upgrades (one at the time with de-pool/re-pool actions) |
[production] |
| 09:12 |
<moritzm> |
installing dpkg bugfix updates on jessie systems |
[production] |
| 08:45 |
<mobrovac> |
change-prop deployed 9b04e475 |
[production] |
| 08:27 |
<gehel> |
lowering elasticsearch high watermark on eqiad cluster to rebalance disk space |
[production] |
| 08:17 |
<_joe_> |
rebooting mw1262 |
[production] |
| 07:57 |
<jynus> |
enabling GTID on pending coredb servers on eqiad |
[production] |
| 06:18 |
<aaron@tin> |
Synchronized php-1.28.0-wmf.4/includes/cache/LinkBatch.php: c2ba764f38e44e7 (duration: 00m 30s) |
[production] |
| 05:34 |
<robh> |
db2034 locked up via serial console. details on T137084, rebooting since its unresponsive to ssh or serial. |
[production] |
| 02:28 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Mon Jun 6 02:28:50 UTC 2016 (duration 5m 56s) |
[production] |
| 02:22 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.4) (duration: 09m 34s) |
[production] |
|
2016-06-03
§
|
| 22:57 |
<Krinkle> |
Purged https://en.wikipedia.org/static/images/project-logos/bawiki.png |
[production] |
| 22:53 |
<krinkle@tin> |
Synchronized static/images/project-logos/bawiki.png: (no message) (duration: 00m 24s) |
[production] |
| 21:57 |
<YuviPanda> |
started copying graphite data from usb back |
[production] |
| 21:27 |
<awight> |
update paymentswiki from 28b98ec254b2a15c8df61c568b62f221b328222f to 3df3329f75fdbc679baf37bfd3955880091b3ae1 |
[production] |
| 20:47 |
<ejegg> |
updated payments-wiki de86eadcd98922ee4207a0c46112585f3ba5c48d to 28b98ec254b2a15c8df61c568b62f221b328222f |
[production] |
| 20:25 |
<ejegg> |
updated GatewayReady hook on paymentswiki |
[production] |
| 19:37 |
<krinkle@tin> |
Synchronized php-1.28.0-wmf.4/extensions/WikimediaEvents/extension.json: T136920 (duration: 00m 28s) |
[production] |
| 19:04 |
<mutante> |
releases apt repo on bromine: export fresh jessie-mediawiki indexes |
[production] |
| 17:41 |
<mutante> |
uploaded parsoid 0.5.1 to releases |
[production] |
| 17:14 |
<robh> |
bast4001 coming down for second hdd installation. (there are currently no active users on system) |
[production] |
| 16:58 |
<mutante> |
magnesium - shutdown -h now, bye |
[production] |
| 15:30 |
<tgr@tin> |
Finished scap: revert AbuseFilter + config to pre-extension-registration state T136929 (duration: 06m 13s) |
[production] |
| 15:24 |
<tgr@tin> |
Started scap: revert AbuseFilter + config to pre-extension-registration state T136929 |
[production] |
| 14:38 |
<gehel> |
un-freezing writes from CirrusSearch to eqiad cluster during upgrade (T133126) |
[production] |
| 13:27 |
<elukey@palladium> |
conftool action : set/pooled=yes; selector: kafka2001.codfw.wmnet |
[production] |
| 13:22 |
<elukey@palladium> |
conftool action : set/pooled=no; selector: kafka2001.codfw.wmnet |
[production] |
| 13:22 |
<elukey@palladium> |
conftool action : set/pooled=yes; selector: kafka2002.codfw.wmnet |
[production] |
| 13:16 |
<hasharAway> |
Reenabling puppet on gallium. Forgot to put it back yesterday |
[production] |
| 13:14 |
<elukey@palladium> |
conftool action : set/pooled=no; selector: kafka2002.codfw.wmnet |
[production] |
| 13:11 |
<elukey> |
rebooting kafka200[12] (codfw EventBus) for kernel upgrades |
[production] |
| 11:18 |
<gehel> |
freezing writes from CirrusSearch to eqiad clsuter during upgrade (T133126) |
[production] |
| 10:48 |
<gehel> |
taking elasticsearch eqiad cluster down for upgrade to 2.3 (T133126) |
[production] |
| 10:39 |
<gehel> |
Starting upgrade of elasticsearch eqiad cluster to 2.3 (T133126) |
[production] |
| 10:35 |
<moritzm> |
restarting apache on bohrium (serving piwik.wikimedia.org) for libxml2 security update |
[production] |
| 10:23 |
<moritzm> |
restarting apache on planet1001 (serving planet.wikimedia.org) for libxml2 security update |
[production] |
| 08:42 |
<moritzm> |
rolling restart of scb cluster (mathoid, ores-uwsgi) in eqiad to pick up libxml2 security updates |
[production] |
| 08:38 |
<jynus> |
archiving again syslog.1 from ms-be2012 on /srv/swift-storage/sdl1/tmp |
[production] |