2201-2250 of 10000 results (36ms)
2016-06-06 §
08:27 <gehel> lowering elasticsearch high watermark on eqiad cluster to rebalance disk space [production]
08:17 <_joe_> rebooting mw1262 [production]
07:57 <jynus> enabling GTID on pending coredb servers on eqiad [production]
06:18 <aaron@tin> Synchronized php-1.28.0-wmf.4/includes/cache/LinkBatch.php: c2ba764f38e44e7 (duration: 00m 30s) [production]
05:34 <robh> db2034 locked up via serial console. details on T137084, rebooting since its unresponsive to ssh or serial. [production]
02:28 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon Jun 6 02:28:50 UTC 2016 (duration 5m 56s) [production]
02:22 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.4) (duration: 09m 34s) [production]
2016-06-05 §
14:55 <Dereckson> `mwscript initSiteStats.php --wiki csbwiki --update` (T137060) [production]
02:27 <l10nupdate@tin> ResourceLoader cache refresh completed at Sun Jun 5 02:27:38 UTC 2016 (duration 5m 35s) [production]
02:22 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.4) (duration: 08m 55s) [production]
2016-06-04 §
20:18 <apergos> rebooting mw1135, unresponsive to ssh or console login [production]
09:51 <elukey> restarted hhvm on mw1144 after the host was hanging (OOM killer restored basic host functionalities but not hhvm) [production]
09:47 <elukey> removed temporary Analytics Kafka upload retention override [production]
09:38 <elukey> Lowering down temporarily the Analytics kafka upload retention time to 24h to free space (T136690) [production]
02:30 <l10nupdate@tin> ResourceLoader cache refresh completed at Sat Jun 4 02:30:50 UTC 2016 (duration 5m 39s) [production]
02:25 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.4) (duration: 09m 08s) [production]
2016-06-03 §
22:57 <Krinkle> Purged https://en.wikipedia.org/static/images/project-logos/bawiki.png [production]
22:53 <krinkle@tin> Synchronized static/images/project-logos/bawiki.png: (no message) (duration: 00m 24s) [production]
21:57 <YuviPanda> started copying graphite data from usb back [production]
21:27 <awight> update paymentswiki from 28b98ec254b2a15c8df61c568b62f221b328222f to 3df3329f75fdbc679baf37bfd3955880091b3ae1 [production]
20:47 <ejegg> updated payments-wiki de86eadcd98922ee4207a0c46112585f3ba5c48d to 28b98ec254b2a15c8df61c568b62f221b328222f [production]
20:25 <ejegg> updated GatewayReady hook on paymentswiki [production]
19:37 <krinkle@tin> Synchronized php-1.28.0-wmf.4/extensions/WikimediaEvents/extension.json: T136920 (duration: 00m 28s) [production]
19:04 <mutante> releases apt repo on bromine: export fresh jessie-mediawiki indexes [production]
17:41 <mutante> uploaded parsoid 0.5.1 to releases [production]
17:14 <robh> bast4001 coming down for second hdd installation. (there are currently no active users on system) [production]
16:58 <mutante> magnesium - shutdown -h now, bye [production]
15:30 <tgr@tin> Finished scap: revert AbuseFilter + config to pre-extension-registration state T136929 (duration: 06m 13s) [production]
15:24 <tgr@tin> Started scap: revert AbuseFilter + config to pre-extension-registration state T136929 [production]
14:38 <gehel> un-freezing writes from CirrusSearch to eqiad cluster during upgrade (T133126) [production]
13:27 <elukey@palladium> conftool action : set/pooled=yes; selector: kafka2001.codfw.wmnet [production]
13:22 <elukey@palladium> conftool action : set/pooled=no; selector: kafka2001.codfw.wmnet [production]
13:22 <elukey@palladium> conftool action : set/pooled=yes; selector: kafka2002.codfw.wmnet [production]
13:16 <hasharAway> Reenabling puppet on gallium. Forgot to put it back yesterday [production]
13:14 <elukey@palladium> conftool action : set/pooled=no; selector: kafka2002.codfw.wmnet [production]
13:11 <elukey> rebooting kafka200[12] (codfw EventBus) for kernel upgrades [production]
11:18 <gehel> freezing writes from CirrusSearch to eqiad clsuter during upgrade (T133126) [production]
10:48 <gehel> taking elasticsearch eqiad cluster down for upgrade to 2.3 (T133126) [production]
10:39 <gehel> Starting upgrade of elasticsearch eqiad cluster to 2.3 (T133126) [production]
10:35 <moritzm> restarting apache on bohrium (serving piwik.wikimedia.org) for libxml2 security update [production]
10:23 <moritzm> restarting apache on planet1001 (serving planet.wikimedia.org) for libxml2 security update [production]
08:42 <moritzm> rolling restart of scb cluster (mathoid, ores-uwsgi) in eqiad to pick up libxml2 security updates [production]
08:38 <jynus> archiving again syslog.1 from ms-be2012 on /srv/swift-storage/sdl1/tmp [production]
08:35 <jynus> created new LDAP group grafana-admin, gid=1007 [production]
08:34 <elukey> rebooting kafka1012 for kernel upgrades. [production]
08:08 <moritzm> installing libxml2 security updates on jessie systems [production]
07:19 <kart_> Update cxserver to 19a71f1 [production]
06:29 <moritzm> installing nginx security updates on Ubuntu systems (Debian installs updated some days ago) [production]
02:36 <l10nupdate@tin> ResourceLoader cache refresh completed at Fri Jun 3 02:36:39 UTC 2016 (duration 5m 58s) [production]
02:30 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.4) (duration: 08m 35s) [production]