4651-4700 of 10000 results (45ms)
2016-06-06 §
14:00 <jynus> dropping database blog from m1 [production]
12:34 <hashar> restarted Jenkins, deadlock in IRC plugin [production]
10:46 <elukey> re-added kafka1001 to eventbus.svc.eqiad.wmflabs without rebooting since some concerns were raised from the Services team. Will have a discussion with them before proceeding. [production]
10:44 <elukey@palladium> conftool action : set/pooled=yes; selector: kafka1001.eqiad.wmnet [production]
10:33 <moritzm> installing perl updates (bugfixes and CVE-2015-8853) [production]
10:27 <elukey@palladium> conftool action : set/pooled=no; selector: kafka1001.eqiad.wmnet [production]
10:25 <elukey> rebooting kafka100[12] for kernel upgrades (one at the time with de-pool/re-pool actions) [production]
09:12 <moritzm> installing dpkg bugfix updates on jessie systems [production]
08:45 <mobrovac> change-prop deployed 9b04e475 [production]
08:27 <gehel> lowering elasticsearch high watermark on eqiad cluster to rebalance disk space [production]
08:17 <_joe_> rebooting mw1262 [production]
07:57 <jynus> enabling GTID on pending coredb servers on eqiad [production]
06:18 <aaron@tin> Synchronized php-1.28.0-wmf.4/includes/cache/LinkBatch.php: c2ba764f38e44e7 (duration: 00m 30s) [production]
05:34 <robh> db2034 locked up via serial console. details on T137084, rebooting since its unresponsive to ssh or serial. [production]
02:28 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon Jun 6 02:28:50 UTC 2016 (duration 5m 56s) [production]
02:22 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.4) (duration: 09m 34s) [production]
2016-06-05 §
14:55 <Dereckson> `mwscript initSiteStats.php --wiki csbwiki --update` (T137060) [production]
02:27 <l10nupdate@tin> ResourceLoader cache refresh completed at Sun Jun 5 02:27:38 UTC 2016 (duration 5m 35s) [production]
02:22 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.4) (duration: 08m 55s) [production]
2016-06-04 §
20:18 <apergos> rebooting mw1135, unresponsive to ssh or console login [production]
09:51 <elukey> restarted hhvm on mw1144 after the host was hanging (OOM killer restored basic host functionalities but not hhvm) [production]
09:47 <elukey> removed temporary Analytics Kafka upload retention override [production]
09:38 <elukey> Lowering down temporarily the Analytics kafka upload retention time to 24h to free space (T136690) [production]
02:30 <l10nupdate@tin> ResourceLoader cache refresh completed at Sat Jun 4 02:30:50 UTC 2016 (duration 5m 39s) [production]
02:25 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.4) (duration: 09m 08s) [production]
2016-06-03 §
22:57 <Krinkle> Purged https://en.wikipedia.org/static/images/project-logos/bawiki.png [production]
22:53 <krinkle@tin> Synchronized static/images/project-logos/bawiki.png: (no message) (duration: 00m 24s) [production]
21:57 <YuviPanda> started copying graphite data from usb back [production]
21:27 <awight> update paymentswiki from 28b98ec254b2a15c8df61c568b62f221b328222f to 3df3329f75fdbc679baf37bfd3955880091b3ae1 [production]
20:47 <ejegg> updated payments-wiki de86eadcd98922ee4207a0c46112585f3ba5c48d to 28b98ec254b2a15c8df61c568b62f221b328222f [production]
20:25 <ejegg> updated GatewayReady hook on paymentswiki [production]
19:37 <krinkle@tin> Synchronized php-1.28.0-wmf.4/extensions/WikimediaEvents/extension.json: T136920 (duration: 00m 28s) [production]
19:04 <mutante> releases apt repo on bromine: export fresh jessie-mediawiki indexes [production]
17:41 <mutante> uploaded parsoid 0.5.1 to releases [production]
17:14 <robh> bast4001 coming down for second hdd installation. (there are currently no active users on system) [production]
16:58 <mutante> magnesium - shutdown -h now, bye [production]
15:30 <tgr@tin> Finished scap: revert AbuseFilter + config to pre-extension-registration state T136929 (duration: 06m 13s) [production]
15:24 <tgr@tin> Started scap: revert AbuseFilter + config to pre-extension-registration state T136929 [production]
14:38 <gehel> un-freezing writes from CirrusSearch to eqiad cluster during upgrade (T133126) [production]
13:27 <elukey@palladium> conftool action : set/pooled=yes; selector: kafka2001.codfw.wmnet [production]
13:22 <elukey@palladium> conftool action : set/pooled=no; selector: kafka2001.codfw.wmnet [production]
13:22 <elukey@palladium> conftool action : set/pooled=yes; selector: kafka2002.codfw.wmnet [production]
13:16 <hasharAway> Reenabling puppet on gallium. Forgot to put it back yesterday [production]
13:14 <elukey@palladium> conftool action : set/pooled=no; selector: kafka2002.codfw.wmnet [production]
13:11 <elukey> rebooting kafka200[12] (codfw EventBus) for kernel upgrades [production]
11:18 <gehel> freezing writes from CirrusSearch to eqiad clsuter during upgrade (T133126) [production]
10:48 <gehel> taking elasticsearch eqiad cluster down for upgrade to 2.3 (T133126) [production]
10:39 <gehel> Starting upgrade of elasticsearch eqiad cluster to 2.3 (T133126) [production]
10:35 <moritzm> restarting apache on bohrium (serving piwik.wikimedia.org) for libxml2 security update [production]
10:23 <moritzm> restarting apache on planet1001 (serving planet.wikimedia.org) for libxml2 security update [production]