5201-5250 of 10000 results (39ms)
2016-05-11 ยง
18:58 <robh> disregard ulsfo cp system icinga spam, onsite work for thermal paste per T134831 [production]
18:55 <hoo@tin> Synchronized wmf-config/InitialiseSettings.php: Enable the ArticlePlaceholder on htwiki - T134273 (duration: 00m 46s) [production]
18:47 <hoo@tin> Finished scap: Update ArticlePlaceholder to master for initial Wikipedia deployment. (duration: 51m 18s) [production]
17:59 <moritzm> uploaded new linux package for jessie-wikimedia to carbon (based on 4.4.9) [production]
17:56 <hoo@tin> Started scap: Update ArticlePlaceholder to master for initial Wikipedia deployment. [production]
17:53 <hoo@tin> Synchronized php-1.28.0-wmf.1/extensions/Wikidata: Update Wikibase (Property ordering related backports) (duration: 01m 52s) [production]
17:51 <hoo@tin> Synchronized php-1.27.0-wmf.23/extensions/Wikidata: Update Wikibase (Property ordering related backports) (duration: 02m 11s) [production]
17:34 <bblack> wiping cache_misc caches again... [production]
16:43 <hashar> Reduced number of executors on Trusty instances from 3 to 2. Memory get exhausted causing the tmpfs to drop files and thus MW jobs to fail randomly. [production]
16:14 <akosiaris> upgrade etherpad software to 1.6.0-1 and evaluate stability. packages NOT yet uploaded on apt.w.o [production]
16:07 <bblack> wiping cache_misc caches again... [production]
15:22 <thcipriani> first SWAT with scap subcommands (3.2.0-1) complete [production]
15:20 <thcipriani@tin> Synchronized php-1.28.0-wmf.1/extensions/Translate/tag/PageTranslationHooks.php: SWAT: On documentation unit deletion, dont attempt to re-render translation page [[gerrit:288165]] (duration: 00m 27s) [production]
15:11 <thcipriani@tin> Synchronized portals: SWAT: T128546 updating portal stats [[gerrit:288192]] (duration: 00m 33s) [production]
15:10 <thcipriani@tin> Synchronized portals/prod/wikipedia.org/assets: SWAT: T128546 updating portal stats [[gerrit:288192]] (duration: 00m 43s) [production]
14:36 <bblack> wiping caches on cache_misc... [production]
13:33 <ottomata> starting kafka 0.9 upgrade of analytics-eqiad cluster [production]
13:31 <elukey> camus + puppet disabled on analytics1027 as prep step for kafka cluster migration to 0.9 [production]
12:50 <elukey> mw1147 powercycled due to unresponsiveness (not able to login as root) [production]
12:50 <ema> upgrading cp1061 to varnish 4 (T131501) [production]
12:47 <ema> upgrading cp1058 to varnish 4 (T131501) [production]
12:39 <ema> upgrading cp1051 to varnish 4 (T131501) [production]
12:33 <ema> upgrading cp1045 to varnish 4 (T131501) [production]
12:18 <ema> upgrading cp2025 to varnish 4 (T131501) [production]
12:10 <ema> upgrading cp2018 to varnish 4 (T131501) [production]
12:09 <moritzm> installing libarchive security updates [production]
12:05 <ema> upgrading cp2012 to varnish 4 (T131501) [production]
11:55 <ema> upgrading cp2006 to varnish 4 (T131501) [production]
11:34 <_joe_> restarting just HHVM on mw1142 [production]
11:34 <_joe_> restarting mw1142 [production]
10:51 <elukey@palladium> conftool action : set/pooled=yes; selector: kafka1002.eqiad.wmnet [production]
10:50 <elukey@palladium> conftool action : set/pooled=no; selector: kafka1002.eqiad.wmnet [production]
10:48 <elukey> restarting eventbus on kafka100[12] for security upgrades [production]
10:47 <elukey@palladium> conftool action : set/pooled=yes; selector: kafka1001.eqiad.wmnet [production]
10:44 <moritzm> gradually disabling unprivileged bpf on Linux 4.4 hosts via sysctl (once completed this will be puppetised, but the sysctl can't be reverted without a reboot so be careful for the initial activation) [production]
10:43 <elukey@palladium> conftool action : set/pooled=no; selector: kafka1001.eqiad.wmnet [production]
10:20 <ema> upgrading cp4004 to varnish 4 (T131501) [production]
10:12 <ema> upgrading cp4003 to varnish 4 (T131501) [production]
10:03 <ema> upgrading cp4002 to varnish 4 (T131501) [production]
09:41 <ema> upgrading cp4001 to varnish 4 (T131501) [production]
09:37 <moritzm> rolling restart of scb in eqiad to pick up openssl update [production]
09:14 <ema> upgrading cp3010 to varnish 4 (T131501) [production]
09:06 <ema> upgrading cp3009 to varnish 4 (T131501) [production]
08:55 <ema> upgrading cp3008 to varnish 4 (T131501) [production]
08:34 <mobrovac> restbase deploy end of beaaa71 [production]
08:28 <godog> bootstrap restbase2008-a T132976 [production]
08:24 <mobrovac> restbase deploy start of beaaa71 [production]
08:18 <elukey> memcached on mc1009 restarted with chunk size growth factor 1.15 (was: 1.05) [production]
08:04 <moritzm> restarting apache on palladium for openssl update [production]
08:03 <elukey> puppet disabled on mc10XX hosts for https://gerrit.wikimedia.org/r/#/c/287913 [production]