3251-3300 of 10000 results (37ms)
2016-02-18 ยง
22:18 <ori@mira> Synchronized php-1.27.0-wmf.13/extensions/SpamBlacklist: I0ad5289324: Pre-cache the link list for external link filters (duration: 02m 26s) [production]
22:01 <chasemp> reboot labvirt1009 [production]
21:59 <krinkle@tin> Synchronized php-1.27.0-wmf.13/includes/rcfeed/IRCColourfulRCFeedFormatter.php: T127360: Ignore RC_CATEGORIZE (duration: 01m 41s) [production]
21:59 <volans> Shutting down MySQL on es2001 (depooled) and starting data trasnfer to es2011 [ T127330 ] [production]
21:32 <chasemp> reboot labvirt1008 [production]
21:15 <volans@tin> Synchronized wmf-config/db-codfw.php: depool es2001 (duration: 01m 36s) [production]
20:52 <volans> Depool es2001 to copy the data to es2011 (T127330) [production]
20:41 <chasemp> reboot labvirt1006 [production]
20:39 <krinkle@tin> Synchronized w/static.php: Set MW_NO_SESSION (duration: 01m 55s) [production]
19:53 <urandom> upgrade Cassandra to 2.1.13 on restbase-test200[1-3].codfw.wmnet (restbase staging) : T126629 [production]
19:50 <chasemp> reboot labvirt1004 [production]
19:40 <paravoid> cr2-knams: deactivating BGP with 1257 [production]
19:21 <chasemp> reboot labvirt1003 [production]
19:06 <moritzm> restarting apache on bohrium [production]
19:04 <subbu> finished deploying parsoid dfbafb60 [production]
18:58 <subbu> synced code; restarted parsoid on wtp1001 as a canary [production]
18:56 <ori@mira> Synchronized wmf-config/mobile.php: Ib6fff26be162: Modify $wgRenderHashAppend when disabling responsive images on mobile (duration: 02m 24s) [production]
18:56 <subbu> starting parsoid deploy [production]
18:53 <twentyafterfour> tagged phabricator hotfixes as release/2016-02-18/2 in the phabricator/phabricator repository. This includes fixes T127290 and T127349 [production]
18:50 <ori@mira> Synchronized wmf-config/InitialiseSettings.php: I02dbbdb79ea9a: Re-set default vega version to 2 (duration: 03m 24s) [production]
18:49 <jynus> stopping, upgrading and reconfiguring dbstore1001 [production]
18:24 <chasemp> rebooting labvirt1001 [production]
18:22 <yurik> deployed graphoid https://gerrit.wikimedia.org/r/#/c/271563/ [production]
18:17 <elukey> re-enabled puppet on analytics1027 after maintenance [production]
18:06 <hoo> Updated Wikidata's property suggester with data from Monday's json dump [production]
18:04 <mobrovac> restbase deploy end of a42976cc82 [production]
18:03 <twentyafterfour> applied a hotfix from https://secure.phabricator.com/D15306 on iridium to test a fix for https://phabricator.wikimedia.org/T127290 [production]
18:00 <godog> reenable puppet on restbase1008 [production]
17:49 <mobrovac> restbase deploy start of a42976cc82 [production]
17:47 <elukey> manual failover of hadoop master node (analytics1001) to secondary (analytics1002) for maintenance (plus service restarts) [production]
17:41 <urandom> upgrading Cassandra to 2.1.13 on cerium.eqiad.wmnet (restbase staging) T126629 [production]
17:28 <mobrovac> restbase deploying a42976cc82 to restbase1002 [production]
17:27 <urandom> Cassandra on xenon.eqiad.wmnet killed by kernel after Cassandra package upgrade (coincidence?): [1482254.046078] Out of memory: Kill process 21854 (java) score 595 or sacrifice child : T126629 [production]
17:26 <urandom> Cassandra on xenon.eqiad.wmnet killed by kernel after Cassandra package upgrade (coincidence): [1482254.046078] Out of memory: Kill process 21854 (java) score 595 or sacrifice child [production]
17:21 <urandom> upgrading Cassandra to 2.1.13 on xenon.eqiad.wmnet (restbase staging) T126629 [production]
17:20 <elukey> disabled puppet on analytics1027 to avoid any Camus job to run [production]
17:04 <dcausse> updating completion suggester indices in eqiad [production]
16:54 <elukey> restarting hadoop services on analytics105* nodes for security updates [production]
16:49 <gehel> removing cirrus maintenance crons from mw1152 (T127322) [production]
15:52 <dcausse> creating adywiki indices in codfw [production]
15:44 <elukey> restarting hadoop services on analytics104* nodes for security updates [production]
15:37 <elukey> restarting hadoop services on analytics102* nodes for security update [production]
15:33 <moritzm> restarting apache on silver/wikitech [production]
15:10 <elukey> restarting hadoop services on analytics103* hosts for security upgrades [production]
14:06 <bblack> restarting apache on gallium (integration) [production]
13:13 <mark> decreased raid md2 sync_speed_max to 6000 on restbase1008 [production]
12:55 <elukey> rebooted kafka1022.eqiad.wmnet for kernel upgrade [production]
12:51 <godog> decrease raid min_speed to 8000 on restbase1008 [production]
12:50 <hoo@tin> Synchronized wmf-config/Wikibase.php: Bump $wgCacheEpoch for Wikidata (duration: 01m 54s) [production]
12:41 <elukey> rebooted kafka1020 for kernel upgrade. [production]