3001-3050 of 10000 results (23ms)
2016-04-27 ยง
21:22 <cwd> updated civicrm from 15a0086eef78f16110eba358a28ef78b51a385e1 to 777a91b8f9f6003a3eebdb8f2c73e45cc2bfb4a4 [production]
21:03 <bblack> rebooting cp1065 [production]
21:01 <ebernhardson@tin> Synchronized wmf-config/InitialiseSettings.php: Restore codfw to elasticsearch config T133784 (duration: 00m 31s) [production]
21:00 <ebernhardson@tin> Synchronized wmf-config/CirrusSearch-production.php: Restore codfw to elasticsearch config T133784 (duration: 00m 37s) [production]
20:48 <thcipriani> restarting jenkins after plugin downgrade [production]
20:41 <hashar> 1.27.0-wmf.22 to group1 has been completed without incident. Deployment is open ! [production]
20:41 <ebernhardson> Enabled cirrussearch writes to codfw only on mw1165 w/ live hack [production]
20:32 <gehel> switching wdqs1002 to maintenance and reimporting data (T133566) [production]
20:28 <cscott> updated OCG to version e39e06570083877d5498da577758cf8d162c1af4 [production]
20:20 <yurik> deployed kartotherian & tilerator services [production]
20:09 <gehel> adding back wdqs1001 to varnish configuration after reinstall (T133566) [production]
19:24 <Pchelolo> update restbase to e9fbdfe [production]
19:18 <Pchelolo> update restbase to e9fbdfe: canary on restbase1007 [production]
19:11 <Pchelolo> update restbase to e9fbdfe: staging [production]
19:09 <hashar@tin> rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.27.0-wmf.22 [production]
19:00 <dcausse> restarting elastic on elastic2007.codfw.wmnet (master) [production]
18:56 <mutante> creating VM ununpentium on ganeti/eqiad (T123713) [production]
18:55 <ebernhardson@tin> Synchronized wmf-config/InitialiseSettings.php: Drop codfw from elasticsearch config T133784 (duration: 00m 36s) [production]
18:55 <ebernhardson@tin> Synchronized wmf-config/CirrusSearch-production.php: Drop codfw from elasticsearch config T133784 (duration: 00m 25s) [production]
18:02 <jynus> generating new triggers for eventlogging_sync schema T108856 [production]
16:58 <gehel> increase throttling limit and concurrency on recoveries for elasticsearch codfw cluster (T133784) [production]
16:05 <gehel> increasing curl pool size for jobrunners (T133755) [production]
15:46 <elukey> restarted kafka1013 for java upgrades [production]
15:30 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: Enable NewUserMessage on hiwikiquote [[gerrit:285639]] (duration: 00m 31s) [production]
15:09 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: Add Subject namespace to hiwikibooks [[gerrit:285008]] (duration: 02m 41s) [production]
14:52 <moritzm> uploaded pcre 8.31-2ubuntu2.3+wm1 to carbon for trusty-wikimedia (rebuild of latest trusty update with our patch to enable JIT) [production]
14:44 <elukey> repooled kafka1001 after upgrades, will do the same procedure to kafka1002 [production]
14:40 <_joe_> upgraded conftool on palladium [production]
14:40 <elukey> restarted kafka on kafka1001 [production]
14:38 <_joe_> upgrading conftool on all cp servers [production]
14:33 <elukey> kafka1001.eqiad.wmnet depooled from eventbus for kafka upgrades (via confctl) [production]
14:14 <chasemp> restart phd on iridium as it keeps complaining it lost procs (seems ok now) [production]
13:53 <elukey> restarted kafka on kafka1018.eqiad.wmnet for Java upgrades [production]
13:24 <gehel> hard restart of codfw elasticsearch cluster [production]
13:23 <_joe_> uploading new conftool packages, T128199 [production]
12:15 <dcausse> restarting elastic on elastic2004.codfw.wmnet [production]
11:43 <dcausse> restarting elastic on elastic2003.codfw.wmnet [production]
11:05 <dcausse> restarting elastic on elastic2002.codfw.wmnet [production]
10:58 <reedy@tin> LocalisationUpdate failed: git pull of core failed [production]
10:58 <reedy@tin> LocalisationUpdate failed: git pull of core failed [production]
10:49 <dcausse> restarting elastic on elastic2001.codfw.wmnet [production]
10:36 <gehel@tin> Synchronized wmf-config/CirrusSearch-production.php: (no message) (duration: 02m 47s) [production]
10:30 <gehel> switching elasticsearch morelike traffic from codfw to eqiad [production]
10:01 <_joe_> shutting down mw10[7-8][0-9] and mw112[1-9]/mw1130 for T126242 [production]
09:56 <_joe_> clean puppet certs and facts on mw10[7-8][0-9] and mw112[1-9]/mw1130 for T126242 [production]
09:23 <_joe_> restarted hhvm on mw1144, usual deadlock [production]
09:11 <_joe_> repooling cp3038 [production]
09:09 <_joe_> repooling cp3038 [production]
08:59 <_joe_> hard rebooting cp3038, console unreachable [production]
08:59 <jynus> starting mysql on holmium [production]