8251-8300 of 10000 results (64ms)
2016-04-26 ยง
18:49 <Amir1> successfully deployed new version of wikilabels to the staging [wikilabels]
18:41 <gehel> restarting HHVM on terbium to enable upgrade to 3.12.1 (T132751) [production]
17:55 <gehel> restarting elasticsearch server elastic2017.codfw.wmnet - activating unicast (T110236) [production]
17:38 <gehel> restarting elasticsearch server elastic2016.codfw.wmnet - activating unicast (T110236) [production]
16:45 <gehel> restarting elasticsearch server elastic2015.codfw.wmnet - activating unicast (T110236) [production]
16:43 <godog> start restbase1014-[ab] cleanup [production]
16:15 <gehel> restarting elasticsearch server elastic2014.codfw.wmnet - activating unicast (T110236) [production]
16:07 <ejegg> updated payments from f09297028acace67588c2de845b754e2ace75c97 to 3ac3a0d7bb6e2d8443a87fb62bd5412a95f75aa2 [production]
16:07 <ejegg> updated payments from [production]
15:34 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: Clean InitialiseSettings.php [[gerrit:285381]] (duration: 00m 27s) [production]
15:27 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: Enable action=credits on test and beta [[gerrit:285374]] (duration: 00m 29s) [production]
15:25 <papaul> OS installation on graphite2002 [production]
15:24 <gehel> restarting elasticsearch server elastic2013.codfw.wmnet - activating unicast (T110236) [production]
15:24 <thcipriani@tin> Synchronized wmf-config/CommonSettings.php: SWAT: Reformatted comment [[gerrit:285373]] (duration: 00m 28s) [production]
15:22 <hashar> 1.27.0-wmf.22 HHVM cache is warmed up | T131556 [production]
15:20 <thcipriani@tin> Synchronized wmf-config: SWAT: Switch to short syntax array [[gerrit:285361]] (duration: 00m 36s) [production]
15:17 <hashar@tin> Synchronized php-1.27.0-wmf.22/includes/DefaultSettings.php: Set = 1.27.0-wmf.22 (duration: 01m 04s) [production]
14:55 <hashar@tin> Finished scap: testwiki to php-1.27.0-wmf.22 and rebuild l10n cache (duration: 29m 28s) [production]
14:38 <gehel> restarting elasticsearch server elastic2012.codfw.wmnet - activating unicast (T110236) [production]
14:26 <hashar@tin> Started scap: testwiki to php-1.27.0-wmf.22 and rebuild l10n cache [production]
14:18 <hashar> Applied security patches to 1.27.0-wmf.22 | T131556 [releng]
13:33 <hashar> Checking out MediaWiki 1.27.0-wmf.22 on tin | T131556 [production]
13:33 <hashar> Checking out MediaWiki 1.27.0-wmf.22 on tin [production]
13:11 <gehel> restarting elasticsearch server elastic2011.codfw.wmnet - activating unicast (T110236) [production]
12:39 <hashar> starting cut of 1.27.0-wmf.22 branch ( poke ostriches ) [releng]
12:27 <gehel> restarting elasticsearch server elastic2010.codfw.wmnet - activating unicast (T110236) [production]
12:09 <elukey> mw1145 powercycled (root login timeout on the console) [production]
11:43 <gehel> restarting elasticsearch server elastic2009.codfw.wmnet - activating unicast (T110236) [production]
10:31 <jynus> restarting mw1143 as is no longer accessible [production]
10:29 <hashar> restored integration/phpunit on CI slaves due to https://integration.wikimedia.org/ci/job/operations-mw-config-phpunit/ failling [releng]
09:51 <jynus> restarting db2068 for upgrade before returning from maintenance [production]
09:50 <gehel> starting reinstall of wdqs1001 (T133566) [production]
09:47 <gehel> restarting elasticsearch server elastic2008.codfw.wmnet - activating unicast (T110236) [production]
09:41 <moritzm> uploaded apache 2.4.10-10+deb8u4+wmf1 to carbon [production]
09:12 <_joe_> restarted hhvm on mw1133, almost OOM [production]
09:11 <hashar> CI is back up! [releng]
09:11 <hashar> CI is back up! [production]
09:09 <mobrovac> citoid deployed 36c2bf02 [production]
09:03 <jynus> restarting db1069 s1 instance- one query is "stuck", creating lag on labs [production]
08:56 <gehel> depooling wdqs1001 from varnish for reinstall [production]
08:51 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1052 (old s1-master) with low weight (duration: 00m 31s) [production]
08:50 <YuviPanda> restarted nova-conductor & scheduler on labcontrol1001 for T133654 [production]
08:45 <hashar> Most of CI is down / deadlocked due to wmflabs being unresponsive T133654 [production]
08:44 <gehel> restarting elasticsearch server elastic2007.codfw.wmnet - activating unicast (T110236) [production]
08:27 <jynus> stopping db2068 for cloning to db2047 [production]
08:20 <hashar> shutoff instance castor, does not seem to be able to start again :( | T133652 [releng]
08:12 <hashar> hard rebooting castor instance | T133652 [releng]
08:10 <hashar> soft rebooting castor instance | T133652 [releng]
08:06 <hashar> CI jobs deadlocked due to castor being unavailable | https://phabricator.wikimedia.org/T133652 [releng]
08:06 <hashar> CI jobs deadlocked due to castor being unavailable | https://phabricator.wikimedia.org/T133652 [production]