2017-04-06
ยง
|
17:45 |
<maxsem@tin> |
Started deploy [tilerator/deploy@71aed11]: https://gerrit.wikimedia.org/r/#/c/346782/ to test hosts |
[production] |
17:41 |
<halfak@tin> |
Finished deploy [ores/deploy@3396b64]: T161748 (duration: 21m 08s) |
[production] |
17:20 |
<halfak@tin> |
Started deploy [ores/deploy@3396b64]: T161748 |
[production] |
17:19 |
<arlolra@tin> |
Finished deploy [parsoid/deploy@b5c2a2b]: Updating Parsoid to 56ae82bb (duration: 08m 29s) |
[production] |
17:13 |
<legoktm@tin> |
Synchronized wmf-config/InitialiseSettings.php: Deploy Linter to medium wikis too - T148609 (duration: 00m 40s) |
[production] |
17:11 |
<arlolra@tin> |
Started deploy [parsoid/deploy@b5c2a2b]: Updating Parsoid to 56ae82bb |
[production] |
16:38 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1079 - T160390 (duration: 00m 43s) |
[production] |
16:18 |
<elukey> |
restart hhvm on mw1227 - debug in /tmp/hhvm.30097.bt. - theads stuck in HPHP::Treadmill::getAgeOldestRequest |
[production] |
16:17 |
<hoo@tin> |
Synchronized wmf-config/Wikibase-production.php: Try using redisLockManager for test.wikidata.org (T159828) (duration: 00m 39s) |
[production] |
16:11 |
<hoo@tin> |
Synchronized wmf-config/InitialiseSettings.php: Temporarily enable change dispatch logging on testwikidata (duration: 00m 45s) |
[production] |
15:48 |
<hoo@tin> |
Synchronized wmf-config/Wikibase.php: Fix Wikibase site groups for testwiki and test2wiki (duration: 00m 40s) |
[production] |
15:36 |
<hoo@tin> |
Synchronized wmf-config/Wikibase.php: Don't set removed Wikibase client settings (duration: 00m 40s) |
[production] |
15:27 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Add tempdb2001 to config files - T162290 (duration: 00m 40s) |
[production] |
15:26 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Add tempdb2001 to config files - T162290 (duration: 00m 39s) |
[production] |
14:55 |
<hoo@tin> |
Synchronized wmf-config/InitialiseSettings.php: touch (duration: 00m 42s) |
[production] |
14:51 |
<hoo> |
Restarted apache on mwdebug1001 in order to test a potential CACHE_ACCEL issue |
[production] |
14:46 |
<hoo@tin> |
Synchronized wmf-config/: Don't use "enwiki" as Wikibase site id on testwiki and test2wiki (T94416) (duration: 01m 08s) |
[production] |
14:12 |
<hoo@tin> |
Synchronized wmf-config/Wikibase.php: Add testwiki and test2wiki to "specialSiteLinkGroups" on testwikidata (T94416) (duration: 00m 40s) |
[production] |
14:04 |
<elukey> |
reimage analytics1002 to Debian Jessie (Hadoop Master Node standby) |
[production] |
13:44 |
<gehel> |
re-generating tiles for tasmania on maps codfw cluster |
[production] |
13:42 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1079 - T160390 (duration: 00m 39s) |
[production] |
13:39 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db1079 - T160390 (duration: 00m 43s) |
[production] |
13:39 |
<marostegui> |
Deploy schema change db1079 (s7 wikis) - T160390 |
[production] |
13:34 |
<hashar> |
European SWAT completed |
[production] |
13:30 |
<marostegui> |
Deploy Deploy schema change dbstore1002 (s7 wikis) - T160390 |
[production] |
13:20 |
<hashar@tin> |
Synchronized php-1.29.0-wmf.19/extensions/Popups: renderer: Pass event to behavior for processing - T162324 (duration: 00m 51s) |
[production] |
12:51 |
<ema> |
upgrade cp3007 to linux 4.9 T162029 |
[production] |
12:50 |
<moritzm> |
upgraded mw1261 to HHVM 3.18.2 with cherrypicked fix for stat_cache deadlock, now running with stat_cache enabled again |
[production] |
12:39 |
<ema> |
rebooting cp2006 again to check for potential issues bringing up network ifaces / loading intel_uncore T162029 |
[production] |
12:28 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Restore db1081 original weight - T161088 (duration: 00m 40s) |
[production] |
12:28 |
<ema> |
cp2009 stuck rebooting, powercycled |
[production] |
12:20 |
<ema> |
upgrade cp2009 to linux 4.9 T162029 |
[production] |
12:16 |
<moritzm> |
uploaded HHVM 3.18.2 to jessie-wikimedia/experimental |
[production] |
11:51 |
<ema> |
upgrade cp2006 to linux 4.9 T162029 |
[production] |
11:27 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increae db1081 weight - T161088 (duration: 00m 40s) |
[production] |
10:59 |
<_joe_> |
running some tests for the switchdc automation |
[production] |
09:33 |
<moritzm> |
installing freetype security updates on trusty |
[production] |
08:43 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increae db1081 weight - T161088 (duration: 00m 39s) |
[production] |
08:41 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=no; selector: dc=codfw,cluster=wdqs |
[production] |
08:40 |
<moritzm> |
installing glibc updates on trusty |
[production] |
08:37 |
<gehel> |
shutting down wdqs codfw for data reimport - T162111 |
[production] |
08:34 |
<hashar> |
starting Jenkins on contint1001 |
[production] |
08:27 |
<moritzm> |
rebooting contint1001 to Linux 4.9 |
[production] |
08:02 |
<elukey> |
restart hhvm on mw1194 - dump debug in /tmp/hhvm.1692.bt. - threads stuck in HPHP::Treadmill::getAgeOldestRequest |
[production] |
07:56 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increae db1081 weight - T161088 (duration: 00m 39s) |
[production] |
07:32 |
<ema> |
cache_upload: ban all objects with content-type ~ "^text" T162035 |
[production] |
07:16 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1081 with low weight - T161088 (duration: 00m 48s) |
[production] |
06:29 |
<elukey> |
restart hhvm on mw1165 (jobrunner) - dump debug in /tmp/hhvm.19449.bt. - threads stuck in HPHP::Treadmill::getAgeOldestRequest |
[production] |
06:09 |
<marostegui> |
Deploy schema change db2029 (s7 codfw master) - T160390 |
[production] |
06:02 |
<marostegui> |
Configure and start replication on db1081 after the defragment - T161088 |
[production] |