2251-2300 of 10000 results (40ms)
2017-04-06 ยง
16:11 <hoo@tin> Synchronized wmf-config/InitialiseSettings.php: Temporarily enable change dispatch logging on testwikidata (duration: 00m 45s) [production]
15:48 <hoo@tin> Synchronized wmf-config/Wikibase.php: Fix Wikibase site groups for testwiki and test2wiki (duration: 00m 40s) [production]
15:36 <hoo@tin> Synchronized wmf-config/Wikibase.php: Don't set removed Wikibase client settings (duration: 00m 40s) [production]
15:27 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Add tempdb2001 to config files - T162290 (duration: 00m 40s) [production]
15:26 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Add tempdb2001 to config files - T162290 (duration: 00m 39s) [production]
14:55 <hoo@tin> Synchronized wmf-config/InitialiseSettings.php: touch (duration: 00m 42s) [production]
14:51 <hoo> Restarted apache on mwdebug1001 in order to test a potential CACHE_ACCEL issue [production]
14:46 <hoo@tin> Synchronized wmf-config/: Don't use "enwiki" as Wikibase site id on testwiki and test2wiki (T94416) (duration: 01m 08s) [production]
14:12 <hoo@tin> Synchronized wmf-config/Wikibase.php: Add testwiki and test2wiki to "specialSiteLinkGroups" on testwikidata (T94416) (duration: 00m 40s) [production]
14:04 <elukey> reimage analytics1002 to Debian Jessie (Hadoop Master Node standby) [production]
13:44 <gehel> re-generating tiles for tasmania on maps codfw cluster [production]
13:42 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1079 - T160390 (duration: 00m 39s) [production]
13:39 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db1079 - T160390 (duration: 00m 43s) [production]
13:39 <marostegui> Deploy schema change db1079 (s7 wikis) - T160390 [production]
13:34 <hashar> European SWAT completed [production]
13:30 <marostegui> Deploy Deploy schema change dbstore1002 (s7 wikis) - T160390 [production]
13:20 <hashar@tin> Synchronized php-1.29.0-wmf.19/extensions/Popups: renderer: Pass event to behavior for processing - T162324 (duration: 00m 51s) [production]
12:51 <ema> upgrade cp3007 to linux 4.9 T162029 [production]
12:50 <moritzm> upgraded mw1261 to HHVM 3.18.2 with cherrypicked fix for stat_cache deadlock, now running with stat_cache enabled again [production]
12:39 <ema> rebooting cp2006 again to check for potential issues bringing up network ifaces / loading intel_uncore T162029 [production]
12:28 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Restore db1081 original weight - T161088 (duration: 00m 40s) [production]
12:28 <ema> cp2009 stuck rebooting, powercycled [production]
12:20 <ema> upgrade cp2009 to linux 4.9 T162029 [production]
12:16 <moritzm> uploaded HHVM 3.18.2 to jessie-wikimedia/experimental [production]
11:51 <ema> upgrade cp2006 to linux 4.9 T162029 [production]
11:27 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increae db1081 weight - T161088 (duration: 00m 40s) [production]
10:59 <_joe_> running some tests for the switchdc automation [production]
09:33 <moritzm> installing freetype security updates on trusty [production]
08:43 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increae db1081 weight - T161088 (duration: 00m 39s) [production]
08:41 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: dc=codfw,cluster=wdqs [production]
08:40 <moritzm> installing glibc updates on trusty [production]
08:37 <gehel> shutting down wdqs codfw for data reimport - T162111 [production]
08:34 <hashar> starting Jenkins on contint1001 [production]
08:27 <moritzm> rebooting contint1001 to Linux 4.9 [production]
08:02 <elukey> restart hhvm on mw1194 - dump debug in /tmp/hhvm.1692.bt. - threads stuck in HPHP::Treadmill::getAgeOldestRequest [production]
07:56 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increae db1081 weight - T161088 (duration: 00m 39s) [production]
07:32 <ema> cache_upload: ban all objects with content-type ~ "^text" T162035 [production]
07:16 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1081 with low weight - T161088 (duration: 00m 48s) [production]
06:29 <elukey> restart hhvm on mw1165 (jobrunner) - dump debug in /tmp/hhvm.19449.bt. - threads stuck in HPHP::Treadmill::getAgeOldestRequest [production]
06:09 <marostegui> Deploy schema change db2029 (s7 codfw master) - T160390 [production]
06:02 <marostegui> Configure and start replication on db1081 after the defragment - T161088 [production]
05:58 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2047 - T160390 (duration: 00m 40s) [production]
05:41 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1070 after compression - T153743 (duration: 00m 51s) [production]
04:06 <twentyafterfour> restarting apache2 on iridium to apply a minor hotfix [production]
03:06 <l10nupdate@tin> ResourceLoader cache refresh completed at Thu Apr 6 03:06:35 UTC 2017 (duration 5m 59s) [production]
03:00 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.19) (duration: 15m 46s) [production]
02:25 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.18) (duration: 10m 28s) [production]
01:45 <mutante> restarting gerrit to pick up config change gerrit:346180 (disable MD5) [production]
00:39 <mutante> install1002/2002: deleting /srv/autoinstall/precise.cfg [production]
00:37 <mutante> install1002/2002: deleteing /srv/tftboot/precise-installer | puppetmaster1002/2001: deleting /var/lib/puppet/volatile/tftpboot/precise-installer (clean up after gerrit:345549) [production]