1701-1750 of 10000 results (48ms)
2018-04-03 §
18:03 <mutante> elnath - fixing and re-enabling Icinga alert about screens, none are running, spare hosts should not have these [production]
17:59 <mutante> restarting ferm on bromine [production]
17:40 <elukey> manually set net.ipv4.tcp_tw_reuse=1 on restbase1007 as test for T190213 [production]
17:35 <sbisson@tin> Finished deploy [tilerator/deploy@8e68cb8]: Deploying tilerator i18n to maps-test* (take 2) (duration: 00m 25s) [production]
17:35 <sbisson@tin> Started deploy [tilerator/deploy@8e68cb8]: Deploying tilerator i18n to maps-test* (take 2) [production]
17:28 <awight@tin> Finished deploy [ores/deploy@7701cee]: ORES versioned virtualenv, T181071 (duration: 01m 27s) [production]
17:28 <sbisson@tin> Finished deploy [tilerator/deploy@03add2d]: Deploying tilerator i18n to maps-test* (duration: 04m 09s) [production]
17:27 <awight@tin> Started deploy [ores/deploy@7701cee]: ORES versioned virtualenv, T181071 [production]
17:25 <awight@tin> Finished deploy [ores/deploy@7701cee]: ORES versioned virtualenv, T181071 (duration: 00m 27s) [production]
17:25 <awight@tin> Started deploy [ores/deploy@7701cee]: ORES versioned virtualenv, T181071 [production]
17:24 <sbisson@tin> Started deploy [tilerator/deploy@03add2d]: Deploying tilerator i18n to maps-test* [production]
17:24 <moritzm> upgrading HHVM on labweb* [production]
17:18 <jynus> reloading labsdb proxy configuration [production]
17:08 <elukey> manually set net.ipv4.tcp_tw_reuse=1 on restbase2001 as test for T190213 [production]
16:53 <demon@tin> Finished deploy [gerrit/gerrit@aa1a1a0]: no-op, pushing empty motd.config file (duration: 00m 11s) [production]
16:53 <demon@tin> Started deploy [gerrit/gerrit@aa1a1a0]: no-op, pushing empty motd.config file [production]
16:33 <urandom> rebooting restbase-dev1006 - T186751 [production]
16:10 <urandom> rebooting restbase-dev1004 - T186751 [production]
16:04 <ariel@tin> Finished deploy [dumps/dumps@77dc467]: split up some large modules, prep work for prefetch changes (duration: 00m 04s) [production]
16:04 <ariel@tin> Started deploy [dumps/dumps@77dc467]: split up some large modules, prep work for prefetch changes [production]
15:39 <elukey> roll restart of zookeeper on conf100[123] to pick up prometheus monitoring [production]
15:09 <godog> depool ms-fe2005 to test rewrite.py - T183902 [production]
14:40 <mobrovac@tin> Synchronized wmf-config/InitialiseSettings.php: Switch the remaining high-traffic jobs for all wikis, file 2/2 - T190327 (duration: 00m 59s) [production]
14:39 <ppchelko@tin> Finished deploy [cpjobqueue/deploy@60a2292]: Switch all high traffic jobs to kafka T190327 (duration: 00m 44s) [production]
14:39 <mobrovac@tin> Synchronized wmf-config/jobqueue.php: Switch the remaining high-traffic jobs for all wikis, file 1/2 - T190327 (duration: 00m 59s) [production]
14:38 <ppchelko@tin> Started deploy [cpjobqueue/deploy@60a2292]: Switch all high traffic jobs to kafka T190327 [production]
13:48 <anomie@tin> Synchronized php-1.31.0-wmf.27/extensions/intersection/DynamicPageList.hooks.php: Backporting fix for T191116 ([[gerrit:423689]]) (duration: 00m 58s) [production]
13:47 <anomie@tin> Synchronized php-1.31.0-wmf.27/includes/specials/SpecialWhatlinkshere.php: Backporting fix for T191116 ([[gerrit:423688]]) (duration: 00m 58s) [production]
13:41 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Restore original weight for db1077 after alter table (duration: 00m 58s) [production]
13:21 <marostegui> Reimport  s51541_sulwatcher.logging from master to slave - T191020 [production]
13:18 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1077 after alter table (duration: 00m 58s) [production]
13:18 <elukey> roll restart of zookeeper on conf200[123] to pick up prometheus monitoring settings [production]
12:57 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1077 after alter table (duration: 00m 59s) [production]
11:19 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slowly repool db1077 after alter table (duration: 00m 58s) [production]
11:16 <godog> deploy thumbor 1.16 in codfw [production]
11:06 <moritzm> installing libdatetime-timezone-perl update from Debian SUA [production]
09:51 <godog> deploy thumbor 1.16 in codfw and eqiad - T186528 T179200 T189647 T191028 [production]
08:46 <marostegui> Deploy schema change on db1077 - s3 - T187089 T185128 T153182 [production]
08:41 <moritzm> upgrading HHVM on video scalers [production]
08:40 <volans> temporarily disabled puppet (and re-enabling it one-by-one) on all prod puppetmasters to deploy g/422907 - T190918 [production]
08:36 <marostegui> Stop MySQL on db1077 for mysql and kernel upgrade [production]
08:35 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1077 for alter table (duration: 00m 59s) [production]
08:29 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Restore original weight for db1078 (duration: 00m 58s) [production]
08:29 <godog> codfw-prod: more weight to ms-be204[0-3] - T189633 [production]
08:14 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase weight for db1078 (duration: 00m 58s) [production]
08:01 <elukey> restart of druid-(overlord|middlemanager) on druid1004[456] as precautionary measure after zk restart [production]
08:01 <moritzm> uploaded HHVM 3.18.5-dfsg-1+wmf5+deb9u1 for stretch-security to apt.wikimedia.org [production]
08:00 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase weight for db1078 (duration: 00m 58s) [production]
07:50 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase weight for db1078 (duration: 00m 58s) [production]
07:50 <elukey> roll restart zookeeper on druid100[456] to enable prometheus monitoring [production]