501-550 of 10000 results (47ms)
2018-03-01 ยง
19:31 <gehel@tin> Finished deploy [wdqs/wdqs@86da751]: new updater to fix kafka poller issues (duration: 02m 12s) [production]
19:29 <gehel@tin> Started deploy [wdqs/wdqs@86da751]: new updater to fix kafka poller issues [production]
19:24 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:414115|Enable responsive references by default on rowiki]] T187997 (duration: 01m 15s) [production]
19:21 <mutante> scb1003 depooled scb1003 from all services on scb because it went down, including mgmt [production]
19:20 <dzahn@neodymium> conftool action : set/pooled=no; selector: name=scb1003.eqiad.wmnet [production]
19:17 <thcipriani@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:415630|Make last throttle limit raise work accross all wikis]] T188630 (duration: 01m 13s) [production]
19:15 <mutante> powercycling crashed scb1003 [production]
19:13 <thcipriani@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:415629|Fix throttle date for outreach dashboard]] T188630 (duration: 01m 13s) [production]
18:47 <demon@tin> Synchronized wmf-config/: killing extension-list-labs (duration: 01m 17s) [production]
18:45 <demon@tin> Synchronized wmf-config/InitialiseSettings.php: disable performance inspector in prod explicitly (duration: 01m 14s) [production]
18:43 <demon@tin> Synchronized docroot/noc/: killing extension-list-labs (duration: 01m 14s) [production]
18:13 <bsitzmann@tin> Finished deploy [mobileapps/deploy@ada38aa]: Update mobileapps to 0db4a60 (T183833) (duration: 06m 01s) [production]
18:07 <bsitzmann@tin> Started deploy [mobileapps/deploy@ada38aa]: Update mobileapps to 0db4a60 (T183833) [production]
17:51 <gehel> depooling wdqs2001 and switching to kafka poller - T188252 [production]
17:47 <gehel> restarting wdqs-updater on wdqs1004 -T188045 [production]
17:46 <mutante> re-enabling icinga notifications for wdqs1004 services, ethernet cable has been replaced (T188045) [production]
17:37 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully repool db1093 (duration: 01m 14s) [production]
17:24 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1093 (duration: 01m 28s) [production]
17:09 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1093 (duration: 01m 13s) [production]
16:53 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slowly repool db1093 (duration: 01m 13s) [production]
16:41 <jynus> reimporting database testreduce_0715 from db1009 to db2037 [production]
16:36 <marostegui> Restart mariadb on db1093 for binlog format change - T186321 [production]
16:35 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1093 - T186321 (duration: 01m 13s) [production]
16:14 <moritzm> rebooting hafnium for kernel security update [production]
16:06 <marostegui> Fix s7 replication on labsdb1010 - T186579 [production]
16:00 <moritzm> rebooting radium (tor relay) for kernel security update [production]
15:52 <moritzm> draining restbase1014 for eventual reboot for kernel security update [production]
15:43 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1060 as API (duration: 01m 13s) [production]
15:32 <bblack> disabling puppet on A:cp for deploy of https://gerrit.wikimedia.org/r/#/c/415204/ and friends [production]
15:30 <mobrovac@tin> Synchronized php-1.31.0-wmf.23/extensions/EventBus/includes/JobQueueEventBus.php: EventBus: Specify that EventBus queue supports delayed jobs (wmf/1.31.0-wmf.23) - T188540 (duration: 01m 14s) [production]
15:26 <mobrovac@tin> Synchronized php-1.31.0-wmf.22/extensions/EventBus/includes/JobQueueEventBus.php: EventBus: Specify that EventBus queue supports delayed jobs (wmf/1.31.0-wmf.22) - T188540 (duration: 01m 13s) [production]
15:25 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1074 after alter table (duration: 01m 13s) [production]
15:22 <moritzm> draining restbase1013 for eventual reboot for kernel security update [production]
15:19 <zeljkof> EU SWAT finished [production]
15:18 <zfilipin@tin> Synchronized php-1.31.0-wmf.22/extensions/Popups: SWAT: [[gerrit:415564|Fix: dont assume thumbnail URLs contain pixel size (T187955)]] (duration: 01m 14s) [production]
15:17 <moritzm> rolling restart of swift frontends in eqiad for kernel security update [production]
15:12 <godog> upload puppetdb 4.4.0-1~wmf1 to component/puppetdb4 - T177253 [production]
15:00 <ema> eqiad LVSs: reboot for retpoline kernel updates T188092 [production]
14:36 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:415522|Add Import sources on maiwikimedia (T188374)]] (duration: 01m 13s) [production]
14:28 <moritzm> rolling restart of swift frontends in codfw for kernel security update [production]
14:26 <moritzm> draining restbase1012 for eventual reboot for kernel security update [production]
14:25 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:414506|Enable Quiz Extension at zhwikibooks (T188213)]] (duration: 01m 14s) [production]
14:12 <mobrovac@tin> Synchronized wmf-config/jobqueue.php: JobQueue: Enable EventBus for cdnPurge for all but wikipedia, commons and wikidata, file 2/2 - T188540 (duration: 01m 13s) [production]
14:10 <mobrovac@tin> Synchronized wmf-config/InitialiseSettings.php: JobQueue: Enable EventBus for cdnPurge for all but wikipedia, commons and wikidata, file 1/2 - T188540 (duration: 01m 14s) [production]
14:02 <ppchelko@tin> Finished deploy [cpjobqueue/deploy@b5255f0]: Enable kafka queue for cdnPurge for all but wikipedia, commons and wikidata. T188540 (duration: 00m 44s) [production]
14:01 <ppchelko@tin> Started deploy [cpjobqueue/deploy@b5255f0]: Enable kafka queue for cdnPurge for all but wikipedia, commons and wikidata. T188540 [production]
13:54 <moritzm> draining restbase1011 for eventual reboot for kernel security update [production]
13:50 <ema> codfw LVSs: reboot for retpoline kernel updates T188092 [production]
13:33 <gehel> force merging enwiki_general index on codfw to reclaim space [production]
13:18 <moritzm> draining restbase1010 for eventual reboot for kernel security update [production]