7401-7450 of 10000 results (73ms)
2018-02-06 ยง
16:30 <gehel@tin> Started deploy [tilerator/deploy@29d633e]: new tilerator packaging [production]
16:29 <gehel@tin> Finished deploy [kartotherian/deploy@ecdda41]: new kartotherian packaging (duration: 02m 34s) [production]
16:29 <mutante> mw1262 started hhvm, it had Unhandled server exception: Class undefined: Psr\Log\LogLevel [production]
16:27 <gehel@tin> Started deploy [kartotherian/deploy@ecdda41]: new kartotherian packaging [production]
16:26 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=maps2001.codfw.wmnet [production]
16:24 <gehel@tin> Finished deploy [tilerator/deploy@29d633e]: new tilerator packaging (duration: 00m 34s) [production]
16:24 <gehel@tin> Started deploy [tilerator/deploy@29d633e]: new tilerator packaging [production]
16:17 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=maps2001.codfw.wmnet [production]
16:15 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=maps2001.codfw.wmnet [production]
16:14 <gehel@tin> Finished deploy [kartotherian/deploy@ecdda41]: new kartotherian packaging (duration: 00m 22s) [production]
16:14 <gehel@tin> Started deploy [kartotherian/deploy@ecdda41]: new kartotherian packaging [production]
16:11 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=maps2001.codfw.wmnet [production]
16:10 <gehel> upgrading kartotherian / tilerator on maps codfw [production]
15:36 <elukey> drain + shutdown of analytics1038 to replace faulty BBU - T185409 [production]
15:02 <zeljkof> EU SWAT finished [production]
15:01 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:406486|Allow eliminators to undelete at urwiki (T185829)]] (duration: 00m 55s) [production]
14:53 <marostegui> Poweroff db1051 for BBU replacement - T186049 [production]
14:50 <akosiaris> upgrade service-checker to 0.1.4 on scb1001 [production]
14:45 <zfilipin@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:408283|Typo, its 2018 not 2017 (T185794)]] (duration: 00m 55s) [production]
14:39 <zfilipin@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:408281|New throttle rule (T186530)]] (duration: 00m 55s) [production]
14:35 <chasemp> disable puppet on labs things for a cautious change rollout [production]
14:33 <anomie@tin> Synchronized wmf-config/InitialiseSettings.php: Setting wgCommentTableSchemaMigrationStage = MIGRATION_WRITE_BOTH on test wikis (duration: 00m 56s) [production]
14:28 <marostegui> Changing triggers on s2 - T174569 [production]
14:26 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:407702|Enable RemexHtml on fiwiki, hewiki, ruwiki, svwiki (T185945)]] (duration: 00m 55s) [production]
14:14 <mlitn@tin> Synchronized php-1.31.0-wmf.17/extensions/UploadWizard/resources/details/uw.DescriptionsDetailsWidget.js: T184380 (duration: 00m 55s) [production]
14:10 <ladsgroup@tin> Synchronized wmf-config/Wikibase.php: [[gerrit:408528|Add entityUsageModifierLimits config for Wikibase (T185693)]] (duration: 00m 55s) [production]
14:07 <urandom> re-enable smartpath on restbase1010 (revert experiment) - T178177 [production]
13:35 <gehel> upgrading prometheus-elasticsearch-exporter across all elasticsearch nodes [production]
12:32 <marostegui> Power cycled dbstore1001 after it crashed - T186596 [production]
11:54 <marostegui> Sanitize s4 - T174569 [production]
11:11 <_joe_> forcing a resync of /dev/md1 on conf2001 to verify if the higher timeouts avoid consensus loss in etcd [production]
11:02 <ema> restart pybal on codfw primary LVSs to make them reconnect to etcd [production]
11:01 <ema> restart pybal on codfw secondary LVSs to make them reconnect to etcd [production]
10:57 <ema> restart pybal on eqiad primary LVSs to make them reconnect to etcd [production]
10:55 <ema> restart eqiad secondary LVSs to make them reconnect to etcd [production]
10:47 <_joe_> rolling restart of the eqiad etcd cluster [production]
10:39 <_joe_> rolling restart of the codfw cluster to pick up the config changes [production]
09:38 <marostegui> Sanitizing s2 - T174569 [production]
08:41 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully repool db1077 (duration: 00m 55s) [production]
08:21 <elukey> rollback apache/httpd changes on phab1001 (restart required) [production]
08:07 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1077 weight (duration: 00m 55s) [production]
07:43 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1077 weight (duration: 00m 55s) [production]
07:28 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1077 with low weight (duration: 00m 53s) [production]
07:06 <marostegui> Stop MySQL on db1077 for a full upgrade [production]
07:01 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1077 for MariaDB and kernel upgrade (duration: 00m 56s) [production]
06:49 <marostegui> Fix replication on labsdb1010 - T186579 [production]
03:32 <demon@tin> Finished deploy [gerrit/gerrit@f25f017]: adding gitiles plugin (duration: 00m 10s) [production]
03:32 <demon@tin> Started deploy [gerrit/gerrit@f25f017]: adding gitiles plugin [production]
03:17 <foks> reset email for User:Andrewman327 [production]
02:32 <demon@tin> Synchronized tests/Defines.php: no op (duration: 00m 55s) [production]