4801-4850 of 10000 results (57ms)
2018-04-26 §
08:32 <moritzm> re-attempt reimage of mw1246 (failed yesterday with an error on the puppetmaster, testing whether this can be reproduced) [production]
08:24 <jynus> stop and upgrade db1109 [production]
07:58 <marostegui> Deploy schema change on db1090 - T191519 T188299 T190148 [production]
07:45 <jynus> stopping db1090 mariadb instance to move its path, port and socket [production]
07:21 <gehel> restarting redis masters in codfw - T193112 [production]
07:20 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1090, pool db1122 with full weight (duration: 01m 23s) [production]
07:16 <gehel> re-enabling puppet on rdb2* - T193112 [production]
06:19 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: dc=codfw,cluster=elasticsearch [production]
05:18 <marostegui> Deploy schema change on dbstore1002:s2 - T191519 T188299 T190148 [production]
04:39 <ebernhardson> unfreeze writes to elasticsearch codfw cluster [production]
03:54 <_joe_> stopping redis replication from eqiad to codfw for the jobqueue cluster, we have an issue ongoing with CirrusSearch jobs and replication is broken [production]
03:41 <ejegg> re-enabled ingenico recurring charge job [production]
02:05 <mutante> mw2163 through mw2166: since the wmf-auto-reimage failed after OS but before puppet run due to "Failed to puppet_generate_certs" i manually logged in with install-console and signed puppet certs (T174431) [production]
2018-04-25 §
22:55 <samwilson@tin> Synchronized wmf-config/InitialiseSettings.php: Undeploy GlobalPreferences T184121 (duration: 01m 16s) [production]
22:21 <samwilson@tin> Synchronized wmf-config/InitialiseSettings.php: Deploy GlobalPreferences T189806 (duration: 01m 18s) [production]
21:03 <demon@tin> rebuilt and synchronized wikiversions files: group1 to wmf.1 [production]
21:01 <demon@tin> Synchronized php: symlink bump (duration: 01m 16s) [production]
20:58 <hasharAway> on tin: rebased php-1.31.0-wmf.30 for https://gerrit.wikimedia.org/r/#/c/429018/ [production]
20:21 <XioNoX> remove test VIP for eqiad ping offload server - T190090 [production]
20:18 <bsitzmann@tin> Finished deploy [mobileapps/deploy@5a4a282]: Config: Start up to 4 workers in parallel during start-up (duration: 06m 48s) [production]
20:11 <bsitzmann@tin> Started deploy [mobileapps/deploy@5a4a282]: Config: Start up to 4 workers in parallel during start-up [production]
19:39 <otto@tin> Finished deploy [eventlogging/eventbus@f0783bb]: Fix for logging error https://gerrit.wikimedia.org/r/#/c/428982/ (duration: 01m 45s) [production]
19:37 <otto@tin> Started deploy [eventlogging/eventbus@f0783bb]: Fix for logging error https://gerrit.wikimedia.org/r/#/c/428982/ [production]
19:12 <urandom> altering timeline tables for 6 month TTL -- T192689 [production]
19:11 <otto@tin> Finished deploy [eventlogging/eventbus@f0783bb]: Fix for logging error https://gerrit.wikimedia.org/r/#/c/428982/ (duration: 00m 11s) [production]
19:11 <otto@tin> Started deploy [eventlogging/eventbus@f0783bb]: Fix for logging error https://gerrit.wikimedia.org/r/#/c/428982/ [production]
19:09 <otto@tin> Started deploy [eventlogging/eventbus@f562c1b]: Fix for logging error https://gerrit.wikimedia.org/r/#/c/428982/ [production]
18:55 <imarlier@tin> Finished deploy [performance/coal@1e79c79]: deploy fix for coal-web (duration: 00m 06s) [production]
18:55 <imarlier@tin> Started deploy [performance/coal@1e79c79]: deploy fix for coal-web [production]
18:16 <ejegg> updated CiviCRM from 219798b2c5 to 47197006d5 [production]
17:35 <urandom> starting cleanups on row 'a' Cassandra nodes -- T189822 [production]
17:33 <mepps> update civicrm from 6ddeb167ec to 219798b2c5 [production]
17:20 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:428951|Change fawiki uca to the right one]] (duration: 01m 17s) [production]
17:11 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:427181|Enable RemexHtml on frwikiquote]] T192301 (duration: 01m 17s) [production]
17:00 <mutante> powercycling wdqs1004 [production]
16:09 <mutante> re-imaging mw2258, mw2163, mw2164 ff. [production]
15:28 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Pool db1122, db1090 with low load (duration: 01m 14s) [production]
15:22 <anomie> Running populateRevisionLength.php on group 0 for T192189 [production]
15:05 <ottomata> temp disabling puppet, applying ipv6 mapped on kafka200* [production]
15:04 <andrewbogott> adding labvirt1016 to the nova-compute scheduling pool [production]
14:37 <elukey> restart hive-server2 on analytics1003 to pick up settings in https://gerrit.wikimedia.org/r/428919 [production]
14:34 <akosiaris> reboot bohrium T150532 [production]
14:32 <ema> cp3030: upgrade varnish to 5.1.3-1wm7 T192368 [production]
14:12 <akosiaris@tin> Synchronized wmf-config/ProductionServices.php: depool poolcounter1002 T193025 (duration: 01m 16s) [production]
13:57 <akosiaris@tin> Synchronized wmf-config/ProductionServices.php: pool poolcounter1003 T187297 (duration: 01m 16s) [production]
13:53 <Amir1> EU SWAT is done! [production]
13:53 <ladsgroup@tin> Synchronized php-1.32.0-wmf.1/extensions/Wikibase/lib/includes/Changes: [[gerrit:428908|Make sure statements in EntityDiffChangedAspects are not passed around as stdClass (T192085)]] (duration: 01m 16s) [production]
13:49 <akosiaris@tin> Synchronized wmf-config/ProductionServices.php: repool poolcounter1001 T150532 (duration: 01m 16s) [production]
13:43 <ladsgroup@tin> Synchronized php-1.31.0-wmf.30/extensions/Wikibase/lib/includes/Changes: [[gerrit:428907|Make sure statements in EntityDiffChangedAspects are not passed around as stdClass (T192085)]] (duration: 01m 17s) [production]
13:40 <akosiaris> reboot poolcounter1001 for T150532 [production]