1151-1200 of 10000 results (41ms)
2018-04-26 §
06:19 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: dc=codfw,cluster=elasticsearch [production]
05:18 <marostegui> Deploy schema change on dbstore1002:s2 - T191519 T188299 T190148 [production]
04:39 <ebernhardson> unfreeze writes to elasticsearch codfw cluster [production]
03:54 <_joe_> stopping redis replication from eqiad to codfw for the jobqueue cluster, we have an issue ongoing with CirrusSearch jobs and replication is broken [production]
03:41 <ejegg> re-enabled ingenico recurring charge job [production]
02:05 <mutante> mw2163 through mw2166: since the wmf-auto-reimage failed after OS but before puppet run due to "Failed to puppet_generate_certs" i manually logged in with install-console and signed puppet certs (T174431) [production]
2018-04-25 §
22:55 <samwilson@tin> Synchronized wmf-config/InitialiseSettings.php: Undeploy GlobalPreferences T184121 (duration: 01m 16s) [production]
22:21 <samwilson@tin> Synchronized wmf-config/InitialiseSettings.php: Deploy GlobalPreferences T189806 (duration: 01m 18s) [production]
21:03 <demon@tin> rebuilt and synchronized wikiversions files: group1 to wmf.1 [production]
21:01 <demon@tin> Synchronized php: symlink bump (duration: 01m 16s) [production]
20:58 <hasharAway> on tin: rebased php-1.31.0-wmf.30 for https://gerrit.wikimedia.org/r/#/c/429018/ [production]
20:21 <XioNoX> remove test VIP for eqiad ping offload server - T190090 [production]
20:18 <bsitzmann@tin> Finished deploy [mobileapps/deploy@5a4a282]: Config: Start up to 4 workers in parallel during start-up (duration: 06m 48s) [production]
20:11 <bsitzmann@tin> Started deploy [mobileapps/deploy@5a4a282]: Config: Start up to 4 workers in parallel during start-up [production]
19:39 <otto@tin> Finished deploy [eventlogging/eventbus@f0783bb]: Fix for logging error https://gerrit.wikimedia.org/r/#/c/428982/ (duration: 01m 45s) [production]
19:37 <otto@tin> Started deploy [eventlogging/eventbus@f0783bb]: Fix for logging error https://gerrit.wikimedia.org/r/#/c/428982/ [production]
19:12 <urandom> altering timeline tables for 6 month TTL -- T192689 [production]
19:11 <otto@tin> Finished deploy [eventlogging/eventbus@f0783bb]: Fix for logging error https://gerrit.wikimedia.org/r/#/c/428982/ (duration: 00m 11s) [production]
19:11 <otto@tin> Started deploy [eventlogging/eventbus@f0783bb]: Fix for logging error https://gerrit.wikimedia.org/r/#/c/428982/ [production]
19:09 <otto@tin> Started deploy [eventlogging/eventbus@f562c1b]: Fix for logging error https://gerrit.wikimedia.org/r/#/c/428982/ [production]
18:55 <imarlier@tin> Finished deploy [performance/coal@1e79c79]: deploy fix for coal-web (duration: 00m 06s) [production]
18:55 <imarlier@tin> Started deploy [performance/coal@1e79c79]: deploy fix for coal-web [production]
18:16 <ejegg> updated CiviCRM from 219798b2c5 to 47197006d5 [production]
17:35 <urandom> starting cleanups on row 'a' Cassandra nodes -- T189822 [production]
17:33 <mepps> update civicrm from 6ddeb167ec to 219798b2c5 [production]
17:20 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:428951|Change fawiki uca to the right one]] (duration: 01m 17s) [production]
17:11 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:427181|Enable RemexHtml on frwikiquote]] T192301 (duration: 01m 17s) [production]
17:00 <mutante> powercycling wdqs1004 [production]
16:09 <mutante> re-imaging mw2258, mw2163, mw2164 ff. [production]
15:28 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Pool db1122, db1090 with low load (duration: 01m 14s) [production]
15:22 <anomie> Running populateRevisionLength.php on group 0 for T192189 [production]
15:05 <ottomata> temp disabling puppet, applying ipv6 mapped on kafka200* [production]
15:04 <andrewbogott> adding labvirt1016 to the nova-compute scheduling pool [production]
14:37 <elukey> restart hive-server2 on analytics1003 to pick up settings in https://gerrit.wikimedia.org/r/428919 [production]
14:34 <akosiaris> reboot bohrium T150532 [production]
14:32 <ema> cp3030: upgrade varnish to 5.1.3-1wm7 T192368 [production]
14:12 <akosiaris@tin> Synchronized wmf-config/ProductionServices.php: depool poolcounter1002 T193025 (duration: 01m 16s) [production]
13:57 <akosiaris@tin> Synchronized wmf-config/ProductionServices.php: pool poolcounter1003 T187297 (duration: 01m 16s) [production]
13:53 <Amir1> EU SWAT is done! [production]
13:53 <ladsgroup@tin> Synchronized php-1.32.0-wmf.1/extensions/Wikibase/lib/includes/Changes: [[gerrit:428908|Make sure statements in EntityDiffChangedAspects are not passed around as stdClass (T192085)]] (duration: 01m 16s) [production]
13:49 <akosiaris@tin> Synchronized wmf-config/ProductionServices.php: repool poolcounter1001 T150532 (duration: 01m 16s) [production]
13:43 <ladsgroup@tin> Synchronized php-1.31.0-wmf.30/extensions/Wikibase/lib/includes/Changes: [[gerrit:428907|Make sure statements in EntityDiffChangedAspects are not passed around as stdClass (T192085)]] (duration: 01m 17s) [production]
13:40 <akosiaris> reboot poolcounter1001 for T150532 [production]
13:30 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:428630|Enable Mapframe for bgwiki (T192895)]] (duration: 01m 15s) [production]
13:23 <zfilipin@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:428878|New throttle rule for cswiki Wikipedia event (T192898)]] (duration: 01m 16s) [production]
13:19 <akosiaris@tin> Synchronized wmf-config/ProductionServices.php: depool poolcounter1001 T150532 (duration: 01m 17s) [production]
13:17 <zfilipin@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:428878|New throttle rule for cswiki Wikipedia event (T192898)]] (duration: 01m 16s) [production]
13:12 <ladsgroup@tin> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:428626|Remove xx-uca-fa for Persian Wikis except Wikipedia]] (duration: 01m 17s) [production]
13:06 <marostegui> Deploy schema change on s2 codfw master (db2035) - this will generate lag on codfw - T191519 T188299 T190148 [production]
12:55 <gehel> starting elasticsearch codfw rolling restart for plugin update and NUMA config - T191543 / T191236 [production]