401-450 of 10000 results (56ms)
2018-09-12 ยง
17:59 <otto@deploy1001> Finished deploy [analytics/refinery@407da92]: Deploying refinery-source 0.0.74 jars for T203804 (duration: 06m 11s) [production]
17:58 <marxarelli> deleting now idle node integration-slave-docker-1001 [releng]
17:53 <otto@deploy1001> Started deploy [analytics/refinery@407da92]: Deploying refinery-source 0.0.74 jars for T203804 [production]
17:52 <marxarelli> removing integration-slave-docker-1001 jenkins node for replacement with a xlarge instance [releng]
17:52 <otto@deploy1001> Finished deploy [analytics/refinery@407da92]: Deploying refinery-source 0.0.74 jars for T203804 (duration: 01m 41s) [production]
17:50 <otto@deploy1001> Started deploy [analytics/refinery@407da92]: Deploying refinery-source 0.0.74 jars for T203804 [production]
17:40 <marxarelli> adding Jenkins node integration-slave-docker-1030 [releng]
17:38 <akosiaris> restart icinga T196336 [production]
17:36 <twentyafterfour> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/#/c/integration/config/+/460067/ [releng]
17:34 <ottomata> deploying new version of refinery-source, and then refinery for properties based RefineMonitor job - https://phabricator.wikimedia.org/T203804 [analytics]
16:53 <ottomata> restarting eventlogging processors to pick up change to mysql whitelist [production]
16:52 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Decrease weight for db2065 (duration: 00m 49s) [production]
16:48 <filippo@puppetmaster1001> conftool action : set/pooled=no; selector: name=wtp2020.codfw.wmnet [production]
16:39 <ebernhardson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: cirrussearch: eqiad -> local (codfw) (duration: 00m 50s) [production]
16:32 <jynus@deploy1001> Synchronized wmf-config/db-codfw.php: Reduce db2065, db2061 weights (duration: 00m 48s) [production]
16:16 <arturo> force-rebooted again bastion-restricted-01 due to some additional tests with DHCP [bastion]
16:14 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Decrease weight for db2049 (duration: 00m 49s) [production]
16:06 <jynus@deploy1001> Synchronized wmf-config/db-codfw.php: Reduce db2056 weight (duration: 00m 49s) [production]
15:56 <akosiaris> switch s*-master DNS records to codfw [production]
15:51 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Decrease weight for db2049 (duration: 00m 50s) [production]
15:49 <marxarelli> provisioning new xlarge integration-slave-docker-1030 [releng]
15:47 <marxarelli> cherry-pick https://gerrit.wikimedia.org/r/c/operations/puppet/+/459875 on integration-puppetmaster01 for testing [releng]
15:38 <krinkle@deploy1001> Synchronized wmf-config/CommonSettings.php: 43b98e414 (duration: 00m 50s) [production]
15:32 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Decrease weight for db2070 (duration: 00m 49s) [production]
15:24 <END> (PASS) - Cookbook sre.switchdc.mediawiki.08-restart-parsoid (exit_code=0) (volans@sarin) [production]
15:22 <oblivian@sarin> conftool action : set/weight=15; selector: dc=codfw,cluster=api_appserver,service=apache2,name=mw21.* [production]
15:19 <oblivian@sarin> conftool action : set/weight=20; selector: dc=codfw,cluster=api_appserver,service=apache2,name=mw22[2-9].* [production]
15:17 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Tweak weights in s1 and s2 (duration: 00m 50s) [production]
15:15 <_joe_> repool mw2141 [production]
15:14 <_joe_> depooling mw2141 for investigation [production]
15:08 <START> - Cookbook sre.switchdc.mediawiki.08-restart-parsoid (volans@sarin) [production]
15:05 <END> (PASS) - Cookbook sre.switchdc.mediawiki.08-restore-ttl (exit_code=0) (volans@sarin) [production]
15:05 <START> - Cookbook sre.switchdc.mediawiki.08-restore-ttl (volans@sarin) [production]
15:05 <END> (PASS) - Cookbook sre.switchdc.mediawiki.08-start-maintenance (exit_code=0) (volans@sarin) [production]
15:03 <START> - Cookbook sre.switchdc.mediawiki.08-start-maintenance (volans@sarin) [production]
14:59 <END> (PASS) - Cookbook sre.switchdc.mediawiki.08-update-tendril (exit_code=0) (volans@sarin) [production]
14:58 <START> - Cookbook sre.switchdc.mediawiki.08-update-tendril (volans@sarin) [production]
14:52 <END> (PASS) - Cookbook sre.switchdc.mediawiki.07-set-readwrite (exit_code=0) (volans@sarin) [production]
14:51 <MediaWiki> read-only period ends at: 2018-09-12 14:51:58.936291 (volans@sarin) [production]
14:51 <START> - Cookbook sre.switchdc.mediawiki.07-set-readwrite (volans@sarin) [production]
14:51 <END> (PASS) - Cookbook sre.switchdc.mediawiki.06-set-db-readwrite (exit_code=0) (volans@sarin) [production]
14:51 <START> - Cookbook sre.switchdc.mediawiki.06-set-db-readwrite (volans@sarin) [production]
14:50 <END> (PASS) - Cookbook sre.switchdc.mediawiki.05-invert-redis-sessions (exit_code=0) (volans@sarin) [production]
14:50 <START> - Cookbook sre.switchdc.mediawiki.05-invert-redis-sessions (volans@sarin) [production]
14:50 <END> (PASS) - Cookbook sre.switchdc.mediawiki.04-switch-traffic (exit_code=0) (volans@sarin) [production]
14:48 <START> - Cookbook sre.switchdc.mediawiki.04-switch-traffic (volans@sarin) [production]
14:47 <END> (PASS) - Cookbook sre.switchdc.mediawiki.04-switch-mediawiki (exit_code=0) (volans@sarin) [production]
14:47 <START> - Cookbook sre.switchdc.mediawiki.04-switch-mediawiki (volans@sarin) [production]
14:47 <END> (PASS) - Cookbook sre.switchdc.mediawiki.03-set-db-readonly (exit_code=0) (volans@sarin) [production]
14:46 <START> - Cookbook sre.switchdc.mediawiki.03-set-db-readonly (volans@sarin) [production]