251-300 of 10000 results (55ms)
2019-05-14 §
13:12 <hashar@deploy1001> Started scap: testwiki to 1.34.0-wmf.5 and rebuild l10n cache [production]
12:37 <jforrester@deploy1001> Synchronized php-1.34.0-wmf.4/extensions/VisualEditor/: Hot-deploy T223023 fix I1b35b28e42 for mobile VE edit section switches (duration: 00m 54s) [production]
12:10 <moritzm> rebooting mw2164 for kernel update [production]
11:33 <hashar@deploy1001> Pruned MediaWiki: 1.33.0-wmf.24 (duration: 03m 20s) [production]
11:29 <hashar> Deleting 1.33.0-wmf.24 from deploy1001 # T220730 [production]
11:28 <kart_> EU-Mid day SWAT Done. [production]
11:25 <kartik@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT [[gerrit:508818|Decrease idwiki MT thresold for publishing]] (T222782) (duration: 00m 51s) [production]
11:23 <hashar@deploy1001> clean aborted: Pruned MediaWiki: 1.33.0-wmf.23 (duration: 14m 31s) [production]
11:23 <jbond42> cumin1001 ~ % sudo cumin A:all '/usr/local/sbin/run-puppet-agent --failed-only [production]
11:18 <jbond42> enable puppet issue fixed https://gerrit.wikimedia.org/r/c/operations/puppet/+/510131 [production]
11:12 <ema> pool cp3036 reimaged to ATS T222937 [production]
11:09 <hashar> Deleting 1.33.0-wmf.23 from deploy1001 # T220730 [production]
11:09 <jbond42> disable puppet [production]
10:58 <hashar> scap prep 1.34.0-wmf.5 # T220730 [production]
10:16 <hashar> Cutting branches for 1.34.0-wmf.5 [production]
10:01 <ema> depool cp3036 and reimage as upload_ats T222937 [production]
09:55 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Remove db2034 from config T219493 (duration: 00m 49s) [production]
09:53 <marostegui@deploy1001> scap failed: average error rate on 4/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
09:51 <marostegui> Remove db2034 from tendril and zarcillo - T219493 [production]
09:51 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Remove db2034 from config T219493 (duration: 00m 50s) [production]
09:34 <jynus> restart apache on ununpentium [production]
09:29 <marostegui> Parsercache deployment window FINISHED [production]
09:27 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Deploy second parsercache key change everywhere after deploying it in batches first T210725 (duration: 00m 50s) [production]
09:15 <godog> statsd_exporter 0.9 upgrade on ores - T220709 [production]
09:02 <godog> statsd_exporter 0.9 upgrade on logstash - T220709 [production]
08:53 <jynus> failing connections over dbproxy1006 to dbproxy1001 [production]
07:48 <moritzm> installing bind security updates for stretch (only client-side tools/libraries in use) [production]
06:45 <ema> cp-ats: upgrade trafficserver to 8.0.3-1wm2 [production]
06:20 <ema> cp4021: upgrade trafficserver to 8.0.3-1wm2 [production]
06:15 <ema> upload trafficserver 8.0.3-1wm2 to stretch-wikimedia [production]
06:02 <marostegui> Deploy parsercache change to eqiad canaries - T210725 [production]
06:01 <marostegui> Lock wmf-config deployment on deploy1001 to slowly change parsercache key on eqiad - T210725 [production]
06:01 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Change parsercache on codfw T210725 (duration: 00m 54s) [production]
01:55 <mutante> re-scheduled nginx / HTTP availability icinga checks [production]
01:42 <mutante> cumin -b 6 'R:git::clone' 'run-puppet-agent -q --failed-only' [production]
01:36 <mutante> restarting Gerrit to apply 2 config changes - disable DNS reverse lookup (gerrit:508127) & list projects from index (gerrit:508892) - removes blockers for 2.16 upgrade (T200739) [production]
00:32 <mutante> restarting wikibugs because it left some channels [production]
2019-05-13 §
20:29 <ejegg> updated payments-wiki from 6e0172bac3 to 8397ccf9cc [production]
20:24 <halfak@deploy1001> Finished deploy [ores/deploy@c17a1a2]: T202202 (duration: 04m 16s) [production]
20:20 <halfak@deploy1001> Started deploy [ores/deploy@c17a1a2]: T202202 [production]
20:19 <ariel@deploy1001> Finished deploy [dumps/dumps@941d374]: lbzip2 decompression for 7z file production for big wikis (duration: 00m 03s) [production]
20:19 <ariel@deploy1001> Started deploy [dumps/dumps@941d374]: lbzip2 decompression for 7z file production for big wikis [production]
20:04 <halfak@deploy1001> Started deploy [ores/deploy@c17a1a2]: T202202 [production]
18:29 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: re-sync: re-enabling all eventgate-analytics monolog events - T222962 (duration: 00m 49s) [production]
18:28 <ejegg> updated SmashPig standalone deploy 22b6982 Try turning off WSDL caching for Adyen [production]
18:25 <reedy@deploy1001> Synchronized wmf-config/CommonSettings.php: T222954 (duration: 00m 49s) [production]
18:19 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: re-enabling all eventgate-analytics monolog events - T222962 (duration: 00m 50s) [production]
18:17 <ottomata> re-enabling all eventgate-analytics monolog events - T222962 [production]
18:12 <reedy@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T223006 T222740 T222044 (duration: 00m 49s) [production]
18:07 <otto@deploy1001> scap-helm eventgate-analytics finished [production]