3151-3200 of 10000 results (60ms)
2019-05-14 §
10:58 <hashar> scap prep 1.34.0-wmf.5 # T220730 [production]
10:16 <hashar> Cutting branches for 1.34.0-wmf.5 [production]
10:01 <ema> depool cp3036 and reimage as upload_ats T222937 [production]
09:55 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Remove db2034 from config T219493 (duration: 00m 49s) [production]
09:53 <marostegui@deploy1001> scap failed: average error rate on 4/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
09:51 <marostegui> Remove db2034 from tendril and zarcillo - T219493 [production]
09:51 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Remove db2034 from config T219493 (duration: 00m 50s) [production]
09:34 <jynus> restart apache on ununpentium [production]
09:29 <marostegui> Parsercache deployment window FINISHED [production]
09:27 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Deploy second parsercache key change everywhere after deploying it in batches first T210725 (duration: 00m 50s) [production]
09:15 <godog> statsd_exporter 0.9 upgrade on ores - T220709 [production]
09:02 <godog> statsd_exporter 0.9 upgrade on logstash - T220709 [production]
08:53 <jynus> failing connections over dbproxy1006 to dbproxy1001 [production]
07:48 <moritzm> installing bind security updates for stretch (only client-side tools/libraries in use) [production]
06:45 <ema> cp-ats: upgrade trafficserver to 8.0.3-1wm2 [production]
06:20 <ema> cp4021: upgrade trafficserver to 8.0.3-1wm2 [production]
06:15 <ema> upload trafficserver 8.0.3-1wm2 to stretch-wikimedia [production]
06:02 <marostegui> Deploy parsercache change to eqiad canaries - T210725 [production]
06:01 <marostegui> Lock wmf-config deployment on deploy1001 to slowly change parsercache key on eqiad - T210725 [production]
06:01 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Change parsercache on codfw T210725 (duration: 00m 54s) [production]
01:55 <mutante> re-scheduled nginx / HTTP availability icinga checks [production]
01:42 <mutante> cumin -b 6 'R:git::clone' 'run-puppet-agent -q --failed-only' [production]
01:36 <mutante> restarting Gerrit to apply 2 config changes - disable DNS reverse lookup (gerrit:508127) & list projects from index (gerrit:508892) - removes blockers for 2.16 upgrade (T200739) [production]
00:32 <mutante> restarting wikibugs because it left some channels [production]
2019-05-13 §
20:29 <ejegg> updated payments-wiki from 6e0172bac3 to 8397ccf9cc [production]
20:24 <halfak@deploy1001> Finished deploy [ores/deploy@c17a1a2]: T202202 (duration: 04m 16s) [production]
20:20 <halfak@deploy1001> Started deploy [ores/deploy@c17a1a2]: T202202 [production]
20:19 <ariel@deploy1001> Finished deploy [dumps/dumps@941d374]: lbzip2 decompression for 7z file production for big wikis (duration: 00m 03s) [production]
20:19 <ariel@deploy1001> Started deploy [dumps/dumps@941d374]: lbzip2 decompression for 7z file production for big wikis [production]
20:04 <halfak@deploy1001> Started deploy [ores/deploy@c17a1a2]: T202202 [production]
18:29 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: re-sync: re-enabling all eventgate-analytics monolog events - T222962 (duration: 00m 49s) [production]
18:28 <ejegg> updated SmashPig standalone deploy 22b6982 Try turning off WSDL caching for Adyen [production]
18:25 <reedy@deploy1001> Synchronized wmf-config/CommonSettings.php: T222954 (duration: 00m 49s) [production]
18:19 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: re-enabling all eventgate-analytics monolog events - T222962 (duration: 00m 50s) [production]
18:17 <ottomata> re-enabling all eventgate-analytics monolog events - T222962 [production]
18:12 <reedy@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T223006 T222740 T222044 (duration: 00m 49s) [production]
18:07 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
18:07 <otto@deploy1001> scap-helm eventgate-analytics cluster eqiad completed [production]
18:07 <otto@deploy1001> scap-helm eventgate-analytics upgrade analytics -f analytics/eqiad-values.yaml --reset-values stable/eventgate [namespace: eventgate-analytics, clusters: eqiad] [production]
18:05 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
18:05 <otto@deploy1001> scap-helm eventgate-analytics cluster codfw completed [production]
18:04 <otto@deploy1001> scap-helm eventgate-analytics upgrade analytics -f analytics/codfw-values.yaml --reset-values stable/eventgate [namespace: eventgate-analytics, clusters: codfw] [production]
18:03 <fsero> deleting eventgate-analytics-production releases on codfw [production]
18:01 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
18:01 <otto@deploy1001> scap-helm eventgate-analytics cluster staging completed [production]
18:01 <otto@deploy1001> scap-helm eventgate-analytics install -n analytics -f analytics/staging-values.yaml stable/eventgate [namespace: eventgate-analytics, clusters: staging] [production]
17:57 <fsero> deleting eventgate-analytics and eventgate-analytics-staging releases on staging [production]
17:41 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: retry - disabling all eventgate-analytics monolog events for eventgate chart migration - T222962 (duration: 00m 50s) [production]
17:11 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: disabling all eventgate-analytics monolog events for eventgate chart migration - T222962 (duration: 00m 50s) [production]
17:09 <ottomata> disabling all eventgate-analytics monolog events for eventgate chart migration - T222962 [production]