2019-05-14
§
|
09:27 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Deploy second parsercache key change everywhere after deploying it in batches first T210725 (duration: 00m 50s) |
[production] |
09:15 |
<godog> |
statsd_exporter 0.9 upgrade on ores - T220709 |
[production] |
09:02 |
<godog> |
statsd_exporter 0.9 upgrade on logstash - T220709 |
[production] |
08:53 |
<jynus> |
failing connections over dbproxy1006 to dbproxy1001 |
[production] |
07:48 |
<moritzm> |
installing bind security updates for stretch (only client-side tools/libraries in use) |
[production] |
06:45 |
<ema> |
cp-ats: upgrade trafficserver to 8.0.3-1wm2 |
[production] |
06:20 |
<ema> |
cp4021: upgrade trafficserver to 8.0.3-1wm2 |
[production] |
06:15 |
<ema> |
upload trafficserver 8.0.3-1wm2 to stretch-wikimedia |
[production] |
06:02 |
<marostegui> |
Deploy parsercache change to eqiad canaries - T210725 |
[production] |
06:01 |
<marostegui> |
Lock wmf-config deployment on deploy1001 to slowly change parsercache key on eqiad - T210725 |
[production] |
06:01 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Change parsercache on codfw T210725 (duration: 00m 54s) |
[production] |
01:55 |
<mutante> |
re-scheduled nginx / HTTP availability icinga checks |
[production] |
01:42 |
<mutante> |
cumin -b 6 'R:git::clone' 'run-puppet-agent -q --failed-only' |
[production] |
01:36 |
<mutante> |
restarting Gerrit to apply 2 config changes - disable DNS reverse lookup (gerrit:508127) & list projects from index (gerrit:508892) - removes blockers for 2.16 upgrade (T200739) |
[production] |
00:32 |
<mutante> |
restarting wikibugs because it left some channels |
[production] |
2019-05-13
§
|
20:29 |
<ejegg> |
updated payments-wiki from 6e0172bac3 to 8397ccf9cc |
[production] |
20:24 |
<halfak@deploy1001> |
Finished deploy [ores/deploy@c17a1a2]: T202202 (duration: 04m 16s) |
[production] |
20:20 |
<halfak@deploy1001> |
Started deploy [ores/deploy@c17a1a2]: T202202 |
[production] |
20:19 |
<ariel@deploy1001> |
Finished deploy [dumps/dumps@941d374]: lbzip2 decompression for 7z file production for big wikis (duration: 00m 03s) |
[production] |
20:19 |
<ariel@deploy1001> |
Started deploy [dumps/dumps@941d374]: lbzip2 decompression for 7z file production for big wikis |
[production] |
20:04 |
<halfak@deploy1001> |
Started deploy [ores/deploy@c17a1a2]: T202202 |
[production] |
18:29 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: re-sync: re-enabling all eventgate-analytics monolog events - T222962 (duration: 00m 49s) |
[production] |
18:28 |
<ejegg> |
updated SmashPig standalone deploy 22b6982 Try turning off WSDL caching for Adyen |
[production] |
18:25 |
<reedy@deploy1001> |
Synchronized wmf-config/CommonSettings.php: T222954 (duration: 00m 49s) |
[production] |
18:19 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: re-enabling all eventgate-analytics monolog events - T222962 (duration: 00m 50s) |
[production] |
18:17 |
<ottomata> |
re-enabling all eventgate-analytics monolog events - T222962 |
[production] |
18:12 |
<reedy@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T223006 T222740 T222044 (duration: 00m 49s) |
[production] |
18:07 |
<otto@deploy1001> |
scap-helm eventgate-analytics finished |
[production] |
18:07 |
<otto@deploy1001> |
scap-helm eventgate-analytics cluster eqiad completed |
[production] |
18:07 |
<otto@deploy1001> |
scap-helm eventgate-analytics upgrade analytics -f analytics/eqiad-values.yaml --reset-values stable/eventgate [namespace: eventgate-analytics, clusters: eqiad] |
[production] |
18:05 |
<otto@deploy1001> |
scap-helm eventgate-analytics finished |
[production] |
18:05 |
<otto@deploy1001> |
scap-helm eventgate-analytics cluster codfw completed |
[production] |
18:04 |
<otto@deploy1001> |
scap-helm eventgate-analytics upgrade analytics -f analytics/codfw-values.yaml --reset-values stable/eventgate [namespace: eventgate-analytics, clusters: codfw] |
[production] |
18:03 |
<fsero> |
deleting eventgate-analytics-production releases on codfw |
[production] |
18:01 |
<otto@deploy1001> |
scap-helm eventgate-analytics finished |
[production] |
18:01 |
<otto@deploy1001> |
scap-helm eventgate-analytics cluster staging completed |
[production] |
18:01 |
<otto@deploy1001> |
scap-helm eventgate-analytics install -n analytics -f analytics/staging-values.yaml stable/eventgate [namespace: eventgate-analytics, clusters: staging] |
[production] |
17:57 |
<fsero> |
deleting eventgate-analytics and eventgate-analytics-staging releases on staging |
[production] |
17:41 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: retry - disabling all eventgate-analytics monolog events for eventgate chart migration - T222962 (duration: 00m 50s) |
[production] |
17:11 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: disabling all eventgate-analytics monolog events for eventgate chart migration - T222962 (duration: 00m 50s) |
[production] |
17:09 |
<ottomata> |
disabling all eventgate-analytics monolog events for eventgate chart migration - T222962 |
[production] |
16:14 |
<Amir1> |
removing tokipona language terms from items using maintenance script (T200432) |
[production] |
16:00 |
<andrewbogott> |
reimaging clouvirt1024 (for the last time I hope) |
[production] |
14:33 |
<otto@deploy1001> |
Synchronized wmf-config/ProductionServices.php: no-op in prod - Configure eventgate services in beta (duration: 00m 49s) |
[production] |
14:32 |
<otto@deploy1001> |
Synchronized wmf-config/LabsServices.php: no-op in prod - Configure eventgate services in beta (duration: 00m 49s) |
[production] |
14:05 |
<moritzm> |
uploaded puppet 4.8.2-5+wmf1 to component/puppetdb4 for apt.wikimedia.org/stretch-wikimedia (T219803) |
[production] |
14:00 |
<elukey> |
roll restart of aqs on aqs1* to pick up new druid settings |
[production] |
13:50 |
<cdanis> |
cdanis@cumin1001.eqiad.wmnet ~ % sudo cumin -p95 -b8 'ms-fe2*' 'run-puppet-agent' |
[production] |
13:46 |
<moritzm> |
updating puppet on deployment-puppetmaster03 to 4.8.2-5+wmf1 (T219803) |
[production] |
13:39 |
<akosiaris> |
bump eventgate-analytics chart to 0.0.36. Renames nodejs GC stats to microseconds and bumps the biggest bucket to 100ms. T220709 |
[production] |