2751-2800 of 10000 results (66ms)
2019-03-25 §
09:24 <hashar> contint1001: manually compressing Zuul log files sudo -u zuul gzip --best /var/log/zuul/*.log.????-??-?? [production]
09:22 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1083+ (duration: 00m 49s) [production]
09:18 <marostegui> Upgrade db2055 [production]
09:16 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1105:3311 (duration: 00m 49s) [production]
09:10 <mutante> contint1001 - restarting zuul [production]
08:21 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1105:3311 (duration: 00m 49s) [production]
08:08 <vgutierrez> reenabling puppet in openldap servers [production]
08:05 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Fully repool db1118 (duration: 00m 49s) [production]
07:58 <vgutierrez> disable puppet and downtime host in icinga for labtestservices2001 - T218022 [production]
07:40 <vgutierrez> disable puppet in production openldap servers before merging https://gerrit.wikimedia.org/r/498776 [production]
07:24 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1118 (duration: 00m 49s) [production]
06:59 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Slowly repool db1118 after mysql upgrade (duration: 00m 50s) [production]
06:45 <marostegui> Stop MySQL on db1118 for upgrade [production]
06:44 <marostegui> Deploy schema change on s1 codfw master, this will generate lag on codfw [production]
06:10 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1118 for schema change and upgrade (duration: 00m 54s) [production]
04:31 <chaomodus> restarted pdfrender on scb1003 to try to help flapping [production]
2019-03-24 §
15:00 <jijiki> Restart pdfrender on scb1002 and scb1004 [production]
2019-03-23 §
13:02 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: Fix WikimediaEditorTasks Beta Cluster DB config, take 2 (duration: 00m 50s) [production]
12:36 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: Fix WikimediaEditorTasks Beta Cluster DB config (duration: 00m 52s) [production]
2019-03-22 §
22:13 <bd808> Restarted uwsgi-striker on labweb1002 [production]
22:12 <bd808> Restarted uwsgi-striker on labweb1001 [production]
20:14 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
20:14 <otto@deploy1001> scap-helm eventgate-analytics cluster eqiad completed [production]
20:14 <otto@deploy1001> scap-helm eventgate-analytics upgrade production -f eventgate-analytics-eqiad-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad] [production]
20:04 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
20:04 <otto@deploy1001> scap-helm eventgate-analytics cluster eqiad completed [production]
20:04 <otto@deploy1001> scap-helm eventgate-analytics upgrade production -f eventgate-analytics-eqiad-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad] [production]
19:59 <ejegg> updated payments-wiki-staging from 31647bc97e to f42910460b [production]
19:57 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
19:57 <otto@deploy1001> scap-helm eventgate-analytics cluster eqiad completed [production]
19:57 <otto@deploy1001> scap-helm eventgate-analytics upgrade production -f eventgate-analytics-eqiad-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad] [production]
19:55 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
19:55 <otto@deploy1001> scap-helm eventgate-analytics cluster codfw completed [production]
19:55 <otto@deploy1001> scap-helm eventgate-analytics upgrade production -f eventgate-analytics-codfw-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: codfw] [production]
19:52 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
19:52 <otto@deploy1001> scap-helm eventgate-analytics cluster staging completed [production]
19:52 <otto@deploy1001> scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics --set main_app.extra_kafka_conf= [namespace: eventgate-analytics, clusters: staging] [production]
19:52 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
19:52 <otto@deploy1001> scap-helm eventgate-analytics cluster staging completed [production]
19:52 <otto@deploy1001> scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics --set main_app.extra_kafka_conf={} [namespace: eventgate-analytics, clusters: staging] [production]
19:46 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
19:46 <otto@deploy1001> scap-helm eventgate-analytics cluster staging completed [production]
19:46 <otto@deploy1001> scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] [production]
19:39 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
19:39 <otto@deploy1001> scap-helm eventgate-analytics cluster staging completed [production]
19:39 <otto@deploy1001> scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] [production]
19:36 <otto@deploy1001> scap-helm eventgate-analytics finished [production]
19:36 <otto@deploy1001> scap-helm eventgate-analytics cluster staging completed [production]
19:36 <otto@deploy1001> scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] [production]
18:53 <otto@deploy1001> scap-helm eventgate-analytics finished [production]