| 2019-03-25
      
      § | 
    
  | 09:24 | <hashar> | contint1001: manually compressing Zuul log files sudo -u zuul gzip --best /var/log/zuul/*.log.????-??-?? | [production] | 
            
  | 09:22 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1083+ (duration: 00m 49s) | [production] | 
            
  | 09:18 | <marostegui> | Upgrade db2055 | [production] | 
            
  | 09:16 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1105:3311 (duration: 00m 49s) | [production] | 
            
  | 09:10 | <mutante> | contint1001 - restarting zuul | [production] | 
            
  | 08:21 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1105:3311 (duration: 00m 49s) | [production] | 
            
  | 08:08 | <vgutierrez> | reenabling puppet in openldap servers | [production] | 
            
  | 08:05 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Fully repool db1118 (duration: 00m 49s) | [production] | 
            
  | 07:58 | <vgutierrez> | disable puppet and downtime host in icinga for labtestservices2001 - T218022 | [production] | 
            
  | 07:40 | <vgutierrez> | disable puppet in production openldap servers before merging https://gerrit.wikimedia.org/r/498776 | [production] | 
            
  | 07:24 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: More traffic to db1118 (duration: 00m 49s) | [production] | 
            
  | 06:59 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Slowly repool db1118 after mysql upgrade (duration: 00m 50s) | [production] | 
            
  | 06:45 | <marostegui> | Stop MySQL on db1118 for upgrade | [production] | 
            
  | 06:44 | <marostegui> | Deploy schema change on s1 codfw master, this will generate lag on codfw | [production] | 
            
  | 06:10 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1118 for schema change and upgrade (duration: 00m 54s) | [production] | 
            
  | 04:31 | <chaomodus> | restarted pdfrender on scb1003 to try to help flapping | [production] | 
            
  
    | 2019-03-22
      
      § | 
    
  | 22:13 | <bd808> | Restarted uwsgi-striker on labweb1002 | [production] | 
            
  | 22:12 | <bd808> | Restarted uwsgi-striker on labweb1001 | [production] | 
            
  | 20:14 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 20:14 | <otto@deploy1001> | scap-helm eventgate-analytics cluster eqiad completed | [production] | 
            
  | 20:14 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade production -f eventgate-analytics-eqiad-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad] | [production] | 
            
  | 20:04 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 20:04 | <otto@deploy1001> | scap-helm eventgate-analytics cluster eqiad completed | [production] | 
            
  | 20:04 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade production -f eventgate-analytics-eqiad-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad] | [production] | 
            
  | 19:59 | <ejegg> | updated payments-wiki-staging from 31647bc97e to f42910460b | [production] | 
            
  | 19:57 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 19:57 | <otto@deploy1001> | scap-helm eventgate-analytics cluster eqiad completed | [production] | 
            
  | 19:57 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade production -f eventgate-analytics-eqiad-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad] | [production] | 
            
  | 19:55 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 19:55 | <otto@deploy1001> | scap-helm eventgate-analytics cluster codfw completed | [production] | 
            
  | 19:55 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade production -f eventgate-analytics-codfw-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: codfw] | [production] | 
            
  | 19:52 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 19:52 | <otto@deploy1001> | scap-helm eventgate-analytics cluster staging completed | [production] | 
            
  | 19:52 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics --set main_app.extra_kafka_conf= [namespace: eventgate-analytics, clusters: staging] | [production] | 
            
  | 19:52 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 19:52 | <otto@deploy1001> | scap-helm eventgate-analytics cluster staging completed | [production] | 
            
  | 19:52 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics --set main_app.extra_kafka_conf={} [namespace: eventgate-analytics, clusters: staging] | [production] | 
            
  | 19:46 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 19:46 | <otto@deploy1001> | scap-helm eventgate-analytics cluster staging completed | [production] | 
            
  | 19:46 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] | [production] | 
            
  | 19:39 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 19:39 | <otto@deploy1001> | scap-helm eventgate-analytics cluster staging completed | [production] | 
            
  | 19:39 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] | [production] | 
            
  | 19:36 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 19:36 | <otto@deploy1001> | scap-helm eventgate-analytics cluster staging completed | [production] | 
            
  | 19:36 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] | [production] | 
            
  | 18:53 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] |