| 
      
        2019-03-25
      
      §
     | 
  
    
  | 10:02 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Slowly repool db1083 (duration: 00m 49s) | 
  [production] | 
            
  | 09:42 | 
  <moritzm> | 
  uploaded openjdk 8u212-b01-1~deb8u1 to apt.wikimedia.org/jessie-wikimedia/main | 
  [production] | 
            
  | 09:34 | 
  <marostegui> | 
  Upgrade db2062 | 
  [production] | 
            
  | 09:24 | 
  <hashar> | 
  contint1001: manually compressing Zuul log files sudo -u zuul gzip --best /var/log/zuul/*.log.????-??-?? | 
  [production] | 
            
  | 09:22 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1083+ (duration: 00m 49s) | 
  [production] | 
            
  | 09:18 | 
  <marostegui> | 
  Upgrade db2055 | 
  [production] | 
            
  | 09:16 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1105:3311 (duration: 00m 49s) | 
  [production] | 
            
  | 09:10 | 
  <mutante> | 
  contint1001 - restarting zuul | 
  [production] | 
            
  | 08:21 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1105:3311 (duration: 00m 49s) | 
  [production] | 
            
  | 08:08 | 
  <vgutierrez> | 
  reenabling puppet in openldap servers | 
  [production] | 
            
  | 08:05 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Fully repool db1118 (duration: 00m 49s) | 
  [production] | 
            
  | 07:58 | 
  <vgutierrez> | 
  disable puppet and downtime host in icinga for labtestservices2001 - T218022 | 
  [production] | 
            
  | 07:40 | 
  <vgutierrez> | 
  disable puppet in production openldap servers before merging https://gerrit.wikimedia.org/r/498776 | 
  [production] | 
            
  | 07:24 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: More traffic to db1118 (duration: 00m 49s) | 
  [production] | 
            
  | 06:59 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Slowly repool db1118 after mysql upgrade (duration: 00m 50s) | 
  [production] | 
            
  | 06:45 | 
  <marostegui> | 
  Stop MySQL on db1118 for upgrade | 
  [production] | 
            
  | 06:44 | 
  <marostegui> | 
  Deploy schema change on s1 codfw master, this will generate lag on codfw | 
  [production] | 
            
  | 06:10 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1118 for schema change and upgrade (duration: 00m 54s) | 
  [production] | 
            
  | 04:31 | 
  <chaomodus> | 
  restarted pdfrender on scb1003 to try to help flapping | 
  [production] | 
            
  
    | 
      
        2019-03-22
      
      §
     | 
  
    
  | 22:13 | 
  <bd808> | 
  Restarted uwsgi-striker on labweb1002 | 
  [production] | 
            
  | 22:12 | 
  <bd808> | 
  Restarted uwsgi-striker on labweb1001 | 
  [production] | 
            
  | 20:14 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics finished | 
  [production] | 
            
  | 20:14 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics cluster eqiad completed | 
  [production] | 
            
  | 20:14 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics upgrade production -f eventgate-analytics-eqiad-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad] | 
  [production] | 
            
  | 20:04 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics finished | 
  [production] | 
            
  | 20:04 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics cluster eqiad completed | 
  [production] | 
            
  | 20:04 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics upgrade production -f eventgate-analytics-eqiad-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad] | 
  [production] | 
            
  | 19:59 | 
  <ejegg> | 
  updated payments-wiki-staging from 31647bc97e to f42910460b | 
  [production] | 
            
  | 19:57 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics finished | 
  [production] | 
            
  | 19:57 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics cluster eqiad completed | 
  [production] | 
            
  | 19:57 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics upgrade production -f eventgate-analytics-eqiad-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad] | 
  [production] | 
            
  | 19:55 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics finished | 
  [production] | 
            
  | 19:55 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics cluster codfw completed | 
  [production] | 
            
  | 19:55 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics upgrade production -f eventgate-analytics-codfw-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: codfw] | 
  [production] | 
            
  | 19:52 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics finished | 
  [production] | 
            
  | 19:52 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics cluster staging completed | 
  [production] | 
            
  | 19:52 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics --set main_app.extra_kafka_conf= [namespace: eventgate-analytics, clusters: staging] | 
  [production] | 
            
  | 19:52 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics finished | 
  [production] | 
            
  | 19:52 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics cluster staging completed | 
  [production] | 
            
  | 19:52 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics --set main_app.extra_kafka_conf={} [namespace: eventgate-analytics, clusters: staging] | 
  [production] | 
            
  | 19:46 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics finished | 
  [production] | 
            
  | 19:46 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics cluster staging completed | 
  [production] | 
            
  | 19:46 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] | 
  [production] | 
            
  | 19:39 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics finished | 
  [production] | 
            
  | 19:39 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics cluster staging completed | 
  [production] | 
            
  | 19:39 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] | 
  [production] | 
            
  | 19:36 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics finished | 
  [production] |