| 
      
        2019-03-15
      
      §
     | 
  
    
  | 10:02 | 
  <akosiaris@deploy1001> | 
  scap-helm citoid upgrade -f citoid-eqiad-values.yaml production stable/citoid [namespace: citoid, clusters: eqiad] | 
  [production] | 
            
  | 10:02 | 
  <akosiaris> | 
  add a 10s bucket to citoid prometheus-statsd exporter mappings | 
  [production] | 
            
  | 10:02 | 
  <akosiaris> | 
  remove prometheus-statsd-exporter from zotero pods | 
  [production] | 
            
  | 10:02 | 
  <akosiaris@deploy1001> | 
  scap-helm citoid finished | 
  [production] | 
            
  | 10:02 | 
  <akosiaris@deploy1001> | 
  scap-helm citoid cluster staging completed | 
  [production] | 
            
  | 10:02 | 
  <akosiaris@deploy1001> | 
  scap-helm citoid upgrade -f citoid-staging-values.yaml staging stable/citoid [namespace: citoid, clusters: staging] | 
  [production] | 
            
  | 10:01 | 
  <akosiaris@deploy1001> | 
  scap-helm citoid upgrade -f citoid-values-staging.yaml staging stable/citoid [namespace: citoid, clusters: staging] | 
  [production] | 
            
  | 10:00 | 
  <akosiaris@deploy1001> | 
  scap-helm zotero finished | 
  [production] | 
            
  | 10:00 | 
  <akosiaris@deploy1001> | 
  scap-helm zotero cluster staging completed | 
  [production] | 
            
  | 10:00 | 
  <akosiaris@deploy1001> | 
  scap-helm zotero upgrade --install -f zotero-values-staging.yaml staging stable/zotero [namespace: zotero, clusters: staging] | 
  [production] | 
            
  | 09:58 | 
  <akosiaris@deploy1001> | 
  scap-helm zotero upgrade -f zotero-values-staging.yaml staging stable/zotero [namespace: zotero, clusters: staging] | 
  [production] | 
            
  | 09:53 | 
  <akosiaris@deploy1001> | 
  scap-helm zotero finished | 
  [production] | 
            
  | 09:53 | 
  <akosiaris@deploy1001> | 
  scap-helm zotero cluster eqiad completed | 
  [production] | 
            
  | 09:53 | 
  <akosiaris@deploy1001> | 
  scap-helm zotero upgrade -f zotero-values-eqiad.yaml production stable/zotero [namespace: zotero, clusters: eqiad] | 
  [production] | 
            
  | 09:53 | 
  <akosiaris@deploy1001> | 
  scap-helm zotero finished | 
  [production] | 
            
  | 09:53 | 
  <akosiaris@deploy1001> | 
  scap-helm zotero cluster codfw completed | 
  [production] | 
            
  | 09:52 | 
  <akosiaris@deploy1001> | 
  scap-helm zotero upgrade -f zotero-values-codfw.yaml production stable/zotero [namespace: zotero, clusters: codfw] | 
  [production] | 
            
  | 09:42 | 
  <godog> | 
  bounce grafana-server on grafana1001 | 
  [production] | 
            
  | 09:32 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1103 (duration: 00m 50s) | 
  [production] | 
            
  | 09:28 | 
  <godog> | 
  correction, prometheus2004 | 
  [production] | 
            
  | 09:27 | 
  <godog> | 
  temporarily disable read queries to prometheus@k8s on prometheus2003 | 
  [production] | 
            
  | 09:19 | 
  <jiji@cumin1001> | 
  conftool action : set/weight=12; selector: dc=eqiad,service=cxserver,cluster=scb,name=kubernetes.* | 
  [production] | 
            
  | 09:18 | 
  <jiji@cumin1001> | 
  conftool action : set/weight=15; selector: dc=codfw,service=cxserver,cluster=scb,name=kubernetes.* | 
  [production] | 
            
  | 09:17 | 
  <jijiki> | 
  Ramp up  cxserver k8s traffic to 50% - T213195 | 
  [production] | 
            
  | 08:57 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1103 (duration: 00m 50s) | 
  [production] | 
            
  | 08:52 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1084 (duration: 00m 47s) | 
  [production] | 
            
  | 08:22 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1084 (duration: 00m 49s) | 
  [production] | 
            
  | 07:28 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Fully repool db1091 (duration: 00m 49s) | 
  [production] | 
            
  | 07:17 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: More traffic to db1091 (duration: 00m 48s) | 
  [production] | 
            
  | 07:05 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: More traffic to db1091 (duration: 00m 48s) | 
  [production] | 
            
  | 07:01 | 
  <kart_> | 
  Finished manual run of unpublished ContentTranslation draft purge script (T217818) | 
  [production] | 
            
  | 06:55 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: More traffic to db1091 (duration: 00m 48s) | 
  [production] | 
            
  | 06:44 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Slowly repool db1091 (duration: 00m 48s) | 
  [production] | 
            
  | 06:04 | 
  <marostegui> | 
  Upgrade db1091 | 
  [production] | 
            
  | 06:04 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1091 (duration: 00m 50s) | 
  [production] | 
            
  | 04:01 | 
  <kart_> | 
  Started manual run of unpublished ContentTranslation draft purge script (T217818) | 
  [production] | 
            
  | 01:25 | 
  <ejegg> | 
  re-enabled ingenico audit parser | 
  [production] | 
            
  | 01:25 | 
  <ejegg> | 
  updated fundraising CiviCRM from 41efa14fb0 to a2316be94f | 
  [production] | 
            
  
    | 
      
        2019-03-14
      
      §
     | 
  
    
  | 22:54 | 
  <ejegg> | 
  temporarily disabled Ingenico WX audit parsing | 
  [production] | 
            
  | 22:05 | 
  <cdanis> | 
  cdanis@icinga2001.wikimedia.org ~ % sudo systemctl restart icinga.service | 
  [production] | 
            
  | 21:58 | 
  <cdanis> | 
  cdanis@icinga2001.wikimedia.org ~ % sudo systemctl restart nsca.service | 
  [production] | 
            
  | 21:01 | 
  <crusnov@deploy1001> | 
  Finished deploy [netbox/deploy@090a0c3]: Another minor bugfix releaes for ganeti-netbox script (duration: 00m 56s) | 
  [production] | 
            
  | 21:00 | 
  <crusnov@deploy1001> | 
  Started deploy [netbox/deploy@090a0c3]: Another minor bugfix releaes for ganeti-netbox script | 
  [production] | 
            
  | 20:26 | 
  <thcipriani> | 
  gerrit live on 2.15.11 | 
  [production] | 
            
  | 20:24 | 
  <thcipriani> | 
  restarting gerrit for 2.15.11 | 
  [production] | 
            
  | 20:23 | 
  <thcipriani@deploy1001> | 
  Finished deploy [gerrit/gerrit@2bc8af0]: Gerrit to 2.15.11 on cobalt (duration: 00m 02s) | 
  [production] | 
            
  | 20:23 | 
  <thcipriani@deploy1001> | 
  Started deploy [gerrit/gerrit@2bc8af0]: Gerrit to 2.15.11 on cobalt | 
  [production] | 
            
  | 20:22 | 
  <thcipriani@deploy1001> | 
  Finished deploy [gerrit/gerrit@2bc8af0]: Gerrit to 2.15.11 on gerrit2001 only (duration: 00m 04s) | 
  [production] | 
            
  | 20:22 | 
  <thcipriani@deploy1001> | 
  Started deploy [gerrit/gerrit@2bc8af0]: Gerrit to 2.15.11 on gerrit2001 only | 
  [production] | 
            
  | 20:17 | 
  <ejegg> | 
  updated CiviCRM from b4e3cf16cc to 41efa14fb0 | 
  [production] |