| 
      
        2019-03-13
      
      ยง
     | 
  
    
  | 16:04 | 
  <akosiaris@deploy1001> | 
  scap-helm cxserver upgrade -f cxserver-codfw-values.yaml production stable/cxserver [namespace: cxserver, clusters: codfw] | 
  [production] | 
            
  | 16:04 | 
  <akosiaris@deploy1001> | 
  scap-helm cxserver finished | 
  [production] | 
            
  | 16:04 | 
  <akosiaris@deploy1001> | 
  scap-helm cxserver cluster staging completed | 
  [production] | 
            
  | 16:04 | 
  <akosiaris@deploy1001> | 
  scap-helm cxserver upgrade -f cxserver-staging-values.yaml staging stable/cxserver [namespace: cxserver, clusters: staging] | 
  [production] | 
            
  | 15:52 | 
  <akosiaris@deploy1001> | 
  scap-helm cxserver finished | 
  [production] | 
            
  | 15:52 | 
  <akosiaris@deploy1001> | 
  scap-helm cxserver cluster staging completed | 
  [production] | 
            
  | 15:52 | 
  <akosiaris@deploy1001> | 
  scap-helm cxserver upgrade -f cxserver-staging-values.yaml staging stable/cxserver [namespace: cxserver, clusters: staging] | 
  [production] | 
            
  | 15:52 | 
  <akosiaris@deploy1001> | 
  scap-helm cxserver finished | 
  [production] | 
            
  | 15:52 | 
  <akosiaris@deploy1001> | 
  scap-helm cxserver cluster eqiad completed | 
  [production] | 
            
  | 15:52 | 
  <akosiaris@deploy1001> | 
  scap-helm cxserver upgrade -f cxserver-eqiad-values.yaml production stable/cxserver [namespace: cxserver, clusters: eqiad] | 
  [production] | 
            
  | 15:52 | 
  <akosiaris@deploy1001> | 
  scap-helm cxserver upgrade -f cxserver-eqiad-values.yaml eqiad stable/cxserver [namespace: cxserver, clusters: eqiad] | 
  [production] | 
            
  | 15:52 | 
  <akosiaris@deploy1001> | 
  scap-helm cxserver finished | 
  [production] | 
            
  | 15:52 | 
  <akosiaris@deploy1001> | 
  scap-helm cxserver cluster codfw completed | 
  [production] | 
            
  | 15:52 | 
  <akosiaris@deploy1001> | 
  scap-helm cxserver upgrade -f cxserver-codfw-values.yaml production stable/cxserver [namespace: cxserver, clusters: codfw] | 
  [production] | 
            
  | 15:40 | 
  <akosiaris> | 
  do the first deploy of cxserver in eqiad/codfw T213195 | 
  [production] | 
            
  | 15:39 | 
  <akosiaris@deploy1001> | 
  scap-helm cxserver finished | 
  [production] | 
            
  | 15:39 | 
  <akosiaris@deploy1001> | 
  scap-helm cxserver cluster eqiad completed | 
  [production] | 
            
  | 15:39 | 
  <akosiaris@deploy1001> | 
  scap-helm cxserver install -n production -f cxserver-eqiad-values.yaml stable/cxserver [namespace: cxserver, clusters: eqiad] | 
  [production] | 
            
  | 15:39 | 
  <akosiaris@deploy1001> | 
  scap-helm cxserver finished | 
  [production] | 
            
  | 15:39 | 
  <akosiaris@deploy1001> | 
  scap-helm cxserver cluster codfw completed | 
  [production] | 
            
  | 15:39 | 
  <akosiaris@deploy1001> | 
  scap-helm cxserver install -n production -f cxserver-codfw-values.yaml stable/cxserver [namespace: cxserver, clusters: codfw] | 
  [production] | 
            
  | 14:27 | 
  <ema> | 
  cp2002: depool varnish-fe in preparation of pointing it to ATS T213263 | 
  [production] | 
            
  | 14:13 | 
  <marostegui> | 
  Upgrade db2074 (sanitarium master) | 
  [production] | 
            
  | 13:42 | 
  <akosiaris> | 
  upgrade kubestage to kubernetes 1.11.8 | 
  [production] | 
            
  | 13:42 | 
  <akosiaris> | 
  upgrade neon to kubernetes 1.11.8 | 
  [production] | 
            
  | 13:28 | 
  <akosiaris> | 
  upgrade kubestage1002 to kubernetes 1.11.8 | 
  [production] | 
            
  | 13:24 | 
  <godog> | 
  take a snapshot of prometheus@k8s data on prometheus2004 | 
  [production] | 
            
  | 13:13 | 
  <zfilipin@deploy1001> | 
  Synchronized php: group1 wikis to 1.33.0-wmf.21 (duration: 01m 43s) | 
  [production] | 
            
  | 13:12 | 
  <zfilipin@deploy1001> | 
  rebuilt and synchronized wikiversions files: group1 wikis to 1.33.0-wmf.21 | 
  [production] | 
            
  | 11:34 | 
  <marostegui> | 
  Test snapshot db1117:3325 to dbstore1001 - T210292 | 
  [production] | 
            
  | 10:55 | 
  <marostegui> | 
  Upgrade db2057 | 
  [production] | 
            
  | 10:00 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1085 (duration: 00m 56s) | 
  [production] | 
            
  | 09:52 | 
  <mutante> | 
  ms-be1035 - sudo  systemctl reset-failed | 
  [production] | 
            
  | 09:45 | 
  <ema> | 
  cp1071: upgrade trafficserver to 8.0.3~rc0 for testing purposes | 
  [production] | 
            
  | 09:41 | 
  <marostegui> | 
  Deploy schema change on db1085 with replication, there will be lag on labsdb:s6 | 
  [production] | 
            
  | 09:41 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1085 (duration: 00m 55s) | 
  [production] | 
            
  | 09:06 | 
  <moritzm> | 
  installing PHP 7.0 security updates | 
  [production] | 
            
  | 08:59 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1113:3316 (duration: 00m 55s) | 
  [production] | 
            
  | 08:58 | 
  <marostegui> | 
  Upgrade mysql and kernel on db2050 | 
  [production] | 
            
  | 08:51 | 
  <ema> | 
  cp3030: wipe frontend cache to get rid of large objects T216006 | 
  [production] | 
            
  | 08:26 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1113:3316 (duration: 00m 55s) | 
  [production] | 
            
  | 08:14 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1093 (duration: 00m 55s) | 
  [production] | 
            
  | 08:09 | 
  <moritzm> | 
  upgrading job runners in eqiad to component/php72 / PHP 7.2.16 (combined with glibc/OpenSSL updates) | 
  [production] | 
            
  | 07:30 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1093 (duration: 00m 54s) | 
  [production] | 
            
  | 07:26 | 
  <moritzm> | 
  upgrading remaining app servers in eqiad to component/php72 / PHP 7.2.16 (combined with glibc/OpenSSL updates) | 
  [production] | 
            
  | 07:25 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Fully repool db1096 (duration: 00m 58s) | 
  [production] | 
            
  | 07:13 | 
  <marostegui> | 
  Test snapshot dbstore1001:3311 to dbstore1001 - T210292 | 
  [production] | 
            
  | 07:12 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: More traffic to db1096 (duration: 00m 55s) | 
  [production] | 
            
  | 06:58 | 
  <marostegui> | 
  Upgrade MySQL and kernel on db2036 | 
  [production] | 
            
  | 06:56 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Slowly repool db1096 (duration: 00m 55s) | 
  [production] |