| 
      
        2019-02-21
      
      ยง
     | 
  
    
  | 13:18 | 
  <gehel@cumin2001> | 
  START - Cookbook sre.elasticsearch.rolling-upgrade | 
  [production] | 
            
  | 13:18 | 
  <gehel> | 
  restarting rolling upgrade on elasticsearch / cirrus / codfw - T215931 | 
  [production] | 
            
  | 12:50 | 
  <jbond42> | 
  restarting hhvm and updateing apache on mwmaint1002.eqiad.wmnet | 
  [production] | 
            
  | 12:44 | 
  <zeljkof> | 
  EU SWAT finished | 
  [production] | 
            
  | 12:42 | 
  <zfilipin@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:491823|Add img.raremaps.com at wgCopyUploadsDomains (T216638)]] (duration: 00m 52s) | 
  [production] | 
            
  | 12:40 | 
  <gilles@deploy1001> | 
  Finished deploy [3d2png/deploy@ca39432]: (no justification provided) (duration: 00m 20s) | 
  [production] | 
            
  | 12:39 | 
  <gilles@deploy1001> | 
  Started deploy [3d2png/deploy@ca39432]: (no justification provided) | 
  [production] | 
            
  | 12:38 | 
  <zfilipin@deploy1001> | 
  Synchronized wmf-config/throttle.php: SWAT: [[gerrit:491826|Throttle rule for National Gallery of Canada Library and Archives edit-a-thon (T216642)]] (duration: 00m 53s) | 
  [production] | 
            
  | 12:33 | 
  <arturo> | 
  disable puppet in cloudnet2001-dev to test T216497 | 
  [production] | 
            
  | 12:31 | 
  <akosiaris@deploy1001> | 
  scap-helm mathoid finished | 
  [production] | 
            
  | 12:31 | 
  <akosiaris@deploy1001> | 
  scap-helm mathoid cluster codfw completed | 
  [production] | 
            
  | 12:30 | 
  <akosiaris@deploy1001> | 
  scap-helm mathoid cluster eqiad completed | 
  [production] | 
            
  | 12:30 | 
  <akosiaris@deploy1001> | 
  scap-helm mathoid upgrade --recreate-pods -f mathoid-values.yaml production stable/mathoid [namespace: mathoid, clusters: eqiad,codfw] | 
  [production] | 
            
  | 12:27 | 
  <gilles@deploy1001> | 
  Finished deploy [3d2png/deploy@ca39432]: (no justification provided) (duration: 00m 38s) | 
  [production] | 
            
  | 12:26 | 
  <gilles@deploy1001> | 
  Started deploy [3d2png/deploy@ca39432]: (no justification provided) | 
  [production] | 
            
  | 12:24 | 
  <gilles@deploy1001> | 
  Finished deploy [3d2png/deploy@ca39432]: l thumbor2002.codfw.wmnet (duration: 00m 04s) | 
  [production] | 
            
  | 12:24 | 
  <gilles@deploy1001> | 
  Started deploy [3d2png/deploy@ca39432]: l thumbor2002.codfw.wmnet | 
  [production] | 
            
  | 12:24 | 
  <gilles@deploy1001> | 
  Finished deploy [3d2png/deploy@ca39432]: l thumbor2002 (duration: 00m 08s) | 
  [production] | 
            
  | 12:24 | 
  <gilles@deploy1001> | 
  Started deploy [3d2png/deploy@ca39432]: l thumbor2002 | 
  [production] | 
            
  | 12:23 | 
  <arturo> | 
  importing openstack mitaka packages to reprepro @ install1002 (T216497) | 
  [production] | 
            
  | 12:17 | 
  <arturo> | 
  enable puppet in install1002 (done testing T216497) | 
  [production] | 
            
  | 12:14 | 
  <zfilipin@deploy1001> | 
  Synchronized dblists/mobilemainpagelegacy.dblist: SWAT: [[gerrit:491699|Disable mobile main page special casing on huwiki (T216563)]] (duration: 00m 54s) | 
  [production] | 
            
  | 12:13 | 
  <gilles@deploy1001> | 
  Finished deploy [3d2png/deploy@ca39432]: Updating repo (duration: 00m 29s) | 
  [production] | 
            
  | 12:13 | 
  <gilles@deploy1001> | 
  Started deploy [3d2png/deploy@ca39432]: Updating repo | 
  [production] | 
            
  | 12:10 | 
  <arturo> | 
  T216497 import reprepro key 7638D0442B90D010 (debian archive automatic signing key (8/jessie) | 
  [production] | 
            
  | 12:00 | 
  <arturo> | 
  disable puppet in install1002 to test T216497 | 
  [production] | 
            
  | 11:13 | 
  <volans> | 
  upgraded spicerack to 0.0.19 on cumin[12]001 | 
  [production] | 
            
  | 11:11 | 
  <volans> | 
  uploaded spicerack_0.0.19-1_amd64.deb to apt.wikimedia.org stretch-wikimedia | 
  [production] | 
            
  | 10:55 | 
  <akosiaris> | 
  upgrade mathoid staging+production to latest helm chart | 
  [production] | 
            
  | 10:47 | 
  <akosiaris@deploy1001> | 
  scap-helm mathoid finished | 
  [production] | 
            
  | 10:47 | 
  <akosiaris@deploy1001> | 
  scap-helm mathoid cluster codfw completed | 
  [production] | 
            
  | 10:47 | 
  <akosiaris@deploy1001> | 
  scap-helm mathoid cluster eqiad completed | 
  [production] | 
            
  | 10:47 | 
  <akosiaris@deploy1001> | 
  scap-helm mathoid upgrade -f mathoid-values.yaml production stable/mathoid [namespace: mathoid, clusters: eqiad,codfw] | 
  [production] | 
            
  | 10:29 | 
  <akosiaris@deploy1001> | 
  scap-helm mathoid finished | 
  [production] | 
            
  | 10:29 | 
  <akosiaris@deploy1001> | 
  scap-helm mathoid cluster staging completed | 
  [production] | 
            
  | 10:29 | 
  <akosiaris@deploy1001> | 
  scap-helm mathoid upgrade -f mathoid-staging-values.yaml staging stable/mathoid [namespace: mathoid, clusters: staging] | 
  [production] | 
            
  | 10:28 | 
  <akosiaris@deploy1001> | 
  scap-helm mathoid finished | 
  [production] | 
            
  | 10:28 | 
  <akosiaris@deploy1001> | 
  scap-helm mathoid cluster staging completed | 
  [production] | 
            
  | 10:28 | 
  <akosiaris@deploy1001> | 
  scap-helm mathoid upgrade -f mathoid-values.yaml staging stable/mathoid [namespace: mathoid, clusters: staging] | 
  [production] | 
            
  | 10:27 | 
  <akosiaris@deploy1001> | 
  scap-helm mathoid upgrade -f mathoid-values.yaml stable/mathoid [namespace: mathoid, clusters: staging] | 
  [production] | 
            
  | 10:26 | 
  <akosiaris@deploy1001> | 
  scap-helm list finished | 
  [production] | 
            
  | 10:26 | 
  <akosiaris@deploy1001> | 
  scap-helm list cluster codfw completed | 
  [production] | 
            
  | 10:26 | 
  <akosiaris@deploy1001> | 
  scap-helm list cluster eqiad completed | 
  [production] | 
            
  | 10:26 | 
  <akosiaris@deploy1001> | 
  scap-helm list  [namespace: list, clusters: eqiad,codfw] | 
  [production] | 
            
  | 10:23 | 
  <godog> | 
  on boron unblock trusty builds with umount /var/cache/pbuilder/base-trusty-amd64.cow/dev/ptmx | 
  [production] | 
            
  | 10:04 | 
  <akosiaris> | 
  create citoid namespace on kubernetes eqiad codfw staging clusters T213194 | 
  [production] | 
            
  | 10:04 | 
  <akosiaris> | 
  create cxserver namespace on kubernetes eqiad codfw staging clusters T213195 | 
  [production] | 
            
  | 09:35 | 
  <volans> | 
  force rebooting unresponsive icinga1001 T214760 | 
  [production] | 
            
  | 09:29 | 
  <marostegui> | 
  Deploy schema change on s3 primary master (db1078) - T210713 | 
  [production] | 
            
  | 09:29 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1075 T210713 (duration: 00m 52s) | 
  [production] |