| 2019-02-21
      
      ยง | 
    
  | 13:18 | <gehel> | restarting rolling upgrade on elasticsearch / cirrus / codfw - T215931 | [production] | 
            
  | 12:50 | <jbond42> | restarting hhvm and updateing apache on mwmaint1002.eqiad.wmnet | [production] | 
            
  | 12:44 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 12:42 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:491823|Add img.raremaps.com at wgCopyUploadsDomains (T216638)]] (duration: 00m 52s) | [production] | 
            
  | 12:40 | <gilles@deploy1001> | Finished deploy [3d2png/deploy@ca39432]: (no justification provided) (duration: 00m 20s) | [production] | 
            
  | 12:39 | <gilles@deploy1001> | Started deploy [3d2png/deploy@ca39432]: (no justification provided) | [production] | 
            
  | 12:38 | <zfilipin@deploy1001> | Synchronized wmf-config/throttle.php: SWAT: [[gerrit:491826|Throttle rule for National Gallery of Canada Library and Archives edit-a-thon (T216642)]] (duration: 00m 53s) | [production] | 
            
  | 12:33 | <arturo> | disable puppet in cloudnet2001-dev to test T216497 | [production] | 
            
  | 12:31 | <akosiaris@deploy1001> | scap-helm mathoid finished | [production] | 
            
  | 12:31 | <akosiaris@deploy1001> | scap-helm mathoid cluster codfw completed | [production] | 
            
  | 12:30 | <akosiaris@deploy1001> | scap-helm mathoid cluster eqiad completed | [production] | 
            
  | 12:30 | <akosiaris@deploy1001> | scap-helm mathoid upgrade --recreate-pods -f mathoid-values.yaml production stable/mathoid [namespace: mathoid, clusters: eqiad,codfw] | [production] | 
            
  | 12:27 | <gilles@deploy1001> | Finished deploy [3d2png/deploy@ca39432]: (no justification provided) (duration: 00m 38s) | [production] | 
            
  | 12:26 | <gilles@deploy1001> | Started deploy [3d2png/deploy@ca39432]: (no justification provided) | [production] | 
            
  | 12:24 | <gilles@deploy1001> | Finished deploy [3d2png/deploy@ca39432]: l thumbor2002.codfw.wmnet (duration: 00m 04s) | [production] | 
            
  | 12:24 | <gilles@deploy1001> | Started deploy [3d2png/deploy@ca39432]: l thumbor2002.codfw.wmnet | [production] | 
            
  | 12:24 | <gilles@deploy1001> | Finished deploy [3d2png/deploy@ca39432]: l thumbor2002 (duration: 00m 08s) | [production] | 
            
  | 12:24 | <gilles@deploy1001> | Started deploy [3d2png/deploy@ca39432]: l thumbor2002 | [production] | 
            
  | 12:23 | <arturo> | importing openstack mitaka packages to reprepro @ install1002 (T216497) | [production] | 
            
  | 12:17 | <arturo> | enable puppet in install1002 (done testing T216497) | [production] | 
            
  | 12:14 | <zfilipin@deploy1001> | Synchronized dblists/mobilemainpagelegacy.dblist: SWAT: [[gerrit:491699|Disable mobile main page special casing on huwiki (T216563)]] (duration: 00m 54s) | [production] | 
            
  | 12:13 | <gilles@deploy1001> | Finished deploy [3d2png/deploy@ca39432]: Updating repo (duration: 00m 29s) | [production] | 
            
  | 12:13 | <gilles@deploy1001> | Started deploy [3d2png/deploy@ca39432]: Updating repo | [production] | 
            
  | 12:10 | <arturo> | T216497 import reprepro key 7638D0442B90D010 (debian archive automatic signing key (8/jessie) | [production] | 
            
  | 12:00 | <arturo> | disable puppet in install1002 to test T216497 | [production] | 
            
  | 11:13 | <volans> | upgraded spicerack to 0.0.19 on cumin[12]001 | [production] | 
            
  | 11:11 | <volans> | uploaded spicerack_0.0.19-1_amd64.deb to apt.wikimedia.org stretch-wikimedia | [production] | 
            
  | 10:55 | <akosiaris> | upgrade mathoid staging+production to latest helm chart | [production] | 
            
  | 10:47 | <akosiaris@deploy1001> | scap-helm mathoid finished | [production] | 
            
  | 10:47 | <akosiaris@deploy1001> | scap-helm mathoid cluster codfw completed | [production] | 
            
  | 10:47 | <akosiaris@deploy1001> | scap-helm mathoid cluster eqiad completed | [production] | 
            
  | 10:47 | <akosiaris@deploy1001> | scap-helm mathoid upgrade -f mathoid-values.yaml production stable/mathoid [namespace: mathoid, clusters: eqiad,codfw] | [production] | 
            
  | 10:29 | <akosiaris@deploy1001> | scap-helm mathoid finished | [production] | 
            
  | 10:29 | <akosiaris@deploy1001> | scap-helm mathoid cluster staging completed | [production] | 
            
  | 10:29 | <akosiaris@deploy1001> | scap-helm mathoid upgrade -f mathoid-staging-values.yaml staging stable/mathoid [namespace: mathoid, clusters: staging] | [production] | 
            
  | 10:28 | <akosiaris@deploy1001> | scap-helm mathoid finished | [production] | 
            
  | 10:28 | <akosiaris@deploy1001> | scap-helm mathoid cluster staging completed | [production] | 
            
  | 10:28 | <akosiaris@deploy1001> | scap-helm mathoid upgrade -f mathoid-values.yaml staging stable/mathoid [namespace: mathoid, clusters: staging] | [production] | 
            
  | 10:27 | <akosiaris@deploy1001> | scap-helm mathoid upgrade -f mathoid-values.yaml stable/mathoid [namespace: mathoid, clusters: staging] | [production] | 
            
  | 10:26 | <akosiaris@deploy1001> | scap-helm list finished | [production] | 
            
  | 10:26 | <akosiaris@deploy1001> | scap-helm list cluster codfw completed | [production] | 
            
  | 10:26 | <akosiaris@deploy1001> | scap-helm list cluster eqiad completed | [production] | 
            
  | 10:26 | <akosiaris@deploy1001> | scap-helm list  [namespace: list, clusters: eqiad,codfw] | [production] | 
            
  | 10:23 | <godog> | on boron unblock trusty builds with umount /var/cache/pbuilder/base-trusty-amd64.cow/dev/ptmx | [production] | 
            
  | 10:04 | <akosiaris> | create citoid namespace on kubernetes eqiad codfw staging clusters T213194 | [production] | 
            
  | 10:04 | <akosiaris> | create cxserver namespace on kubernetes eqiad codfw staging clusters T213195 | [production] | 
            
  | 09:35 | <volans> | force rebooting unresponsive icinga1001 T214760 | [production] | 
            
  | 09:29 | <marostegui> | Deploy schema change on s3 primary master (db1078) - T210713 | [production] | 
            
  | 09:29 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1075 T210713 (duration: 00m 52s) | [production] | 
            
  | 09:14 | <moritzm> | temporarily stop prometheus@labs.service on labmon for journald restarts (part of security update) | [production] |