| 2019-03-05
      
      § | 
    
  | 14:41 | <otto@deploy1001> | scap-helm eventgate-analytics cluster codfw completed | [production] | 
            
  | 14:41 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade production stable/eventgate-analytics -f eventgate-analytics-codfw-values.yaml [namespace: eventgate-analytics, clusters: codfw] | [production] | 
            
  | 14:35 | <hashar@deploy1001> | scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki="cawikibooks" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.BRPBtKvzZH" --verbose' returned non-zero exit status 1 (duration: 00m 20s) | [production] | 
            
  | 14:35 | <hashar@deploy1001> | Started scap: testwiki to php-1.33.0-wmf.20 and rebuild l10n cache # T206674 | [production] | 
            
  | 14:34 | <hashar@deploy1001> | scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki="cawikibooks" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.ngh6XIMz8y" --verbose' returned non-zero exit status 1 (duration: 00m 21s) | [production] | 
            
  | 14:33 | <hashar@deploy1001> | Started scap: testwiki to php-1.33.0-wmf.20 and rebuild l10n cache # T206674 | [production] | 
            
  | 14:27 | <hashar@deploy1001> | scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki="cawikibooks" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.JrfRQw0oDJ" --verbose' returned non-zero exit status 1 (duration: 00m 21s) | [production] | 
            
  | 14:27 | <hashar@deploy1001> | Started scap: testwiki to php-1.33.0-wmf.20 and rebuild l10n cache # T206674 | [production] | 
            
  | 14:20 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 14:20 | <otto@deploy1001> | scap-helm eventgate-analytics cluster codfw completed | [production] | 
            
  | 14:20 | <otto@deploy1001> | scap-helm eventgate-analytics cluster eqiad completed | [production] | 
            
  | 14:20 | <otto@deploy1001> | scap-helm eventgate-analytics  [namespace: eventgate-analytics, clusters: eqiad,codfw] | [production] | 
            
  | 14:17 | <hashar@deploy1001> | scap failed: LockFailedError Failed to acquire lock "/var/lock/scap.operations_mediawiki-config.lock"; owner is "hashar"; reason is "Pruned MediaWiki: 1.33.0-wmf.14" (duration: 00m 00s) | [production] | 
            
  | 11:59 | <_joe_> | upgrading scap everywhere to 3.9.2-1, T217611 | [production] | 
            
  | 11:45 | <_joe_> | installing new scap version in codfw | [production] | 
            
  | 11:44 | <oblivian@deploy1001> | Synchronized README: Test deploy for new scap version (duration: 00m 48s) | [production] | 
            
  | 11:22 | <_joe_> | uploading new scap packages , T217611 | [production] | 
            
  
    | 2019-03-04
      
      § | 
    
  | 21:58 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 21:58 | <otto@deploy1001> | scap-helm eventgate-analytics cluster codfw completed | [production] | 
            
  | 21:58 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade production stable/eventgate-analytics -f eventgate-analytics-codfw-values.yaml [namespace: eventgate-analytics, clusters: codfw] | [production] | 
            
  | 21:58 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 21:58 | <otto@deploy1001> | scap-helm eventgate-analytics cluster eqiad completed | [production] | 
            
  | 21:58 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade production stable/eventgate-analytics -f eventgate-analytics-eqiad-values.yaml [namespace: eventgate-analytics, clusters: eqiad] | [production] | 
            
  | 21:54 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 21:54 | <otto@deploy1001> | scap-helm eventgate-analytics cluster staging completed | [production] | 
            
  | 21:54 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade staging stable/eventgate-analytics -f eventgate-analytics-staging-values.yaml [namespace: eventgate-analytics, clusters: staging] | [production] | 
            
  | 21:54 | <otto@deploy1001> | scap-helm eventgate-analytics install -n staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] | [production] | 
            
  | 11:04 | <akosiaris@deploy1001> | scap-helm citoid finished | [production] | 
            
  | 11:04 | <akosiaris@deploy1001> | scap-helm citoid cluster codfw completed | [production] | 
            
  | 11:04 | <akosiaris@deploy1001> | scap-helm citoid upgrade -f citoid-codfw-values.yaml production stable/citoid [namespace: citoid, clusters: codfw] | [production] | 
            
  | 11:04 | <akosiaris@deploy1001> | scap-helm citoid cluster eqiad completed | [production] | 
            
  | 11:04 | <akosiaris@deploy1001> | scap-helm citoid finished | [production] | 
            
  | 11:04 | <akosiaris@deploy1001> | scap-helm citoid upgrade -f citoid-eqiad-values.yaml production stable/citoid [namespace: citoid, clusters: eqiad] | [production] | 
            
  | 11:04 | <akosiaris@deploy1001> | scap-helm citoid finished | [production] | 
            
  | 11:04 | <akosiaris@deploy1001> | scap-helm citoid cluster staging completed | [production] | 
            
  | 11:04 | <akosiaris@deploy1001> | scap-helm citoid upgrade -f citoid-staging-values.yaml staging stable/citoid [namespace: citoid, clusters: staging] | [production] | 
            
  | 08:38 | <gilles@deploy1001> | scap failed: average error rate on 7/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) | [production] | 
            
  
    | 2019-02-28
      
      § | 
    
  | 19:36 | <_joe_> | upgrading scap on all servers | [production] | 
            
  | 15:56 | <thcipriani@deploy1001> | Synchronized README: noop sync to test opcache-manager in scap 3.9.1-1 (duration: 00m 53s) | [production] | 
            
  | 15:50 | <thcipriani@deploy1001> | Synchronized README: noop sync scap 3.9.1-1 (duration: 00m 52s) | [production] | 
            
  | 15:49 | <akosiaris@deploy1001> | scap-helm citoid finished | [production] | 
            
  | 15:49 | <akosiaris@deploy1001> | scap-helm citoid cluster staging completed | [production] | 
            
  | 15:48 | <akosiaris@deploy1001> | scap-helm citoid upgrade -f citoid-staging-values.yaml staging stable/citoid [namespace: citoid, clusters: staging] | [production] | 
            
  | 15:46 | <_joe_> | install scap 3.9.1-1 on the deployment servers | [production] | 
            
  | 15:14 | <_joe_> | uploading scap 3.9.1-1 to {stretch,jessie}-wikimedia | [production] | 
            
  | 14:47 | <hashar> | mw1272 fixed by running "scap sync-l10n" from deploy host | [production] | 
            
  | 14:46 | <hashar@deploy1001> | scap sync-l10n completed (1.33.0-wmf.19) (duration: 03m 33s) | [production] |