| 2019-03-20
      
      ยง | 
    
  | 20:13 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 20:13 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade production -f eventgate-analytics-codfw-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: codfw] | [production] | 
            
  | 20:13 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 20:13 | <otto@deploy1001> | scap-helm eventgate-analytics cluster eqiad completed | [production] | 
            
  | 20:13 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade production -f eventgate-analytics-eqiad-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad] | [production] | 
            
  | 20:07 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 20:07 | <otto@deploy1001> | scap-helm eventgate-analytics cluster staging completed | [production] | 
            
  | 20:07 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] | [production] | 
            
  | 19:38 | <zfilipin@deploy1001> | rebuilt and synchronized wikiversions files: group0 to 1.33.0-wmf.22 | [production] | 
            
  | 19:13 | <otto@deploy1001> | scap-helm eventgate-analytics cluster staging completed | [production] | 
            
  | 19:13 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 19:13 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] | [production] | 
            
  | 19:13 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] | [production] | 
            
  | 19:10 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] | [production] | 
            
  | 19:04 | <zfilipin@deploy1001> | Finished scap: testwiki to php-1.33.0-wmf.22 and rebuild l10n cache (duration: 38m 29s) | [production] | 
            
  | 18:50 | <jijiki> | restarting pdfrender on scb1003 | [production] | 
            
  | 18:49 | <ottomata> | hitting eventgate-analytics in eqiad with ab | [production] | 
            
  | 18:39 | <otto@deploy1001> | scap-helm eventgate-analytics cluster eqiad completed | [production] | 
            
  | 18:39 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 18:39 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade production -f eventgate-analytics-eqiad-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad] | [production] | 
            
  | 18:39 | <otto@deploy1001> | scap-helm eventgate-analytics cluster codfw completed | [production] | 
            
  | 18:39 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 18:39 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade production -f eventgate-analytics-codfw-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: codfw] | [production] | 
            
  | 18:37 | <otto@deploy1001> | scap-helm eventgate-analytics cluster staging completed | [production] | 
            
  | 18:37 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 18:37 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] | [production] | 
            
  | 18:26 | <zfilipin@deploy1001> | Started scap: testwiki to php-1.33.0-wmf.22 and rebuild l10n cache | [production] | 
            
  | 16:44 | <XioNoX> | disable lldp on asw2-a-eqiad:ge-8/0/10 | [production] | 
            
  | 16:25 | <chasemp> | mkdir /srv/dumps/xmldatadumps/public/other/rook for T218587 (fyi apergos) | [production] | 
            
  | 15:55 | <gehel@cumin1001> | END (PASS) - Cookbook sre.elasticsearch.e6-upgrade (exit_code=0) | [production] | 
            
  | 15:52 | <gehel@cumin1001> | START - Cookbook sre.elasticsearch.e6-upgrade | [production] | 
            
  | 15:35 | <gehel@cumin1001> | END (FAIL) - Cookbook sre.elasticsearch.e6-upgrade (exit_code=99) | [production] | 
            
  | 15:35 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1098:3317 (duration: 00m 50s) | [production] | 
            
  | 15:33 | <gehel@cumin1001> | START - Cookbook sre.elasticsearch.e6-upgrade | [production] | 
            
  | 15:24 | <gehel@cumin1001> | END (FAIL) - Cookbook sre.elasticsearch.e6-upgrade (exit_code=99) | [production] | 
            
  | 15:24 | <gehel@cumin1001> | START - Cookbook sre.elasticsearch.e6-upgrade | [production] | 
            
  | 15:23 | <gehel@cumin1001> | START - Cookbook sre.elasticsearch.e6-upgrade | [production] | 
            
  | 15:23 | <gehel@cumin1001> | END (FAIL) - Cookbook sre.elasticsearch.e6-upgrade (exit_code=99) | [production] | 
            
  | 15:22 | <bawolff@deploy1001> | Synchronized wmf-config/wikitech.php: Adjust account stuff at wikitech 4adc89bce4 (duration: 00m 48s) | [production] | 
            
  | 15:20 | <gehel@cumin1001> | END (PASS) - Cookbook sre.elasticsearch.e6-upgrade (exit_code=0) | [production] | 
            
  | 15:20 | <gehel@cumin1001> | START - Cookbook sre.elasticsearch.e6-upgrade | [production] | 
            
  | 15:10 | <gehel@cumin1001> | END (FAIL) - Cookbook sre.elasticsearch.e6-upgrade (exit_code=99) | [production] | 
            
  | 15:09 | <gehel@cumin1001> | START - Cookbook sre.elasticsearch.e6-upgrade | [production] | 
            
  | 15:09 | <gehel@cumin1001> | END (ERROR) - Cookbook sre.elasticsearch.e6-upgrade (exit_code=97) | [production] | 
            
  | 15:08 | <gehel@cumin1001> | START - Cookbook sre.elasticsearch.e6-upgrade | [production] | 
            
  | 14:51 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1098:3317 (duration: 00m 56s) | [production] | 
            
  | 14:35 | <zfilipin@deploy1001> | clean aborted: Pruned MediaWiki: 1.33.0-wmf.17 (duration: 00m 03s) | [production] | 
            
  | 14:02 | <moritzm> | rebooting oresrdb2002 for kernel update | [production] | 
            
  | 13:48 | <godog> | take a snapshot of prometheus data on prometheus1004 | [production] | 
            
  | 13:44 | <zfilipin@deploy1001> | clean aborted: Pruned MediaWiki: 1.33.0-wmf.17 (duration: 00m 05s) | [production] |