| 
      
        2019-06-18
      
      ยง
     | 
  
    
  | 13:22 | 
  <ema@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) | 
  [production] | 
            
  | 13:17 | 
  <ema@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) | 
  [production] | 
            
  | 13:12 | 
  <ema@cumin1001> | 
  START - Cookbook sre.hosts.upgrade-and-reboot | 
  [production] | 
            
  | 13:10 | 
  <ema@cumin1001> | 
  START - Cookbook sre.hosts.upgrade-and-reboot | 
  [production] | 
            
  | 13:10 | 
  <ema> | 
  cache nodes: begin rolling reboots for kernel and varnish upgrades T224694 | 
  [production] | 
            
  | 12:59 | 
  <ema@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) | 
  [production] | 
            
  | 12:55 | 
  <ema@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) | 
  [production] | 
            
  | 12:53 | 
  <ema@cumin1001> | 
  START - Cookbook sre.hosts.upgrade-and-reboot | 
  [production] | 
            
  | 12:49 | 
  <ema@cumin1001> | 
  START - Cookbook sre.hosts.upgrade-and-reboot | 
  [production] | 
            
  | 12:49 | 
  <ema> | 
  cp3034 (ats-be upload) cp2002 (varnish-be upload): reboot for kernel and varnish upgrade T224694 | 
  [production] | 
            
  | 12:38 | 
  <ema@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) | 
  [production] | 
            
  | 12:37 | 
  <XioNoX> | 
  merge puppet change to make all router down alerts paging - T224535 | 
  [production] | 
            
  | 12:29 | 
  <ema@cumin1001> | 
  START - Cookbook sre.hosts.upgrade-and-reboot | 
  [production] | 
            
  | 12:27 | 
  <ema> | 
  cp5007 (varnish-be text): reboot for kernel and varnish upgrade T224694 | 
  [production] | 
            
  | 12:23 | 
  <XioNoX> | 
  activate bgp to telia on cr1-codfw - T222967 | 
  [production] | 
            
  | 12:13 | 
  <Urbanecm> | 
  Assigned an email address to Eritha@enwiki per user request (T223960) | 
  [production] | 
            
  | 12:12 | 
  <akosiaris> | 
  slowly rolling restart php7 on mw1299-mw1338 to avoid opcache exhaustion | 
  [production] | 
            
  | 12:03 | 
  <Urbanecm> | 
  EU SWAT done | 
  [production] | 
            
  | 12:03 | 
  <urbanecm@deploy1001> | 
  Synchronized wmf-config/flaggedrevs.php: [[:gerrit:517629|Allow sysops to manage flaggedrevs group membership only if the group exists]] (T225797) (duration: 00m 47s) | 
  [production] | 
            
  | 12:00 | 
  <Urbanecm> | 
  EU SWAT is going a few minutes beyond its slot | 
  [production] | 
            
  | 11:55 | 
  <Urbanecm> | 
  running namespaceDupes.php for eswikibooks (T216143) | 
  [production] | 
            
  | 11:54 | 
  <urbanecm@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: [[:gerrit:516195|Set two new namespace aliases for es.wikibooks]] (T216143) (duration: 00m 47s) | 
  [production] | 
            
  | 11:49 | 
  <akosiaris> | 
  set all termbox backends with weight 10 (from 0) for consistency's sake | 
  [production] | 
            
  | 11:49 | 
  <dcausse@deploy1001> | 
  Synchronized wmf-config/CirrusSearch-common.php: [cirrus] drop most wmgCirrusSearch* ephemeral config vars [3/3] (3/3) (duration: 00m 46s) | 
  [production] | 
            
  | 11:49 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/weight=10; selector: service=termbox | 
  [production] | 
            
  | 11:47 | 
  <dcausse@deploy1001> | 
  Synchronized wmf-config/CirrusSearch-production.php: [cirrus] drop most wmgCirrusSearch* ephemeral config vars [3/3] (2/3) (duration: 00m 47s) | 
  [production] | 
            
  | 11:46 | 
  <dcausse@deploy1001> | 
  Synchronized wmf-config/CommonSettings.php: [cirrus] drop most wmgCirrusSearch* ephemeral config vars [3/3] (1/3) (duration: 00m 47s) | 
  [production] | 
            
  | 11:39 | 
  <akosiaris> | 
  restart pybal on lvs1016 | 
  [production] | 
            
  | 11:39 | 
  <dcausse@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: [cirrus] drop most wmgCirrusSearch* ephemeral config vars [2/3] (duration: 00m 47s) | 
  [production] | 
            
  | 11:38 | 
  <akosiaris> | 
  restart pybal on lvs2003 | 
  [production] | 
            
  | 11:34 | 
  <jijiki> | 
  restarting php-fpm on mwdebug1001 | 
  [production] | 
            
  | 11:29 | 
  <dcausse@deploy1001> | 
  Synchronized wmf-config/CirrusSearch-common.php: [cirrus] drop most wmgCirrusSearch* ephemeral config vars [1/3] (duration: 00m 46s) | 
  [production] | 
            
  | 11:26 | 
  <akosiaris> | 
  pool all hosts for termbox | 
  [production] | 
            
  | 11:26 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: service=termbox | 
  [production] | 
            
  | 11:25 | 
  <dcausse@deploy1001> | 
  Synchronized wmf-config/extension-list: [cirrus] Load cirrus using wfLoadExtension 2/2 (duration: 00m 46s) | 
  [production] | 
            
  | 11:24 | 
  <dcausse@deploy1001> | 
  Synchronized wmf-config/CommonSettings.php: [cirrus] Load cirrus using wfLoadExtension 1/2 (duration: 00m 47s) | 
  [production] | 
            
  | 11:22 | 
  <akosiaris> | 
  set elastic1029 as inactive in all conftool data. Command was sudo confctl select "name=elastic1029.eqiad.wmnet" set/pooled=inactive T214283 | 
  [production] | 
            
  | 11:21 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/pooled=inactive; selector: name=elastic1029.eqiad.wmnet | 
  [production] | 
            
  | 11:15 | 
  <akosiaris> | 
  deploy lvs termbox configuration changes | 
  [production] | 
            
  | 11:12 | 
  <awight@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:516760|Add 'sms' and 'smn' langcodes to commons for use in captions (T222309)]] (duration: 00m 48s) | 
  [production] | 
            
  | 10:58 | 
  <jbond@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | 
  [production] | 
            
  | 10:58 | 
  <jbond@cumin1001> | 
  START - Cookbook sre.hosts.downtime | 
  [production] | 
            
  | 10:57 | 
  <jbond42> | 
  reboot bast1002 | 
  [production] | 
            
  | 10:53 | 
  <jmm@cumin2001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | 
  [production] | 
            
  | 10:53 | 
  <jmm@cumin2001> | 
  START - Cookbook sre.hosts.downtime | 
  [production] | 
            
  | 10:53 | 
  <moritzm> | 
  rebooting pybal-test2001 for some tests with the new 4.9 kernel for jessie | 
  [production] | 
            
  | 10:52 | 
  <jbond@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | 
  [production] | 
            
  | 10:52 | 
  <jbond@cumin1001> | 
  START - Cookbook sre.hosts.downtime | 
  [production] | 
            
  | 10:46 | 
  <jbond@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | 
  [production] | 
            
  | 10:46 | 
  <jbond@cumin1001> | 
  START - Cookbook sre.hosts.downtime | 
  [production] |