| 
      
        2018-11-09
      
      §
     | 
  
    
  | 21:46 | 
  <SMalyshev> | 
  repooled wdqs1004 - looks like other servers feel worse so probably makes sense to share the load equally | 
  [production] | 
            
  | 21:16 | 
  <jiji> | 
  Reimaging rdb2003, rdb2004 - T206450 | 
  [production] | 
            
  | 20:46 | 
  <SMalyshev> | 
  depooled wdqs1004 to let it catch up | 
  [production] | 
            
  | 20:40 | 
  <legoktm@deploy1001> | 
  Synchronized docroot/mediawiki/keys/: Add my (20after4) PGP key to mediawiki.org/keys/keys.(txt|html) (duration: 00m 55s) | 
  [production] | 
            
  | 20:08 | 
  <andrewbogott> | 
  restarted neutron-linuxbridge-agent on cloudvirt1018 and cloudvirt1023 | 
  [production] | 
            
  | 19:39 | 
  <banyek|away> | 
  repooling labsdb1011 (T189158) | 
  [production] | 
            
  | 15:23 | 
  <banyek> | 
  depooling labsdb1011 (T189158) | 
  [production] | 
            
  | 15:23 | 
  <banyek> | 
  depooling labsdb1011 | 
  [production] | 
            
  | 15:08 | 
  <banyek> | 
  repooling labsdb1009 (T189158) | 
  [production] | 
            
  | 15:06 | 
  <bblack> | 
  cp1008/pinkunicorn: puppet disabled, public-facing testing of new globalsign 2018 certs | 
  [production] | 
            
  | 15:04 | 
  <ladsgroup@deploy1001> | 
  Finished deploy [ores/deploy@bb39f4b]: T191842 T209060, try II (duration: 14m 43s) | 
  [production] | 
            
  | 14:50 | 
  <andrewbogott> | 
  rebooting cloudvirt1024 to (I hope) cause a page | 
  [production] | 
            
  | 14:49 | 
  <ladsgroup@deploy1001> | 
  Started deploy [ores/deploy@bb39f4b]: T191842 T209060, try II | 
  [production] | 
            
  | 14:48 | 
  <ladsgroup@deploy1001> | 
  deploy aborted: T191842 T209060 (duration: 09m 32s) | 
  [production] | 
            
  | 14:39 | 
  <ladsgroup@deploy1001> | 
  Started deploy [ores/deploy@0728805]: T191842 T209060 | 
  [production] | 
            
  | 14:18 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config: BETA ONLY: Enable SSR termbox for wikibase on beta - T209143 (duration: 00m 56s) | 
  [production] | 
            
  | 13:32 | 
  <moritzm> | 
  rebooting acrab for some qemu tests | 
  [production] | 
            
  | 13:21 | 
  <godog> | 
  upload graphite-web_1.0.2+debian-2.1wmf1 to stretch-wikimedia - T208782 | 
  [production] | 
            
  | 13:10 | 
  <moritzm> | 
  upgrading qemu on ganeti2001 (packages supporting SSBD passthrough) | 
  [production] | 
            
  | 12:40 | 
  <banyek@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: T189158: repool db1106 (duration: 00m 53s) | 
  [production] | 
            
  | 12:34 | 
  <banyek> | 
  repooling db1106 (T208954) | 
  [production] | 
            
  | 12:17 | 
  <kartik@deploy1001> | 
  Finished deploy [cxserver/deploy@fc21164]: Update cxserver to 01686f6 (T208831) (duration: 01m 09s) | 
  [production] | 
            
  | 12:16 | 
  <kartik@deploy1001> | 
  Started deploy [cxserver/deploy@fc21164]: Update cxserver to 01686f6 (T208831) | 
  [production] | 
            
  | 11:45 | 
  <banyek> | 
  data load finished restarting replication on db1106 (T208954) | 
  [production] | 
            
  | 11:43 | 
  <akosiaris> | 
  set previous normal wait for scb1001 for apertium service T206439 | 
  [production] | 
            
  | 11:39 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/weight=8; selector: dc=eqiad,service=apertium,cluster=scb,name=scb1001.* | 
  [production] | 
            
  | 11:30 | 
  <akosiaris> | 
  upgrade apertium apertium-cat apertium-fra apertium-fra-cat apertium-lex-tools apertium-separable cg3 libapertium3-3.5-1 libcg3-1 lttoolbox on all scb boxes and restart apertium-apy | 
  [production] | 
            
  | 11:26 | 
  <akosiaris> | 
  upgrade apertium apertium-cat apertium-fra apertium-fra-cat apertium-lex-tools apertium-separable cg3 libapertium3-3.5-1 libcg3-1 lttoolbox on scb1002 | 
  [production] | 
            
  | 11:22 | 
  <jiji> | 
  switch scb*.eqiad.wmnet nutcracker rdb1003:6382 with rdb1005:6379 | 
  [production] | 
            
  | 10:50 | 
  <vgutierrez> | 
  uploaded certcentral 0.6 to apt.wikimedia.org (stretch) - T208859 T208948 T208967 T208970 | 
  [production] | 
            
  | 09:48 | 
  <ema> | 
  repool cp2018, cp2025 (cache_upload) T208588 | 
  [production] | 
            
  | 09:45 | 
  <banyek> | 
  truncating enwiki.archive on db1124 and labsdb hosts too (T208954) | 
  [production] | 
            
  | 09:21 | 
  <banyek> | 
  stopping replication on db1106 (T208954) | 
  [production] | 
            
  | 09:21 | 
  <banyek> | 
  stopping replication on db1106 (T208672) | 
  [production] | 
            
  | 09:08 | 
  <banyek@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: T189158: depool db1106 (duration: 00m 55s) | 
  [production] | 
            
  | 09:02 | 
  <banyek> | 
  depooling db1106 (T208954) | 
  [production] | 
            
  | 08:28 | 
  <moritzm> | 
  installing nginx security updates | 
  [production] | 
            
  | 08:05 | 
  <ema> | 
  repool cp2006, cp2012 (cache_text) T208588 | 
  [production] | 
            
  | 04:33 | 
  <ejegg> | 
  restarted recurring donation charge jobs | 
  [production] | 
            
  | 04:24 | 
  <ejegg> | 
  updated fundraising CiviCRM from 1154cca3f2 to 71755d021b | 
  [production] | 
            
  | 03:25 | 
  <ejegg> | 
  updated fundraising CiviCRM from 02cc1f80d4 to 1154cca3f2 | 
  [production] | 
            
  | 00:07 | 
  <ejegg> | 
  updated fundraising CiviCRM from 07183ed7cc to 02cc1f80d4 | 
  [production] | 
            
  | 00:03 | 
  <ejegg> | 
  updated payments-wiki from 983ce3af0f to 20542c9184 | 
  [production] |