| 
      
        2017-08-02
      
      §
     | 
  
    
  | 17:44 | 
  <mobrovac@tin> | 
  Started deploy [cxserver/deploy@f43ef96]: Revert canary scb2001 to f43ef963, take #2 | 
  [production] | 
            
  | 17:44 | 
  <mobrovac@tin> | 
  Finished deploy [cxserver/deploy@f43ef96]: Revert canary scb2001 to f43ef963 (duration: 00m 29s) | 
  [production] | 
            
  | 17:43 | 
  <mobrovac@tin> | 
  Started deploy [cxserver/deploy@f43ef96]: Revert canary scb2001 to f43ef963 | 
  [production] | 
            
  | 17:26 | 
  <mobrovac@tin> | 
  Finished deploy [recommendation-api/deploy@8dfae34]: (no justification provided) (duration: 01m 36s) | 
  [production] | 
            
  | 17:25 | 
  <mobrovac@tin> | 
  Started deploy [recommendation-api/deploy@8dfae34]: (no justification provided) | 
  [production] | 
            
  | 17:18 | 
  <herron> | 
  installed libmail-spf-perl and restarted spamassassin service on mx[1,2]001 - T172299 | 
  [production] | 
            
  | 16:45 | 
  <gehel@puppetmaster1001> | 
  conftool action : set/pooled=no; selector: name=elastic10(24|25|26|27).eqiad.wmnet | 
  [production] | 
            
  | 16:43 | 
  <gehel> | 
  depooling and shutting down elastic102[4567] - T168816 | 
  [production] | 
            
  | 15:34 | 
  <mobrovac@tin> | 
  Finished deploy [cxserver/deploy@cf3e280]: (no justification provided) (duration: 00m 22s) | 
  [production] | 
            
  | 15:34 | 
  <mobrovac@tin> | 
  Started deploy [cxserver/deploy@cf3e280]: (no justification provided) | 
  [production] | 
            
  | 15:18 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Change db2051 IP - T169501 (duration: 00m 46s) | 
  [production] | 
            
  | 15:17 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-codfw.php: Change db2051 IP - T169501 (duration: 00m 46s) | 
  [production] | 
            
  | 15:17 | 
  <nschaaf@tin> | 
  Finished deploy [recommendation-api/deploy@baa11c0]: source parameter validation (duration: 03m 22s) | 
  [production] | 
            
  | 15:14 | 
  <nschaaf@tin> | 
  Started deploy [recommendation-api/deploy@baa11c0]: source parameter validation | 
  [production] | 
            
  | 15:06 | 
  <marostegui> | 
  Poweroff db2051 to get it move to another rack - T169501 | 
  [production] | 
            
  | 14:46 | 
  <ema> | 
  upgrading cache_misc to varnish 4.1.8-1wm1 | 
  [production] | 
            
  | 14:31 | 
  <ema> | 
  varnish 4.1.8-1wm1 (fixes VSV00001, DSA 3924-1) built and uploaded to apt.w.o | 
  [production] | 
            
  | 14:12 | 
  <marostegui> | 
  Stop MySQL on db2051 in order to get it ready to move to another rack - T170351 | 
  [production] | 
            
  | 13:16 | 
  <hashar@tin> | 
  Synchronized wmf-config/Wikibase-production.php: Write to term_full_entity_id column in wb_terms table in prod too - T167229 (duration: 00m 46s) | 
  [production] | 
            
  | 13:07 | 
  <hashar@tin> | 
  Synchronized php-1.30.0-wmf.12/extensions/Wikidata: fix constraint type checks - T169326 (duration: 02m 13s) | 
  [production] | 
            
  | 12:59 | 
  <gehel> | 
  banning elastic102[67] - T168816 | 
  [production] | 
            
  | 12:41 | 
  <gehel> | 
  banning elastic102[45] - T168816 | 
  [production] | 
            
  | 11:42 | 
  <jynus> | 
  disabling autolearn on newest db1* hosts | 
  [production] | 
            
  | 11:39 | 
  <jynus> | 
  disabling autolearn on newest db2* hosts | 
  [production] | 
            
  | 11:33 | 
  <marostegui> | 
  Stop MySQL on db2051 for maintenance - T170351 | 
  [production] | 
            
  | 11:29 | 
  <jynus> | 
  setting all es hosts with disabled auto-learn bbu properties | 
  [production] | 
            
  | 11:22 | 
  <kartik@tin> | 
  (no justification provided) | 
  [production] | 
            
  | 11:21 | 
  <kartik@tin> | 
  (no justification provided) | 
  [production] | 
            
  | 11:19 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-codfw.php: Depool db2051 - T170351 (duration: 00m 46s) | 
  [production] | 
            
  | 11:18 | 
  <kartik@tin> | 
  Finished deploy [cxserver/deploy@cf3e280]: Update cxserver to fe03ad7 (duration: 00m 56s) | 
  [production] | 
            
  | 11:17 | 
  <kartik@tin> | 
  Started deploy [cxserver/deploy@cf3e280]: Update cxserver to fe03ad7 | 
  [production] | 
            
  | 11:12 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-codfw.php: Depool es2013 (duration: 00m 47s) | 
  [production] | 
            
  | 11:02 | 
  <hashar> | 
  Upgraded tox on CI to 2.5.0 | 
  [production] | 
            
  | 10:49 | 
  <marostegui> | 
  Force a re-learn cycle on es2013 | 
  [production] | 
            
  | 10:18 | 
  <marostegui> | 
  Rename wikigrok tables on enwiki on db1089 - T172020 | 
  [production] | 
            
  | 09:03 | 
  <marostegui> | 
  Drop table click_tracking_user_properties wherever it exists - T115982 | 
  [production] | 
            
  | 09:02 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-codfw.php: Repool db2057 - T170662 (duration: 00m 46s) | 
  [production] | 
            
  | 08:51 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Add db2073 to s4 - T170662 (duration: 00m 47s) | 
  [production] | 
            
  | 08:50 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-codfw.php: Add db2073 to s4 - T170662 (duration: 00m 57s) | 
  [production] | 
            
  | 08:32 | 
  <marostegui> | 
  Drop table click_tracking wherever it exists - T115982 | 
  [production] | 
            
  | 08:15 | 
  <godog> | 
  bounce pdfrender on scb1001, stuck | 
  [production] | 
            
  | 07:09 | 
  <marostegui> | 
  Disable BBU auto-learn on es2013 | 
  [production] | 
            
  | 06:58 | 
  <marostegui> | 
  Stop MySQL on db2057 for maintenance - T148507 | 
  [production] | 
            
  | 06:50 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1055 - T166204 (duration: 00m 45s) | 
  [production] | 
            
  | 05:47 | 
  <demon@tin> | 
  Synchronized dblists/: No-op (duration: 00m 47s) | 
  [production] | 
            
  | 02:59 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Wed Aug  2 02:59:33 UTC 2017 (duration 7m 3s) | 
  [production] | 
            
  | 02:52 | 
  <l10nupdate@tin> | 
  scap sync-l10n completed (1.30.0-wmf.12) (duration: 05m 54s) | 
  [production] | 
            
  | 02:36 | 
  <eileen> | 
  update process-control to 3d3978ad86e077911e558b986d0635caf2 | 
  [production] | 
            
  | 02:27 | 
  <l10nupdate@tin> | 
  scap sync-l10n completed (1.30.0-wmf.11) (duration: 07m 35s) | 
  [production] |