| 2017-12-13
      
      § | 
    
  | 14:03 | <akosiaris> | gnt-node remove ganeti1006 T181121 | [production] | 
            
  | 14:01 | <elukey> | restart Yarn nodemanagers on analytics102[8,9] to apply new settings - T182276 | [production] | 
            
  | 13:21 | <moritzm> | uploaded prometheus-pdns-rec-exporter 0.2-1 to apt.wikimedia.org | [production] | 
            
  | 13:10 | <marostegui> | Deploy schema change on s4 - dbstore1002 - T174569 | [production] | 
            
  | 12:53 | <marostegui> | Deploy alter table on s4 db1064 (sanitarium master) with replication, this will generate lag on labs replicas - T174569 | [production] | 
            
  | 12:53 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1103:3314 - T174569 (duration: 01m 36s) | [production] | 
            
  | 12:19 | <moritzm> | uploaded prometheus-ircd-exporter and prometheus-pdns-rec-exporter to apt.wikimedia.org | [production] | 
            
  | 11:59 | <elukey> | forced remount of /mnt/hdfs after OOM event on stat1005 | [production] | 
            
  | 11:41 | <akosiaris> | empty ganeti1006 for reimage after ltpstress and bios upgrades T181121 | [production] | 
            
  | 11:16 | <mobrovac@tin> | Finished deploy [graphoid/deploy@7979a40]: Update to service-template-node v0.5.4 (duration: 03m 56s) | [production] | 
            
  | 11:12 | <mobrovac@tin> | Started deploy [graphoid/deploy@7979a40]: Update to service-template-node v0.5.4 | [production] | 
            
  | 10:19 | <mobrovac@tin> | Finished deploy [recommendation-api/deploy@ac66089]: Update to service-template-node v0.5.4 (duration: 02m 20s) | [production] | 
            
  | 10:17 | <mobrovac@tin> | Started deploy [recommendation-api/deploy@ac66089]: Update to service-template-node v0.5.4 | [production] | 
            
  | 09:41 | <godog> | upload prometheus-elasticsearch-exporter to jessie-wikimedia - T181627 | [production] | 
            
  | 08:38 | <jynus> | migrate away from ganeti1008 | [production] | 
            
  | 06:26 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1103:3314 - T174569 (duration: 01m 11s) | [production] | 
            
  | 06:25 | <marostegui> | Deploy schema change on db1103:3314 - T174569 | [production] | 
            
  | 06:12 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1097:3314 - T174569 (duration: 01m 08s) | [production] | 
            
  | 02:26 | <l10nupdate@tin> | scap sync-l10n completed (1.31.0-wmf.11) (duration: 07m 02s) | [production] | 
            
  | 00:49 | <ebernhardson@tin> | Synchronized php-1.31.0-wmf.11/extensions/WikimediaEvents/: SWAT: T182616: turn on second mlr ab test for hewiki (duration: 01m 08s) | [production] | 
            
  | 00:44 | <ebernhardson@tin> | Synchronized php-1.31.0-wmf.12/extensions/WikimediaEvents/: SWAT: T182616: turn on second mlr ab test for hewiki (duration: 01m 08s) | [production] | 
            
  | 00:40 | <ebernhardson@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Turn on cirrus MLR for most wikis with >1% of search traffic (duration: 01m 08s) | [production] | 
            
  | 00:35 | <mholloway-shell@tin> | Finished deploy [mobileapps/deploy@5832a8c]: Update mobileapps to bfc3588 (duration: 04m 48s) | [production] | 
            
  | 00:32 | <brion> | restarted requeueTranscodes.php on terbium for mp3 audio generation backfill (had dropped DB connection) | [production] | 
            
  | 00:31 | <mholloway-shell@tin> | Started deploy [mobileapps/deploy@5832a8c]: Update mobileapps to bfc3588 | [production] | 
            
  | 00:05 | <ebernhardson@tin> | Synchronized wmf-config/: SWAT: T182616: Setup MLR AB test for hewiki (duration: 01m 10s) | [production] | 
            
  
    | 2017-12-12
      
      § | 
    
  | 22:30 | <mholloway-shell@tin> | Finished deploy [mobileapps/deploy@ea8f05d]: Update mobileapps to 94f267b (duration: 05m 10s) | [production] | 
            
  | 22:24 | <mholloway-shell@tin> | Started deploy [mobileapps/deploy@ea8f05d]: Update mobileapps to 94f267b | [production] | 
            
  | 22:02 | <urandom> | setting compaction throughput to 5 MB/s, restbase1010 | [production] | 
            
  | 21:31 | <mutante> | releases1001 - rm mediawiki core repo and let puppet try to recreate it (follow-up issue after gerrit:397891) | [production] | 
            
  | 21:28 | <mobrovac@tin> | Finished deploy [restbase/deploy@dceab2e]: Switch to Parsoid content v1.6.0 and switch to Cassandra 3 storage - T179417 (duration: 04m 16s) | [production] | 
            
  | 21:27 | <demon@tin> | Synchronized php-1.31.0-wmf.12/extensions/GlobalBlocking/: (no justification provided) (duration: 01m 07s) | [production] | 
            
  | 21:26 | <mholloway-shell@tin> | Finished deploy [mobileapps/deploy@28bfda3]: Update mobileapps to d0ee651 (duration: 01m 45s) | [production] | 
            
  | 21:24 | <demon@tin> | Synchronized php-1.31.0-wmf.11/extensions/GlobalBlocking/: (no justification provided) (duration: 01m 08s) | [production] | 
            
  | 21:24 | <mholloway-shell@tin> | Started deploy [mobileapps/deploy@28bfda3]: Update mobileapps to d0ee651 | [production] | 
            
  | 21:24 | <mholloway-shell@tin> | Finished deploy [mobileapps/deploy@b2d5b8e]: Update mobileapps to 172abc7 (duration: 00m 30s) | [production] | 
            
  | 21:24 | <mholloway-shell@tin> | Started deploy [mobileapps/deploy@b2d5b8e]: Update mobileapps to 172abc7 | [production] | 
            
  | 21:23 | <mobrovac@tin> | Started deploy [restbase/deploy@dceab2e]: Switch to Parsoid content v1.6.0 and switch to Cassandra 3 storage - T179417 | [production] | 
            
  | 21:21 | <ppchelko@tin> | Finished deploy [restbase/deploy@dceab2e]: Bump expected parsoid version, but do not switch summaries, take 4 (duration: 02m 45s) | [production] | 
            
  | 21:18 | <ppchelko@tin> | Started deploy [restbase/deploy@dceab2e]: Bump expected parsoid version, but do not switch summaries, take 4 | [production] | 
            
  | 21:15 | <ppchelko@tin> | Finished deploy [restbase/deploy@dceab2e]: Bump expected parsoid version, but do not switch summaries, take 3 (duration: 02m 04s) | [production] | 
            
  | 21:13 | <ppchelko@tin> | Started deploy [restbase/deploy@dceab2e]: Bump expected parsoid version, but do not switch summaries, take 3 | [production] | 
            
  | 21:13 | <ppchelko@tin> | Finished deploy [restbase/deploy@dceab2e]: Bump expected parsoid version, but do not switch summaries, take 2 after failed content rerender (duration: 05m 05s) | [production] | 
            
  | 21:12 | <mobrovac@tin> | Started restart [electron-render/deploy@94d27d7]: Electron hanging - T174916 | [production] | 
            
  | 21:08 | <ppchelko@tin> | Started deploy [restbase/deploy@dceab2e]: Bump expected parsoid version, but do not switch summaries, take 2 after failed content rerender | [production] | 
            
  | 21:08 | <ppchelko@tin> | Finished deploy [restbase/deploy@dceab2e]: Bump expected parsoid version, but do not switch summaries (duration: 05m 51s) | [production] | 
            
  | 21:02 | <ppchelko@tin> | Started deploy [restbase/deploy@dceab2e]: Bump expected parsoid version, but do not switch summaries | [production] | 
            
  | 20:55 | <ppchelko@tin> | Finished deploy [restbase/deploy@d3ca789]: Revert deployment for using MCS for summaries (duration: 01m 36s) | [production] | 
            
  | 20:53 | <ppchelko@tin> | Started deploy [restbase/deploy@d3ca789]: Revert deployment for using MCS for summaries | [production] | 
            
  | 20:53 | <demon@tin> | rebuilt and synchronized wikiversions files: group0 to wmf.12 | [production] |