| 2018-08-02
      
      § | 
    
  | 06:59 | <TimStarling> | on logstash1007 restarting logstash | [production] | 
            
  | 06:58 | <jynus> | stop db1092 for reimage | [production] | 
            
  | 06:53 | <jynus@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1092 (duration: 00m 55s) | [production] | 
            
  | 06:35 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1106 (duration: 00m 55s) | [production] | 
            
  | 06:18 | <marostegui> | Deploy schema change on db1106 with replication, this will generate lag on labsdb:s1 T144010 T51190 T199368 | [production] | 
            
  | 06:17 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1106 (duration: 00m 54s) | [production] | 
            
  | 06:11 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1119 (duration: 00m 55s) | [production] | 
            
  | 06:00 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1119 (duration: 00m 57s) | [production] | 
            
  | 05:30 | <TimStarling> | on mwmaint1001 running populateContentTables.php as described in T183488 | [production] | 
            
  | 05:14 | <TimStarling> | restarted stashbot | [production] | 
            
  | 02:53 | <tstarling@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Enable MCR write-both mode on all wikis (duration: 00m 50s) | [production] | 
            
  | 02:36 | <l10nupdate@deploy1001> | scap sync-l10n completed (1.32.0-wmf.14) (duration: 15m 42s) | [production] | 
            
  
    | 2018-08-01
      
      § | 
    
  | 23:39 | <thcipriani@deploy1001> | Synchronized php-1.32.0-wmf.14/extensions/TimedMediaHandler/WebVideoTranscode/WebVideoTranscodeJob.php: SWAT: [[gerrit:449792|Work around transcode failures in newer ffmpeg]] (duration: 00m 56s) | [production] | 
            
  | 23:37 | <thcipriani@deploy1001> | Synchronized php-1.32.0-wmf.15/extensions/TimedMediaHandler/WebVideoTranscode/WebVideoTranscodeJob.php: SWAT: [[gerrit:449793|Work around transcode failures in newer ffmpeg]] (duration: 00m 57s) | [production] | 
            
  | 23:17 | <thcipriani@deploy1001> | Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:449895|Re-enable VP8 video transcodes to fix playback regression]] (duration: 00m 56s) | [production] | 
            
  | 22:58 | <krinkle@deploy1001> | Synchronized wmf-config: I4db5d03f8af7 (step 2) (duration: 00m 57s) | [production] | 
            
  | 22:57 | <krinkle@deploy1001> | Synchronized wmf-config: I4db5d03f8af7 (step 1) (duration: 00m 57s) | [production] | 
            
  | 20:36 | <twentyafterfour> | T191061 Finished deploying 1.32.0-wmf.15 to group1 wikis. Fatalmonitor is quiet and everything appears to be stable. See you tomorrow for group2. | [production] | 
            
  | 20:24 | <twentyafterfour@deploy1001> | Synchronized php: group1 wikis to 1.32.0-wmf.15  refs T191061 (duration: 00m 55s) | [production] | 
            
  | 20:23 | <twentyafterfour@deploy1001> | rebuilt and synchronized wikiversions files: group1 wikis to 1.32.0-wmf.15  refs T191061 | [production] | 
            
  | 20:17 | <ejegg> | updated payments-wiki from 626ff1cb72 to 0c9c24d30c | [production] | 
            
  | 20:10 | <bsitzmann@deploy1001> | Finished deploy [mobileapps/deploy@c2448e0]: Update mobileapps to 282f368 (T200464 T200459) (duration: 05m 42s) | [production] | 
            
  | 20:04 | <bsitzmann@deploy1001> | Started deploy [mobileapps/deploy@c2448e0]: Update mobileapps to 282f368 (T200464 T200459) | [production] | 
            
  | 19:53 | <twentyafterfour@deploy1001> | Synchronized php-1.32.0-wmf.15/extensions/Collection/: Sync Change: https://gerrit.wikimedia.org/r/449796 Bug: T189636 unblocks: T191061 (duration: 00m 57s) | [production] | 
            
  | 19:07 | <twentyafterfour> | preparing to deploy 1.32.0-wmf.15 to group1 wikis. Gonna merge a couple of patches first to fix some logspam. | [production] | 
            
  | 18:49 | <ejegg|food> | updated DjangoBannerStats from 73d74f1b5e to 02be6cbb74 | [production] | 
            
  | 18:13 | <mobrovac@deploy1001> | Finished deploy [restbase/deploy@4c9966c]: Multi-content bucket: delete old revisions when a new render happens, take #4 (duration: 03m 21s) | [production] | 
            
  | 18:10 | <mobrovac@deploy1001> | Started deploy [restbase/deploy@4c9966c]: Multi-content bucket: delete old revisions when a new render happens, take #4 | [production] | 
            
  | 18:09 | <mobrovac@deploy1001> | Finished deploy [restbase/deploy@4c9966c]: Multi-content bucket: delete old revisions when a new render happens, take #3 (duration: 06m 27s) | [production] | 
            
  | 18:03 | <mobrovac@deploy1001> | Started deploy [restbase/deploy@4c9966c]: Multi-content bucket: delete old revisions when a new render happens, take #3 | [production] | 
            
  | 18:03 | <mobrovac@deploy1001> | Finished deploy [restbase/deploy@4c9966c]: Multi-content bucket: delete old revisions when a new render happens, take #2 (duration: 05m 08s) | [production] | 
            
  | 17:58 | <mobrovac@deploy1001> | Started deploy [restbase/deploy@4c9966c]: Multi-content bucket: delete old revisions when a new render happens, take #2 | [production] | 
            
  | 17:57 | <mobrovac@deploy1001> | Finished deploy [restbase/deploy@4c9966c]: Multi-content bucket: delete old revisions when a new render happens (duration: 12m 23s) | [production] | 
            
  | 17:47 | <ejegg> | updated DjangoBannerStats from 43e47f98a2 to 73d74f1b5e | [production] | 
            
  | 17:45 | <mobrovac@deploy1001> | Started deploy [restbase/deploy@4c9966c]: Multi-content bucket: delete old revisions when a new render happens | [production] | 
            
  | 17:45 | <mobrovac@deploy1001> | Finished deploy [restbase/deploy@4c9966c] (dev-cluster): Multi-content bucket: delete old revisions when a new render happens (duration: 02m 52s) | [production] | 
            
  | 17:42 | <mobrovac@deploy1001> | Started deploy [restbase/deploy@4c9966c] (dev-cluster): Multi-content bucket: delete old revisions when a new render happens | [production] | 
            
  | 17:22 | <aaron@deploy1001> | Synchronized wmf-config/mc.php: Use mcrouter for cache reads for test wikis (duration: 00m 55s) | [production] | 
            
  | 17:19 | <XioNoX> | enable puppet on all cp2* servers after merging https://gerrit.wikimedia.org/r/c/operations/puppet/+/449760 - T195365 | [production] | 
            
  | 16:51 | <mforns> | Finished deploying refinery using scap, then refinery-deploy-to-hdfs | [production] | 
            
  | 16:41 | <vgutierrez> | Turn off AES128-SHA support - T192555 && T147202 | [production] | 
            
  | 16:38 | <thcipriani@deploy1001> | Synchronized php-1.32.0-wmf.14/extensions/PageTriage/modules/ext.pageTriage.views.list/ext.pageTriage.listControlNav.js: SWAT: [[gerrit:449692|Fix namespaces shown in NPP filters]] T200826 T200821 (duration: 00m 55s) | [production] | 
            
  | 16:36 | <thcipriani@deploy1001> | Synchronized php-1.32.0-wmf.15/extensions/PageTriage/modules/ext.pageTriage.views.list/ext.pageTriage.listControlNav.js: SWAT: [[gerrit:449693|Fix namespaces shown in NPP filters]] T200826 T200821 (duration: 00m 58s) | [production] | 
            
  | 16:34 | <mforns@deploy1001> | Finished deploy [analytics/refinery@7fba0fc]: fixing EL sanitization whitelist (duration: 07m 54s) | [production] | 
            
  | 16:26 | <mforns@deploy1001> | Started deploy [analytics/refinery@7fba0fc]: fixing EL sanitization whitelist | [production] | 
            
  | 16:24 | <mforns> | deploying analytics-refinery using scap | [production] | 
            
  | 16:08 | <moritzm> | upgrading proton* to chromium 68.0.3440.75-1~deb9u1 (new release tested successfully in deployment-prep) | [production] | 
            
  | 15:50 | <moritzm> | installing libarchive-zip-perl security updates | [production] | 
            
  | 15:43 | <akosiaris> | upload mapnik_3.0.20+ds-1 to apt.wikimedia.org/stretch-wikimedia/main T200284 | [production] | 
            
  | 15:16 | <XioNoX> | disable puppet on all codfw cp* servers - T195365 | [production] |