| 2018-07-19
      
      § | 
    
  | 07:50 | <jynus> | stop es1019 and reimage it | [production] | 
            
  | 07:48 | <jynus@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool es1019 (duration: 00m 54s) | [production] | 
            
  | 07:43 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3312 after MySQL upgrade (duration: 00m 55s) | [production] | 
            
  | 07:26 | <moritzm> | removing cdrom and sr_mod (related module) kernel modules across the fleet (following the blacklisting of the kernel module via puppet) | [production] | 
            
  | 06:00 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3312 after MySQL upgrade (duration: 00m 54s) | [production] | 
            
  | 05:44 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3312 after MySQL upgrade (duration: 00m 55s) | [production] | 
            
  | 05:30 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Slowly repool db1103:3312 after MySQL upgrade (duration: 00m 54s) | [production] | 
            
  | 05:14 | <marostegui> | Stop MySQL on db1103 to upgrade MySQL | [production] | 
            
  | 05:11 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1103:3312 for MySQL upgrade (duration: 00m 56s) | [production] | 
            
  | 04:12 | <kart_> | Finished ContentTranslation draft purge script on mwmaint1001 (T199658) | [production] | 
            
  | 04:05 | <kart_> | Starting ContentTranslation draft purge script on mwmaint1001, dry run first and then --really | [production] | 
            
  | 03:57 | <krinkle@deploy1001> | Synchronized wmf-config/CommonSettings.php: I978f3eda8 - Farewell temporary hack from 2013 (duration: 00m 56s) | [production] | 
            
  | 03:20 | <ejegg> | updated CiviCRM from b21d783e7f to 6f311f48d9 | [production] | 
            
  | 03:09 | <l10nupdate@deploy1001> | ResourceLoader cache refresh completed at Thu Jul 19 03:09:19 UTC 2018 (duration 10m 35s) | [production] | 
            
  | 02:58 | <l10nupdate@deploy1001> | scap sync-l10n completed (1.32.0-wmf.13) (duration: 15m 05s) | [production] | 
            
  | 02:24 | <l10nupdate@deploy1001> | scap sync-l10n completed (1.32.0-wmf.12) (duration: 10m 41s) | [production] | 
            
  
    | 2018-07-18
      
      § | 
    
  | 23:35 | <thcipriani@deploy1001> | Synchronized php-1.32.0-wmf.13/includes/logging/LogEventsList.php: SWAT: [[gerrit:446635|LogEventsList: Use GET in HTMLForm]] T199856 (duration: 00m 54s) | [production] | 
            
  | 23:33 | <thcipriani@deploy1001> | Synchronized php-1.32.0-wmf.13/extensions/VisualEditor/modules/ve-mw/ui/dialogs/ve.ui.MWMediaDialog.js: SWAT: [[gerrit:446529|ve.ui.MWMediaDialog: Fix confusion between #getSetupProcess and #getReadyProcess]] T185944 T199841 (duration: 00m 56s) | [production] | 
            
  | 22:16 | <ejegg> | updated SmashPig payments listener from 2b4186715e to 2736e41045 | [production] | 
            
  | 19:24 | <reedy@deploy1001> | Synchronized wmf-config/CommonSettings.php: Unset wgVipsThumbnailHost T199937 (duration: 00m 55s) | [production] | 
            
  | 16:28 | <catrope@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Enable new backend for Special:Tags on fawikisource (T199334) (duration: 00m 54s) | [production] | 
            
  | 16:14 | <catrope@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Enable ORES on testwiki (T199913) (duration: 00m 55s) | [production] | 
            
  | 15:25 | <volans> | installing conftool 1.0.1 on jessie and stretch | [production] | 
            
  | 14:50 | <mobrovac@deploy1001> | Finished deploy [eventstreams/deploy@09f0efe]: Set the maximum rdkafka receive buffer size to 64MB - T199813 (duration: 02m 28s) | [production] | 
            
  | 14:48 | <mobrovac@deploy1001> | Started deploy [eventstreams/deploy@09f0efe]: Set the maximum rdkafka receive buffer size to 64MB - T199813 | [production] | 
            
  | 14:47 | <marostegui> | Partition commonswiki.logging table on db1103:3314 - T199790 | [production] | 
            
  | 14:46 | <volans@sarin> | conftool action : set/pooled=yes; selector: name=mw2224.codfw.wmnet | [production] | 
            
  | 14:43 | <volans> | uploaded conftool (with python-conftool and python3-conftool) version 1.0.1 for jessie and stretch to apt.w.o | [production] | 
            
  | 14:42 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1103:3314 for alter table - T199790 (duration: 00m 52s) | [production] | 
            
  | 14:37 | <moritzm> | rebooting poolcounter2001 for some tests | [production] | 
            
  | 14:22 | <moritzm> | rebooting vega for some tests | [production] | 
            
  | 13:59 | <anomie@deploy1001> | Synchronized wmf-config/InitialiseSettings-labs.php: Sync labs config file, no prod impact (duration: 00m 54s) | [production] | 
            
  | 13:53 | <moritzm> | installing ruby2.1 security updates for jessie | [production] | 
            
  | 13:17 | <marostegui> | Deploy schema change on db1052 - T187089 | [production] | 
            
  | 13:13 | <zfilipin@deploy1001> | Synchronized php: group1 wikis to 1.32.0-wmf.13 (duration: 00m 53s) | [production] | 
            
  | 13:13 | <zfilipin@deploy1001> | rebuilt and synchronized wikiversions files: group1 wikis to 1.32.0-wmf.13 | [production] | 
            
  | 12:58 | <marostegui> | Stop MySQL on db1052 to upgrade socket and MySQL | [production] | 
            
  | 12:57 | <elukey> | restart eventstreams on scb200[5,6] as precautionary after mem consumption too high | [production] | 
            
  | 12:57 | <elukey> | restart eventstreams on scb2003 as precautionary after mem consumption too high | [production] | 
            
  | 12:56 | <elukey> | restart eventstreams on scb2001 as precautionary after mem consumption too high (still investigating a fix) | [production] | 
            
  | 12:54 | <dcausse> | T156137: unbanning elastic1030 | [production] | 
            
  | 12:52 | <dcausse> | T156137: restarting elastic1030 to disable G1GC | [production] | 
            
  | 12:51 | <moritzm> | installing PHP5 security updates (remaining hosts which only use -cli) | [production] | 
            
  | 12:48 | <moritzm> | installing PHP security updates on tungsten | [production] | 
            
  | 12:36 | <moritzm> | installing PHP security updates on icinga.wikimedia.org | [production] | 
            
  | 12:24 | <elukey> | manually added queued.max.messages.kbytes: 65535 to eventstreams on scb2002 as test for T199813 | [production] | 
            
  | 12:16 | <moritzm> | installing PHP security updates on yubiauth servers | [production] | 
            
  | 12:02 | <moritzm> | installing PHP security update on bohrium | [production] | 
            
  | 11:35 | <moritzm> | installing imagemagick security updates | [production] | 
            
  | 11:34 | <zeljkof> | EU SWAT finished | [production] |