| 2016-11-03
      
      § | 
    
  | 14:14 | <moritzm> | temporarily stop exim on fermium for mailman update | [production] | 
            
  | 14:08 | <bblack> | cache_text: nginx lossless restarts for libssl update - T144626 - T148917 | [production] | 
            
  | 14:00 | <mobrovac> | restbase rolling restart for T149114 | [production] | 
            
  | 13:56 | <bblack> | cache_upload: nginx lossless restarts for libssl update - T144626 - T148917 | [production] | 
            
  | 13:49 | <bblack> | cache_maps + cache_misc: nginx lossless restarts for libssl update - T144626 - T148917 | [production] | 
            
  | 13:42 | <bblack> | cp*: upgrade libssl1.1 to 1.1.0b-1+wmf2 (but no nginx restart yet) - T144626 - T148917 | [production] | 
            
  | 13:35 | <bblack> | cp1065: upgrade libssl1.1 to 1.1.0b-1+wmf2 - T144626 - T148917 | [production] | 
            
  | 13:31 | <mobrovac> | change-prop deploying a1bd739 | [production] | 
            
  | 13:06 | <hashar@tin> | Synchronized wmf-config/CommonSettings.php: Add wmgRevisionSliderBetaFeature (default true) (duration: 00m 46s) | [production] | 
            
  | 13:05 | <hashar@tin> | Synchronized wmf-config/InitialiseSettings.php: Add wmgRevisionSliderBetaFeature (default true) (duration: 00m 47s) | [production] | 
            
  | 13:04 | <paravoid> | re-enabling cr2-esams:xe-0/1/3 + cr2-eqiad:xe-4/1/3 (esams-eqiad link) | [production] | 
            
  | 12:09 | <marostegui> | Deploying schema change s4 commonswiki.revision only codfw - https://phabricator.wikimedia.org/T147305 | [production] | 
            
  | 11:54 | <mobrovac> | change-prop deploying 15eae87 | [production] | 
            
  | 11:52 | <mobrovac> | restbase deploy end of 1ec3b129 | [production] | 
            
  | 11:48 | <akosiaris> | reenable puppet across the fleet on hosts that I had disabled it. https://gerrit.wikimedia.org/r/#/c/316032/1 merged successfully | [production] | 
            
  | 11:32 | <mobrovac> | restbase deploy start of 1ec3b129 | [production] | 
            
  | 11:16 | <ema> | depooling cp2016, cp2007, cp2019, cp2023: not caching properly (T131503) | [production] | 
            
  | 10:54 | <akosiaris> | disable puppet throughout the fleet. merging https://gerrit.wikimedia.org/r/#/c/316032/1 | [production] | 
            
  | 09:37 | <moritzm> | uploaded openssl 1.1.0b-1+wmf2 for jessie-wikimedia to apt.wikimedia.org (adding the read_ahead bugfix and dropping the chapoly_pref patch) | [production] | 
            
  | 09:36 | <marostegui> | Deploy schema change s5 dewiki.revision - only codfw https://phabricator.wikimedia.org/T148967 | [production] | 
            
  | 09:24 | <ema> | upgrading cp2016 (text-codfw) to varnish 4 -- T131503 | [production] | 
            
  | 09:17 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=yes; selector: scb2003.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=apertium']) | [production] | 
            
  | 09:17 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=yes; selector: scb2004.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=apertium']) | [production] | 
            
  | 09:16 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=yes; selector: scb1004.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=scb', 'service=apertium']) | [production] | 
            
  | 09:16 | <akosiaris@puppetmaster1001> | conftool action : set/pooled=yes; selector: scb1003.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=scb', 'service=apertium']) | [production] | 
            
  | 09:00 | <hashar> | contint1001: preliminary transfer of jenkins history from gallium using rsync | [production] | 
            
  | 08:51 | <hashar> | gallium: unmounted /var/lib/jenkins/tmpfs freeing 512MBytes. Artifact from the past freeing up 512MBytes of memory | [production] | 
            
  | 08:47 | <ema> | upgrading cp2007 (text-codfw) to varnish 4 -- T131503 | [production] | 
            
  | 08:01 | <ema> | upgrading cp2019 (text-codfw) to varnish 4 -- T131503 | [production] | 
            
  | 07:56 | <jynus> | restarting replication codfw -> eqiad on s1 | [production] | 
            
  | 07:54 | <ema> | repool cp2019 varnish-be, currently depooled for no valid reason | [production] | 
            
  | 07:51 | <jynus> | stopping mysql on db1042 | [production] | 
            
  | 07:42 | <ema> | upgrading cp2023 (text-codfw) to varnish 4 -- T131503 | [production] | 
            
  | 07:38 | <_joe_> | rolling restart of pybal in esams | [production] | 
            
  | 07:30 | <_joe_> | restarting pybal on lvs2005 | [production] | 
            
  | 07:18 | <jynus> | stopping and debugging db1073 | [production] | 
            
  | 06:39 | <yuvipanda> | attempting manual re-image of labstore2004 | [production] | 
            
  | 06:28 | <jynus@tin> | Synchronized wmf-config/db-codfw.php: Remove references to db1042 (duration: 00m 46s) | [production] | 
            
  | 06:22 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1052; Depool db1073; Remove references to db1042 (duration: 00m 47s) | [production] | 
            
  | 03:44 | <Krenair> | wikitech-static package updates | [production] | 
            
  | 03:05 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Thu Nov  3 03:05:05 UTC 2016 (duration 5m 36s) | [production] | 
            
  | 02:59 | <l10nupdate@tin> | scap sync-l10n completed (1.29.0-wmf.1) (duration: 11m 28s) | [production] | 
            
  | 02:30 | <l10nupdate@tin> | scap sync-l10n completed (1.28.0-wmf.23) (duration: 12m 08s) | [production] | 
            
  | 00:28 | <dereckson@tin> | Synchronized php-1.29.0-wmf.1/resources/src/mediawiki.widgets/mw.widgets.TitleWidget.js: Follow-up Id0021594: Remove extra code for redlink suggestions (T149130) (duration: 00m 46s) | [production] | 
            
  | 00:23 | <dereckson@tin> | Synchronized php-1.29.0-wmf.1/extensions/Kartographer/styles/: Set font size to 14px for both static and interactive maps (T149860) (duration: 00m 47s) | [production] |