| 
      
        2017-10-12
      
      §
     | 
  
    
  | 14:57 | 
  <mutante> | 
  netmon1002 - arming keyholder for rancid deploy | 
  [production] | 
            
  | 14:52 | 
  <mutante> | 
  netmon1002 (librenms, rancid) - rebooting for kernel upgrade | 
  [production] | 
            
  | 14:47 | 
  <moritzm> | 
  rebooting kubernetes workers to new 4.9.51 kernel | 
  [production] | 
            
  | 14:41 | 
  <moritzm> | 
  rebooting kubernetes staging servers to new 4.9.51 kernel | 
  [production] | 
            
  | 14:29 | 
  <moritzm> | 
  rebooting kubernetes masters to new 4.9.51 kernel | 
  [production] | 
            
  | 13:54 | 
  <moritzm> | 
  updating image scalers to librsvg 2.40.18 | 
  [production] | 
            
  | 13:48 | 
  <elukey> | 
  deployed the new Analytics Public Druid cluster - T176223 | 
  [production] | 
            
  | 13:45 | 
  <moritzm> | 
  updating remaining thumbor servers to librsvg 2.40.18 | 
  [production] | 
            
  | 13:40 | 
  <ladsgroup@tin> | 
  Synchronized wmf-config/Wikibase.php: SWAT: Remove deprecated config variable for Wikibase (T129475) (duration: 01m 02s) | 
  [production] | 
            
  | 13:33 | 
  <moritzm> | 
  updating thumbor1001 to librsvg 2.40.18 | 
  [production] | 
            
  | 13:12 | 
  <moritzm> | 
  rolling restart of logstash to pick up thumbor logs (T150734) | 
  [production] | 
            
  | 13:07 | 
  <zeljkof> | 
  EU SWAT finished | 
  [production] | 
            
  | 12:56 | 
  <moritzm> | 
  uploaded librsvg 2.40.18 for jessie-wikimedia to apt.wikimedia.org | 
  [production] | 
            
  | 11:46 | 
  <ema> | 
  upgrading cp3010 to Varnish 5 T177233 | 
  [production] | 
            
  | 11:27 | 
  <Amir1> | 
  finished cleanup of ores_classification in wikidatawiki, still needs more work (T159753) | 
  [production] | 
            
  | 10:03 | 
  <ema> | 
  lvs1005: upgrade pybal to 1.14.1 T177815 | 
  [production] | 
            
  | 10:02 | 
  <ema> | 
  pybal 1.14.1 uploaded to apt.w.o | 
  [production] | 
            
  | 09:40 | 
  <ema> | 
  upgrading cp3008 to Varnish 5 T177233 | 
  [production] | 
            
  | 09:06 | 
  <moritzm> | 
  installing nettle update from stretch 9.2 point release | 
  [production] | 
            
  | 09:01 | 
  <moritzm> | 
  installing ncurses security updates | 
  [production] | 
            
  | 08:25 | 
  <moritzm> | 
  installing gnutls28 update from stretch 9.2 point release | 
  [production] | 
            
  | 08:02 | 
  <Amir1> | 
  starting cleanup of ores_classification in wikidatawiki (T159753) | 
  [production] | 
            
  | 07:51 | 
  <gehel> | 
  reinitialize cassandra on maps-test2004 to test vector tiles - T153282 | 
  [production] | 
            
  | 07:40 | 
  <moritzm> | 
  installing at-spi2-core update from stretch 9.2 point release | 
  [production] | 
            
  | 07:24 | 
  <moritzm> | 
  installing gnupg2 update from stretch 9.2 point release | 
  [production] | 
            
  | 07:18 | 
  <legoktm> | 
  purging html5-misnesting linter entries from database on terbium (T178040) | 
  [production] | 
            
  | 03:25 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Thu Oct 12 03:25:17 UTC 2017 (duration 7m 17s) | 
  [production] | 
            
  | 03:18 | 
  <l10nupdate@tin> | 
  scap sync-l10n completed (1.31.0-wmf.3) (duration: 15m 57s) | 
  [production] | 
            
  | 02:41 | 
  <l10nupdate@tin> | 
  scap sync-l10n completed (1.31.0-wmf.2) (duration: 15m 39s) | 
  [production] | 
            
  | 00:30 | 
  <twentyafterfour> | 
  phabricator update finished (a while ago, I forgot to log it) | 
  [production] | 
            
  | 00:08 | 
  <twentyafterfour> | 
  upgrading phabricator to #phab-2017-10-11 | 
  [production] | 
            
  | 00:05 | 
  <mutante> | 
  netmon2001 arm keyholder for rancid deploy | 
  [production] | 
            
  | 00:01 | 
  <twentyafterfour> | 
  Preparing to take phabricator offline for a hopefully momentary upgrade. | 
  [production] | 
            
  
    | 
      
        2017-10-11
      
      §
     | 
  
    
  | 23:55 | 
  <mutante> | 
  netmon2001 - smokeping back up - the reboot, as a side-effect, also resolved the systemd-icinga-alert that was pending in Icinga for a while with comments | 
  [production] | 
            
  | 23:52 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:383491|Enable Vector print logo and print styles on all wikis]] T169732 PART II (duration: 00m 50s) | 
  [production] | 
            
  | 23:50 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:383491|Enable Vector print logo and print styles on all wikis]] T169732 PART I (duration: 00m 50s) | 
  [production] | 
            
  | 23:47 | 
  <mutante> | 
  netmon2001 (smokeping) - kernel upgrade, schedule downtime, reboot | 
  [production] | 
            
  | 23:40 | 
  <thcipriani@tin> | 
  Synchronized php-1.31.0-wmf.2/skins/Vector/ResourceLoaderLessModule.php: SWAT: [[gerrit:383706|Print logo should use an absolute URI]] T177800 (duration: 00m 49s) | 
  [production] | 
            
  | 23:38 | 
  <mutante> | 
  netmon1003 - servermon back up - apt-get autoremove to drop unrequired python packages | 
  [production] | 
            
  | 23:37 | 
  <thcipriani@tin> | 
  Synchronized php-1.31.0-wmf.3/skins/Vector/ResourceLoaderLessModule.php: SWAT: [[gerrit:383706|Print logo should use an absolute URI]] T177800 (duration: 00m 50s) | 
  [production] | 
            
  | 23:35 | 
  <mutante> | 
  netmon1003 - cant seem to reboot normally, attempting via gnt-instance command | 
  [production] | 
            
  | 23:31 | 
  <mutante> | 
  netmon1003 (servermon) - upgrading kernel (jessie), schedule icinga downtime, rebooting, short downtime for servermon itself | 
  [production] | 
            
  | 23:31 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:383653|Parser: Switch from Tidy to Remex on nowiki]] T177989 (duration: 00m 50s) | 
  [production] | 
            
  | 23:27 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:383652|Parser: Switch from Tidy to Remex on fawiki]] T176150 (duration: 00m 50s) | 
  [production] | 
            
  | 23:23 | 
  <thcipriani@tin> | 
  Synchronized php-1.31.0-wmf.3/extensions/VisualEditor/modules/ve-mw/init/styles/ve.init.MWVESwitchConfirmDialog.css: SWAT: [[gerrit:383618|Fix WikiEditor mode switcher widget]] (duration: 00m 50s) | 
  [production] | 
            
  | 23:19 | 
  <thcipriani@tin> | 
  Synchronized php-1.31.0-wmf.2/includes/specials/SpecialUnblock.php: SWAT: [[gerrit:383635|Fix unblocking autoblocks]] T177952 (duration: 00m 50s) | 
  [production] | 
            
  | 23:18 | 
  <mutante> | 
  releases1001 upgrading kernel, installed linux-image-amd64, took out of cache::misc, upgrade libnss3, scheduled downtime, rebooting ... | 
  [production] | 
            
  | 23:17 | 
  <thcipriani@tin> | 
  Synchronized php-1.31.0-wmf.3/includes/specials/SpecialUnblock.php: SWAT: [[gerrit:383634|Fix unblocking autoblocks]] T177952 (duration: 00m 51s) | 
  [production] | 
            
  | 22:01 | 
  <volans> | 
  uploaded cumin_1.2.2-1_amd64.deb to apt.wikimedia.org jessie-wikimedia | 
  [production] | 
            
  | 21:44 | 
  <robh> | 
  cp4009 shutdown accidental, will boot back up immediately | 
  [production] |