| 
      
        2018-12-18
      
      §
     | 
  
    
  | 23:49 | 
  <XioNoX> | 
  remove BGP session to AS50629 from cr2-esams (not in AMS-IX anymore) | 
  [production] | 
            
  | 20:33 | 
  <otto@deploy1001> | 
  Finished deploy [eventlogging/analytics@104adb5]: Send JSON string of event for validation errors in EventError (duration: 00m 04s) | 
  [production] | 
            
  | 20:33 | 
  <otto@deploy1001> | 
  Started deploy [eventlogging/analytics@104adb5]: Send JSON string of event for validation errors in EventError | 
  [production] | 
            
  | 19:43 | 
  <mholloway-shell@deploy1001> | 
  Finished deploy [mobileapps/deploy@963d704]: Parse summaries from lead objects only (T202642) (duration: 05m 26s) | 
  [production] | 
            
  | 19:38 | 
  <mholloway-shell@deploy1001> | 
  Started deploy [mobileapps/deploy@963d704]: Parse summaries from lead objects only (T202642) | 
  [production] | 
            
  | 19:30 | 
  <robh> | 
  migration of ulsfo pdus complete | 
  [production] | 
            
  | 19:19 | 
  <sbisson@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:480106|Production configuration for GrowthExperiments Help Panel]] (duration: 00m 52s) | 
  [production] | 
            
  | 19:06 | 
  <XioNoX> | 
  redirect ns1 back to authdns2001 - T210447 | 
  [production] | 
            
  | 18:51 | 
  <moritzm> | 
  installing libx11 security updates | 
  [production] | 
            
  | 18:48 | 
  <XioNoX> | 
  depool ulsfo - T209101 | 
  [production] | 
            
  | 18:42 | 
  <XioNoX> | 
  repool codfw  - T210447 | 
  [production] | 
            
  | 18:40 | 
  <XioNoX> | 
  Revert "Redirect eqsin/ulsfo caches to eqiad"  - T210447 | 
  [production] | 
            
  | 18:05 | 
  <chasemp> | 
  stat1004:~# umount /mnt/T211327 | 
  [production] | 
            
  | 17:58 | 
  <XioNoX> | 
  shutdown fpc4 for replacement - T210447 | 
  [production] | 
            
  | 17:51 | 
  <bblack> | 
  deploying php7 cache-splitter patch to cache_text - https://gerrit.wikimedia.org/r/c/operations/puppet/+/478680 - T206339 | 
  [production] | 
            
  | 17:49 | 
  <godog> | 
  bounce rsyslog on lithium, tls listener timeout | 
  [production] | 
            
  | 17:34 | 
  <volans> | 
  triggered restart of ircecho on icinga1001 while applying https://gerrit.wikimedia.org/r/480509 | 
  [production] | 
            
  | 16:37 | 
  <jijiki> | 
  librsvg* 2.40.20-3+wmf1+stretch1 uploaded to components/thumor to stretch-wikimedia - T209886 | 
  [production] | 
            
  | 16:22 | 
  <bblack> | 
  powercycle cp1075 from console (crashed, apparently) | 
  [production] | 
            
  | 16:07 | 
  <XioNoX> | 
  starting codfw row A recabling - T210447 | 
  [production] | 
            
  | 16:05 | 
  <ejegg> | 
  updated fundraising python tools from af5dbee8eb to 5f44d9dd43 | 
  [production] | 
            
  | 15:53 | 
  <XioNoX> | 
  redirect ns1 to authdns1001 for T210447 | 
  [production] | 
            
  | 15:47 | 
  <XioNoX> | 
  redirect eqsin/ulsfo caches to eqiad for T210447 | 
  [production] | 
            
  | 15:44 | 
  <XioNoX> | 
  depool codfw for T210447 | 
  [production] | 
            
  | 15:30 | 
  <akosiaris> | 
  empty ganeti2005, ganeti2006 for T210447 | 
  [production] | 
            
  | 15:16 | 
  <Amir1> | 
  mwscript extensions/WikibaseQualityConstraints/maintenance/ImportConstraintEntities.php --wiki=testwikidatawiki --config-format=wgConf | tee WikibaseQualityConstraints-config.php | 
  [production] | 
            
  | 14:55 | 
  <akosiaris> | 
  restart pybal on lvs1006, lvs2003 for blubberoid LVS deployment. T205919 | 
  [production] | 
            
  | 14:40 | 
  <zfilipin@deploy1001> | 
  rebuilt and synchronized wikiversions files: group0 to 1.33.0-wmf.9 | 
  [production] | 
            
  | 14:26 | 
  <akosiaris> | 
  restart ircecho, seems to have croaked with Dec 17 19:39:52 icinga1001 ircecho[861]: UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 174: ordinal not in range(128) | 
  [production] | 
            
  | 14:25 | 
  <zfilipin@deploy1001> | 
  Finished scap: testwiki to php-1.33.0-wmf.9 and rebuild l10n cache (duration: 34m 11s) | 
  [production] | 
            
  | 14:15 | 
  <akosiaris> | 
  restart pybal on lvs1016, lvs2006 for blubberoid LVS deployment. T205919 | 
  [production] | 
            
  | 13:51 | 
  <zfilipin@deploy1001> | 
  Started scap: testwiki to php-1.33.0-wmf.9 and rebuild l10n cache | 
  [production] | 
            
  | 13:48 | 
  <zfilipin@deploy1001> | 
  Pruned MediaWiki: 1.33.0-wmf.4 (duration: 11m 13s) | 
  [production] | 
            
  | 13:12 | 
  <addshore@deploy1001> | 
  Synchronized php-1.33.0-wmf.8/extensions/Wikibase/lib/includes/Formatters/ControlledFallbackEntityIdFormatter.php: T201930 ControlledFallbackEntityIdFormatter, track unique value formats (duration: 00m 46s) | 
  [production] | 
            
  | 12:52 | 
  <Amir1> | 
  deployed a patch on wmf.8 for T207814 | 
  [production] | 
            
  | 12:41 | 
  <filippo@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: (no justification provided) (duration: 00m 45s) | 
  [production] | 
            
  | 12:17 | 
  <zfilipin@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:478630|Perform even more PHP constraint checks before falling back (T209504)]] (duration: 00m 46s) | 
  [production] | 
            
  | 12:16 | 
  <moritzm> | 
  installing fuse updates from stretch point release | 
  [production] | 
            
  | 11:41 | 
  <moritzm> | 
  installing remaining libgd2 security updates | 
  [production] | 
            
  | 09:38 | 
  <godog> | 
  swift eqiad-prod: initial weights for ms-be10[44-50].eqiad.wmnet - T209618 | 
  [production] | 
            
  | 08:44 | 
  <marostegui> | 
  Enable GTID on s7 codfw master (db2040) - T211973 | 
  [production] | 
            
  | 08:26 | 
  <marostegui> | 
  Enable GTID on es3 - T211973 | 
  [production] | 
            
  | 08:23 | 
  <marostegui> | 
  Enable GTID on es2 - T211973 | 
  [production] | 
            
  | 07:57 | 
  <elukey> | 
  restart cassandra-{a,b} on aqs1004 for openjdk upgrades | 
  [production] | 
            
  | 07:49 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1078 T86338 T202167 (duration: 00m 45s) | 
  [production] | 
            
  | 07:49 | 
  <marostegui> | 
  Deploy schema change on db1075 (s3 master) T86338 T202167 | 
  [production] |