| 
      
        2018-11-07
      
      §
     | 
  
    
  | 17:25 | 
  <sbisson@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:471947|Inject wikidata rc records on wikidata itself]] (duration: 00m 53s) | 
  [production] | 
            
  | 17:21 | 
  <sbisson@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:472034|Enable WMEUnderstandingFirstDay on testwiki]] (duration: 00m 53s) | 
  [production] | 
            
  | 16:37 | 
  <XioNoX> | 
  remove asw-c-codfw FPC8 from config - T208272 | 
  [production] | 
            
  | 16:35 | 
  <XioNoX> | 
  shutdown asw-c-codfw FPC8 - T208272 | 
  [production] | 
            
  | 16:33 | 
  <jforrester@deploy1001> | 
  Synchronized php-1.33.0-wmf.3/resources/src/mediawiki.rcfilters/styles/mw.rcfilters.ui.less: T208898 Hot-deploy to wmf.3 (duration: 00m 53s) | 
  [production] | 
            
  | 16:21 | 
  <jforrester@deploy1001> | 
  Synchronized php-1.33.0-wmf.3/extensions/Echo/modules/styles: Hot-deploy T208930 to wmf.3 (duration: 00m 54s) | 
  [production] | 
            
  | 16:20 | 
  <XioNoX> | 
  Enable all VC ports (except uplinks) on spines - T208272 | 
  [production] | 
            
  | 15:58 | 
  <XioNoX> | 
  Redirect eqsin/ulsfo caches to eqiad - T208272 | 
  [production] | 
            
  | 15:57 | 
  <XioNoX> | 
  depool codfw for row C maintenance - T208272 | 
  [production] | 
            
  | 15:36 | 
  <moritzm> | 
  installing Java security updates on relforge* | 
  [production] | 
            
  | 15:29 | 
  <jiji@deploy1001> | 
  Synchronized wmf-config/ProductionServices.php: Remove jobqueue_redis references, T198220 (duration: 00m 54s) | 
  [production] | 
            
  | 15:21 | 
  <akosiaris> | 
  T206439 direct 30% of the apertium.svc.eqiad.wmnet traffic to scb1001. Will increase tomorrow to 50% | 
  [production] | 
            
  | 15:20 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/weight=15; selector: dc=eqiad,service=apertium,cluster=scb,name=scb1001.* | 
  [production] | 
            
  | 15:16 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: dc=eqiad,service=apertium,cluster=scb,name=scb1001.* | 
  [production] | 
            
  | 15:15 | 
  <akosiaris> | 
  T206439 pool upgraded scb1001 to apertium.svc.eqiad.wmnet as a form of canary | 
  [production] | 
            
  | 15:13 | 
  <moritzm> | 
  uploaded nginx 1.13.6-2+wmf2 to apt.wikimedia.org/stretch-wikimedia | 
  [production] | 
            
  | 14:55 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/pooled=no; selector: dc=eqiad,service=apertium,cluster=scb,name=scb1001.* | 
  [production] | 
            
  | 14:37 | 
  <oblivian@deploy1001> | 
  Synchronized docroot/wwwportal/w/search-redirect.php: Fixing redirects if no language is specified (duration: 00m 54s) | 
  [production] | 
            
  | 14:33 | 
  <moritzm> | 
  uploaded nginx 1.13.6-2+wmf2~jessie1 to apt.wikimedia.org/jessie-wikimedia | 
  [production] | 
            
  | 14:32 | 
  <akosiaris> | 
  T206439 upload apertium-cat_2.6.0-1+wmf1 apertium-fra-cat_1.5.0-1+wmf1 apertium-fra_1.5.0-1+wmf1  to apt.wikimedia.org/jessie-wikimedia/main | 
  [production] | 
            
  | 14:26 | 
  <bblack> | 
  rebooting graphite1004 | 
  [production] | 
            
  | 14:16 | 
  <akosiaris> | 
  T206439 upload  apertium-separable_0.3.2-1+wmf1 apertium-lex-tools_0.2.1-1+wmf1 to apt.wikimedia.org/jessie-wikimedia/main | 
  [production] | 
            
  | 14:07 | 
  <akosiaris> | 
  T206439 upload apertium_3.5.2-1+wmf1 to apt.wikimedia.org/jessie-wikimedia/main | 
  [production] | 
            
  | 13:43 | 
  <bblack> | 
  hi | 
  [production] | 
            
  | 13:21 | 
  <Amir1> | 
  ladsgroup@mwmaint1002:/srv/mediawiki/php-1.33.0-wmf.1$ mwscript sql.php --wiki=sourceswiki extensions/Wikibase/client/sql/entity_usage.sql (T208858) | 
  [production] | 
            
  | 12:38 | 
  <zeljkof> | 
  EU SWAT finished | 
  [production] | 
            
  | 12:36 | 
  <zfilipin@deploy1001> | 
  Synchronized wmf-config: SWAT: [[gerrit:471948|BC: Enable Schema.org page split test (T208763)]] (duration: 00m 54s) | 
  [production] | 
            
  | 12:35 | 
  <akosiaris> | 
  T206439 upload  hfst-ospell_0.5.0-1+wmf1to apt.wikimedia.org/jessie-wikimedia/main | 
  [production] | 
            
  | 12:27 | 
  <akosiaris> | 
  T206439 upload cg3_1.1.7-1+wmf1 to apt.wikimedia.org/jessie-wikimedia/main | 
  [production] | 
            
  | 12:16 | 
  <zfilipin@deploy1001> | 
  Synchronized wmf-config/InterwikiSortOrders.php: SWAT: [[gerrit:468337|Add dty, gor, inh, kbp and lfn to InterwikiSortOrders (T208217)]] (duration: 00m 53s) | 
  [production] | 
            
  | 12:12 | 
  <zfilipin@deploy1001> | 
  Synchronized wmf-config/throttle.php: SWAT: [[gerrit:472027|New throttle rule for Art&Feminism event in Chile (T208866)]] (duration: 00m 54s) | 
  [production] | 
            
  | 12:12 | 
  <akosiaris> | 
  T206439 upload hfst_3.15.0-1+wmf1 to apt.wikimedia.org/jessie-wikimedia/main | 
  [production] | 
            
  | 12:08 | 
  <zfilipin@deploy1001> | 
  Synchronized wmf-config/throttle.php: SWAT: [[gerrit:472026|Remove expired throttle rules]] (duration: 01m 05s) | 
  [production] | 
            
  | 11:49 | 
  <akosiaris> | 
  T206439 upload lttoolbox_3.5.0-1+wmf1 to apt.wikimedia.org/jessie-wikimedia/main | 
  [production] | 
            
  | 11:49 | 
  <akosiaris> | 
  T206439 upload lttoolbox_3.5.0-1+wmf1 | 
  [production] | 
            
  | 10:06 | 
  <hashar> | 
  CI: switched operations/puppet job to be based on Stretch ( T208422 ) and to add python3 ( T208873 ) | 
  [production] | 
            
  | 09:25 | 
  <_joe_> | 
  run systemctl reset-failed on ms-be1029, had a failed debmonitor session | 
  [production] | 
            
  | 08:16 | 
  <kartik@deploy1001> | 
  Finished deploy [cxserver/deploy@6f97d25]: Update cxserver to f9ffd24 (duration: 04m 59s) | 
  [production] | 
            
  | 08:11 | 
  <kartik@deploy1001> | 
  Started deploy [cxserver/deploy@6f97d25]: Update cxserver to f9ffd24 | 
  [production] | 
            
  | 02:55 | 
  <ejegg> | 
  disabled recurring charge jobs | 
  [production] | 
            
  | 00:46 | 
  <mutante> | 
  tegmen - shutting down for renaming and reinstall (T208824) | 
  [production] | 
            
  | 00:11 | 
  <dereckson@deploy1001> | 
  Synchronized wmf-config/interwiki.php: Updating interwiki cache (duration: 02m 44s) | 
  [production] | 
            
  
    | 
      
        2018-11-06
      
      §
     | 
  
    
  | 23:55 | 
  <mutante> | 
  cp1084 - network went down, powercycled, probably T203194 | 
  [production] | 
            
  | 22:49 | 
  <ejegg> | 
  updated fundraising CiviCRM from e0742d2210 to 769dcf6456 | 
  [production] | 
            
  | 21:50 | 
  <mutante> | 
  icinga1001-"MediaWiki EtcdConfig up-to-date" checks were all UNKNOWN because systemd unit update-etcd-mw-config-lastindex was present but service not running. it was turned off in https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/427328/ on purpose. manually ran "systemctl start update-etcd-mw-config-lastindex" and the checks all work (T202782) | 
  [production] | 
            
  | 21:49 | 
  <mutante> | 
  icinga1001 - the "MediaWiki EtcdConfig up-to-date" checks were all unknown on the new icinga server, this was because systemd unit update-etcd-mw-config-lastindex was present but service not running. that was turned off in https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/427328/ on purpose. manually ran "systemctl start update-etcd-mw-config-lastindex" to start it and the checks | 
  [production] | 
            
  | 21:40 | 
  <thcipriani@deploy1001> | 
  rebuilt and synchronized wikiversions files: Group0 wikis to 1.33.0-wmf.3 | 
  [production] | 
            
  | 20:19 | 
  <thcipriani@deploy1001> | 
  Finished scap: testwiki to 1.33.0-wmf.3 and rebuild l10n cache (duration: 34m 06s) | 
  [production] | 
            
  | 19:45 | 
  <thcipriani@deploy1001> | 
  Started scap: testwiki to 1.33.0-wmf.3 and rebuild l10n cache | 
  [production] | 
            
  | 19:44 | 
  <thcipriani@deploy1001> | 
  Pruned MediaWiki: 1.32.0-wmf.23 (duration: 07m 19s) | 
  [production] |