| 
      
        2018-10-10
      
      §
     | 
  
    
  | 23:08 | 
  <krinkle@deploy1001> | 
  Synchronized php-1.32.0-wmf.24/maintenance/resources/foreign-resources.yaml: Ic865e7077d (duration: 00m 49s) | 
  [production] | 
            
  | 22:59 | 
  <krinkle@deploy1001> | 
  Synchronized php-1.32.0-wmf.24/extensions/MultimediaViewer/: T206099 - I53dbce0a (duration: 00m 49s) | 
  [production] | 
            
  | 22:43 | 
  <krinkle@deploy1001> | 
  Synchronized php-1.32.0-wmf.24/includes/specials/SpecialDeletedContributions.php: T187619 - Ic6b0d8020553 (duration: 00m 48s) | 
  [production] | 
            
  | 22:41 | 
  <krinkle@deploy1001> | 
  Synchronized php-1.32.0-wmf.24/extensions/ORES/includes/FetchScoreJob.php: T204753 - Icc28230585bc (duration: 00m 49s) | 
  [production] | 
            
  | 22:25 | 
  <mutante> | 
  icinga1001 - chmod 2710 /var/lib/icinga/rw | 
  [production] | 
            
  | 22:16 | 
  <krinkle@deploy1001> | 
  Synchronized wmf-config/arclamp.php: T206092 - If607ad111a (duration: 00m 48s) | 
  [production] | 
            
  | 21:50 | 
  <krinkle@deploy1001> | 
  Synchronized php-1.32.0-wmf.24/extensions/ContentTranslation/specials/SpecialContentTranslation.php: T205433 - Ib34b28c5bb114c (duration: 00m 49s) | 
  [production] | 
            
  | 21:48 | 
  <krinkle@deploy1001> | 
  Synchronized php-1.32.0-wmf.24/extensions/Echo/includes/DiscussionParser.php: T204291 - Ia5323b401b94 (duration: 00m 51s) | 
  [production] | 
            
  | 21:45 | 
  <XioNoX> | 
  Add icinga1001 to mr* security policies - T206704 | 
  [production] | 
            
  | 20:34 | 
  <thcipriani> | 
  upgrading ci jenkins install on contint1001 | 
  [production] | 
            
  | 20:19 | 
  <thcipriani> | 
  upgrading releases-jenkins jenkins install on releases1001 | 
  [production] | 
            
  | 20:17 | 
  <thcipriani> | 
  upgrading releases-jenkins jenkins install on releases2001 | 
  [production] | 
            
  | 19:58 | 
  <mutante> | 
  icinga - enabled icinga service on icinga1001 (stretch), but all notifications are disabled | 
  [production] | 
            
  | 19:43 | 
  <mutante> | 
  awight restarted ORES celery workers on ores2003 (~17:00), ores200* (17:05) | 
  [production] | 
            
  | 19:39 | 
  <awight> | 
  restarted ORES celery workers on ores2003 (~17:00), ores200* (17:05) | 
  [production] | 
            
  | 19:35 | 
  <kaldari@deploy1001> | 
  Finished scap: (no justification provided) (duration: 22m 05s) | 
  [production] | 
            
  | 19:13 | 
  <kaldari@deploy1001> | 
  Started scap: (no justification provided) | 
  [production] | 
            
  | 19:11 | 
  <kaldari> | 
  scap sync to rebuild i18n cache | 
  [production] | 
            
  | 18:35 | 
  <XioNoX> | 
  disable VC port 1/2 on asw2-c-eqiad:fpc3 (to fpc8) | 
  [production] | 
            
  | 18:20 | 
  <otto@deploy1001> | 
  Finished deploy [analytics/refinery@28bbee8]: Add accept header to webrequest logs - T170606 (duration: 10m 34s) | 
  [production] | 
            
  | 18:19 | 
  <XioNoX> | 
  delete sessions to AS6805 on cr2-esams (left AMS-IX) | 
  [production] | 
            
  | 18:10 | 
  <otto@deploy1001> | 
  Started deploy [analytics/refinery@28bbee8]: Add accept header to webrequest logs - T170606 | 
  [production] | 
            
  | 18:09 | 
  <otto@deploy1001> | 
  Finished deploy [analytics/refinery@4e2d956]: Add accept header to webrequest logs - T170606 (duration: 04m 35s) | 
  [production] | 
            
  | 18:05 | 
  <otto@deploy1001> | 
  Started deploy [analytics/refinery@4e2d956]: Add accept header to webrequest logs - T170606 | 
  [production] | 
            
  | 17:49 | 
  <XioNoX> | 
  replace 10.195.0.0/25 with 10.195.0.0/24 in prefix-list fundraising-codfw4 on cr1/2-codfw - T206637 | 
  [production] | 
            
  | 16:25 | 
  <mutante> | 
  LDAP - added isaacj to wmf group (for SWAP access, existing shell user since recently) (T206631) (T205840) | 
  [production] | 
            
  | 16:16 | 
  <_joe_> | 
  restart of now-unused jobqueue redises for stopping the alerts post-switchover | 
  [production] | 
            
  | 16:09 | 
  <ejegg> | 
  updated CiviCRM from 1165e7ed79 to 4cc21d61c5 | 
  [production] | 
            
  | 15:59 | 
  <vgutierrez> | 
  Uploaded certcentral 0.1 to apt.wikimedia.org (stretch) - T199711 | 
  [production] | 
            
  | 15:55 | 
  <cmjohnson1> | 
  scheduled downtime for host cloudvirt1019 swap raid card T196507 | 
  [production] | 
            
  | 15:35 | 
  <moritzm> | 
  uploaded jenkins 2.138.2 security release to apt.wikimedia.org (jessie/stretch) (T206234) | 
  [production] | 
            
  | 15:11 | 
  <_joe_> | 
  started again hhvm on mwmaint2001 | 
  [production] | 
            
  | 14:51 | 
  <ejegg> | 
  turned fundraising scheduled jobs back on | 
  [production] | 
            
  | 14:43 | 
  <ejegg> | 
  turned off fundraising scheduled jobs | 
  [production] | 
            
  | 14:42 | 
  <END> | 
  (PASS) - Cookbook sre.switchdc.mediawiki.08-restore-ttl (exit_code=0) (volans@neodymium) | 
  [production] | 
            
  | 14:42 | 
  <START> | 
  - Cookbook sre.switchdc.mediawiki.08-restore-ttl (volans@neodymium) | 
  [production] | 
            
  | 14:42 | 
  <END> | 
  (FAIL) - Cookbook sre.switchdc.mediawiki.08-start-maintenance (exit_code=99) (volans@neodymium) | 
  [production] | 
            
  | 14:40 | 
  <START> | 
  - Cookbook sre.switchdc.mediawiki.08-start-maintenance (volans@neodymium) | 
  [production] | 
            
  | 14:39 | 
  <END> | 
  (FAIL) - Cookbook sre.switchdc.mediawiki.08-start-maintenance (exit_code=99) (volans@neodymium) | 
  [production] | 
            
  | 14:38 | 
  <START> | 
  - Cookbook sre.switchdc.mediawiki.08-start-maintenance (volans@neodymium) | 
  [production] | 
            
  | 14:33 | 
  <oblivian@puppetmaster1001> | 
  conftool action : set/weight=15; selector: cluster=api_appserver,service=apache2,dc=eqiad,name=mw123.* | 
  [production] | 
            
  | 14:31 | 
  <oblivian@puppetmaster1001> | 
  conftool action : set/weight=15; selector: cluster=api_appserver,service=apache2,dc=eqiad,name=mw122.* | 
  [production] |