| 
      
        2017-09-13
      
      §
     | 
  
    
  | 07:08 | 
  <moritzm> | 
  installing tcpdump security updates (fixing 90 CVE IDs...) | 
  [production] | 
            
  | 05:18 | 
  <kartik@tin> | 
  Finished deploy [cxserver/deploy@ee0081d]: Update cxserver to 3baaa36 (duration: 02m 56s) | 
  [production] | 
            
  | 05:15 | 
  <kartik@tin> | 
  Started deploy [cxserver/deploy@ee0081d]: Update cxserver to 3baaa36 | 
  [production] | 
            
  | 03:12 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Wed Sep 13 03:12:46 UTC 2017 (duration 7m 30s) | 
  [production] | 
            
  | 03:05 | 
  <l10nupdate@tin> | 
  scap sync-l10n completed (1.30.0-wmf.18) (duration: 16m 28s) | 
  [production] | 
            
  | 03:03 | 
  <jynus> | 
  dropping old users from phabricator database | 
  [production] | 
            
  | 03:00 | 
  <eileen> | 
  update civicrm from ee7dda38ed7071d3100907d11c2a77e82a2a852c to 187238fccb2b59378dececac7055a5320ce0269b | 
  [production] | 
            
  | 02:41 | 
  <demon@tin> | 
  Synchronized wmf-config/mobile.php: rm unused config var (duration: 00m 46s) | 
  [production] | 
            
  | 02:27 | 
  <l10nupdate@tin> | 
  scap sync-l10n completed (1.30.0-wmf.17) (duration: 08m 31s) | 
  [production] | 
            
  | 01:19 | 
  <jynus> | 
  stopping mariadb @ db1048 to clone it to db1059 | 
  [production] | 
            
  | 00:11 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:377357|Enable Special:PageLanguage on mul.wikisource]] [[gerrit:377674|Fix correct wiki name for wgPageLanguageUseDB on www.wikisource.org]] T175622 (duration: 00m 49s) | 
  [production] | 
            
  
    | 
      
        2017-09-12
      
      §
     | 
  
    
  | 23:53 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:377346|Revert "Do not deploy Timeless on fr.wiktionary for now"]] (duration: 00m 49s) | 
  [production] | 
            
  | 23:35 | 
  <thcipriani@tin> | 
  Synchronized wmf-config: SWAT: [[gerrit:377657|Enable Flow on Newsletter_talk on mediawiki.org]] T175502 (duration: 00m 52s) | 
  [production] | 
            
  | 22:17 | 
  <chasemp> | 
  labvirt1018:~# /sbin/reboot | 
  [production] | 
            
  | 22:00 | 
  <bsitzmann@tin> | 
  Finished deploy [mobileapps/deploy@b11b75c]: Update mobileapps to 297b048 (T174707 T175305) (duration: 04m 28s) | 
  [production] | 
            
  | 21:55 | 
  <bsitzmann@tin> | 
  Started deploy [mobileapps/deploy@b11b75c]: Update mobileapps to 297b048 (T174707 T175305) | 
  [production] | 
            
  | 21:49 | 
  <maxsem@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/377527/2 T175725 (duration: 00m 49s) | 
  [production] | 
            
  | 21:37 | 
  <MaxSem> | 
  Populating ip_changes in group0 wikis | 
  [production] | 
            
  | 21:33 | 
  <ejegg> | 
  changed contact de-duplication duty cycle to 25 minutes | 
  [production] | 
            
  | 21:05 | 
  <demon@tin> | 
  rebuilt wikiversions.php and synchronized wikiversions files: group0 to wmf.18 | 
  [production] | 
            
  | 20:33 | 
  <demon@tin> | 
  Finished scap: bootstrap wmf.18 (for real this time) (duration: 26m 23s) | 
  [production] | 
            
  | 20:06 | 
  <demon@tin> | 
  Started scap: bootstrap wmf.18 (for real this time) | 
  [production] | 
            
  | 19:53 | 
  <demon@tin> | 
  Finished scap: bootstrap wmf.18 (duration: 08m 14s) | 
  [production] | 
            
  | 19:45 | 
  <demon@tin> | 
  Started scap: bootstrap wmf.18 | 
  [production] | 
            
  | 19:05 | 
  <papaul> | 
  maintenance complete on mw2256 | 
  [production] | 
            
  | 17:51 | 
  <bblack> | 
  cp3034 - reset fetch_maxchunksize to 0.25G (default) for fe+be | 
  [production] | 
            
  | 17:40 | 
  <cwd> | 
  turned on dedupe | 
  [production] | 
            
  | 16:55 | 
  <niharika29@tin> | 
  Finished deploy [iegreview/iegreview@69c4c3f]: Deploying iegreview with scap3 T129154 (duration: 00m 01s) | 
  [production] | 
            
  | 16:55 | 
  <niharika29@tin> | 
  Started deploy [iegreview/iegreview@69c4c3f]: Deploying iegreview with scap3 T129154 | 
  [production] | 
            
  | 16:40 | 
  <ejegg> | 
  updated CiviCRM from 63288ae8b3bac2f15804d4076c4ede55ba4a3759 to ee7dda38ed7071d3100907d11c2a77e82a2a852c | 
  [production] | 
            
  | 16:35 | 
  <niharika29@tin> | 
  Finished deploy [scholarships/scholarships@004635d]: Deploying scholarships with scap3 T129134 (duration: 00m 03s) | 
  [production] | 
            
  | 16:35 | 
  <niharika29@tin> | 
  Started deploy [scholarships/scholarships@004635d]: Deploying scholarships with scap3 T129134 | 
  [production] | 
            
  | 16:26 | 
  <volans@sarin> | 
  conftool action : set/pooled=yes; selector: name=mw2100.codfw.wmnet | 
  [production] | 
            
  | 16:18 | 
  <ejegg> | 
  updated SmashPig from dce4f0a to dc62203910 | 
  [production] | 
            
  | 15:43 | 
  <_joe_> | 
  restarted ircecho on einsteinium | 
  [production] | 
            
  | 15:35 | 
  <gehel> | 
  restart elasticsearch on relforge (last check of new plugin deployment) - T158560 | 
  [production] | 
            
  | 15:22 | 
  <bblack> | 
  manually setting fetch_maxchunksize=16MB via varnishadm on cp3034 fe+be instances | 
  [production] | 
            
  | 15:06 | 
  <chasemp> | 
  disable puppet for lab* things for designate refactor rolleout (delayed a few minutes for a meeting) | 
  [production] | 
            
  | 15:04 | 
  <moritzm> | 
  uploaded php5.5 5.5.38 to component/ci of jessie-wikimedia (for use in CI) | 
  [production] | 
            
  | 14:53 | 
  <papaul> | 
  shutting down mw2256 for maintenance | 
  [production] | 
            
  | 14:43 | 
  <elukey> | 
  add kafka-jumbo IPs to the kafka term of the analytics-in4 filter on cr1/cr2 eqiad | 
  [production] | 
            
  | 14:42 | 
  <ema> | 
  cp1074 - backend restart, mailbox lag | 
  [production] | 
            
  | 14:39 | 
  <bblack> | 
  manually setting fetch_maxchunksize=64MB via varnishadm on cp3034 fe+be instances | 
  [production] | 
            
  | 14:19 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Remove all references to db1059 (duration: 00m 44s) | 
  [production] | 
            
  | 14:18 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-codfw.php: Remove all references to db1059 (duration: 00m 45s) | 
  [production] | 
            
  | 14:10 | 
  <gehel> | 
  restarting elasticsearch on elastic1020 to validate new plugin deployment - T158560 | 
  [production] | 
            
  | 14:07 | 
  <gehel> | 
  switching elasticsearch plugin deployment to .deb instead of scap on cirrus/eqiad - T158560 | 
  [production] | 
            
  | 14:06 | 
  <volans> | 
  testing reimage of mw2100 - T166300 | 
  [production] | 
            
  | 14:05 | 
  <gehel> | 
  restarting elasticsearch on elastic2001 to validate new plugin deployment - T158560 | 
  [production] | 
            
  | 14:04 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1059, pool db1097 with low load (duration: 00m 45s) | 
  [production] |