| 
      
        2017-07-05
      
      §
     | 
  
    
  | 23:34 | 
  <eileen> | 
  civicrm updated from a9e3e0c55ce1c2a1efc162c1b2d25e6d6e91857c to 89147827da40f2d90784fb444fd3c5ef782a6239 | 
  [production] | 
            
  | 22:47 | 
  <Reedy> | 
  running `mwscript updateArticleCount.php --wiki=commonswiki --update` on screen on terbium T169822 | 
  [production] | 
            
  | 22:29 | 
  <mutante> | 
  subra/suhail: re-enabled puppet, now with role::spare, no more poolcounter, scheduled icinga downtimes for decom (T169506) | 
  [production] | 
            
  | 22:27 | 
  <niharika29@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Syncing InitialiseSettings for CodeMirror deployment (take 4) (duration: 00m 42s) | 
  [production] | 
            
  | 22:26 | 
  <niharika29@tin> | 
  scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) | 
  [production] | 
            
  | 22:21 | 
  <niharika29@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Syncing InitialiseSettings for CodeMirror deployment (take 2) (duration: 00m 42s) | 
  [production] | 
            
  | 22:20 | 
  <demon@tin> | 
  Synchronized wmf-config/CommonSettings.php: apache_request_headers protection (duration: 00m 42s) | 
  [production] | 
            
  | 22:16 | 
  <mutante> | 
  subra/suhail: disabling puppet, stopping poolcounterd, stopping other services, first step of decom, replaced by poolcounter200[12] (T169506) | 
  [production] | 
            
  | 22:13 | 
  <niharika29@tin> | 
  Finished scap: Deploying Codemirror on testwiki- full scap (T169284) (duration: 20m 43s) | 
  [production] | 
            
  | 22:09 | 
  <eileen> | 
  upgrade CiviCRM from ea9e3afa9062a8af5aa6202933a11e86e7f62775 to a9e3e0c55ce1c2a1efc162c1b2d25e6d6e91857c | 
  [production] | 
            
  | 21:53 | 
  <niharika29@tin> | 
  Started scap: Deploying Codemirror on testwiki- full scap (T169284) | 
  [production] | 
            
  | 21:53 | 
  <niharika29@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Syncing InitialiseSettings for CodeMirror deployment (duration: 00m 42s) | 
  [production] | 
            
  | 21:51 | 
  <niharika29@tin> | 
  scap aborted: Deploying Codemirror on testwiki- full scap (T169284) (duration: 03m 10s) | 
  [production] | 
            
  | 21:47 | 
  <niharika29@tin> | 
  Started scap: Deploying Codemirror on testwiki- full scap (T169284) | 
  [production] | 
            
  | 21:38 | 
  <niharika29@tin> | 
  Synchronized php-1.30.0-wmf.7/extensions/CodeMirror/: Deploying CodeMirror to testwiki (T169284) (duration: 00m 44s) | 
  [production] | 
            
  | 21:03 | 
  <chasemp> | 
  add madhuvishy to wmf-nda phab group | 
  [production] | 
            
  | 20:58 | 
  <eileen> | 
  update CiviCRM  from e53d62193e51e839229c6aa78015ca0055ed8474 to ea9e3afa9062a8af5aa6202933a11e86e7f62775 | 
  [production] | 
            
  | 20:14 | 
  <RainbowSprinkles> | 
  commonswiki: nevermind that article count thing | 
  [production] | 
            
  | 20:07 | 
  <mutante> | 
  phab2001 - deleted /etc/systemd/system/phd.service (base::service_unit uses /lib/systemd/system/phd.service both have DIFFERENT content and conflicted, causing systemd degradation after reboot) | 
  [production] | 
            
  | 19:48 | 
  <RainbowSprinkles> | 
  commonswiki: running updateArticleCount.php (against the vslow slave) | 
  [production] | 
            
  | 19:31 | 
  <mutante> | 
  phab2001 - rebooting for kernel upgrade | 
  [production] | 
            
  | 19:19 | 
  <niharika29@tin> | 
  Synchronized php-1.30.0-wmf.7/extensions/MobileApp/config/android.json: Syncing in hopes of invalidating cache (duration: 00m 42s) | 
  [production] | 
            
  | 18:59 | 
  <niharika29@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Fix nowikisource template namespace subpages [mediawiki-config] - https://gerrit.wikimedia.org/r/362272 (duration: 00m 42s) | 
  [production] | 
            
  | 18:46 | 
  <niharika29@tin> | 
  Synchronized wmf-config/InitialiseSettings.php:  Add 'WP' namespace alias to ruwiki [mediawiki-config] - https://gerrit.wikimedia.org/r/362267 (duration: 00m 42s) | 
  [production] | 
            
  | 18:41 | 
  <niharika29@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Add H as wgNamespaceAlias to NS_HELP for en.wikisource [mediawiki-config] - https://gerrit.wikimedia.org/r/362508 (duration: 00m 42s) | 
  [production] | 
            
  | 18:36 | 
  <niharika29@tin> | 
  Synchronized php-1.30.0-wmf.7/extensions/MobileApp/: Enable description editing for all wikis except enwiki. (T146705) (duration: 00m 43s) | 
  [production] | 
            
  | 18:26 | 
  <niharika29@tin> | 
  Synchronized wmf-config/InitialiseSettings.php:  Set wgCategoryCollation to 'numeric' at he.wikisource [mediawiki-config] - https://gerrit.wikimedia.org/r/362592 (duration: 00m 43s) | 
  [production] | 
            
  | 18:14 | 
  <niharika29@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Enable OOjs UI EditPage buttons on es/fr/it/ja/ru-wiki and meta [mediawiki-config] - https://gerrit.wikimedia.org/r/360370 (duration: 00m 45s) | 
  [production] | 
            
  | 18:08 | 
  <niharika29@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Enable mobile non-JavaScript editing on ptwiki [mediawiki-config] - https://gerrit.wikimedia.org/r/361455 (duration: 00m 45s) | 
  [production] | 
            
  | 18:00 | 
  <moritzm> | 
  rebooting tungsten for kernel update | 
  [production] | 
            
  | 17:53 | 
  <moritzm> | 
  rebooting osmium for kernel update | 
  [production] | 
            
  | 17:46 | 
  <gehel> | 
  cleaning /srv/wdqs/import on all wdqs servers | 
  [production] | 
            
  | 17:41 | 
  <apergos> | 
  re-enabled puppet on stat1003 (last dataset nfs client), manually mounted /mnt/data because puppet run has an unrelated error | 
  [production] | 
            
  | 16:33 | 
  <jynus> | 
  restart mysql on db2062 | 
  [production] | 
            
  | 16:04 | 
  <ema> | 
  restart pybal on lvs200[12] to make them reconnect to conf2001 | 
  [production] | 
            
  | 16:03 | 
  <ema> | 
  restart pybal on lvs200[45] to make them reconnect to conf2001 | 
  [production] | 
            
  | 15:54 | 
  <jynus> | 
  restart mysql on db2072 | 
  [production] | 
            
  | 15:30 | 
  <apergos> | 
  re-enabled puppet on stat1002, did a manual run, dataset filesystem available again there | 
  [production] | 
            
  | 15:09 | 
  <apergos> | 
  re-enabled puppet on snapshot6,7, still watching dataset1001 performance | 
  [production] | 
            
  | 15:09 | 
  <ema> | 
  restart pybal on lvs2003 to make it reconnect to conf2001 | 
  [production] | 
            
  | 14:45 | 
  <ema> | 
  bounce pybal on lvs2006, not synced with etcd information | 
  [production] | 
            
  | 14:40 | 
  <moritzm> | 
  rebooting restbase1012 for kernel update | 
  [production] | 
            
  | 14:19 | 
  <moritzm> | 
  rebooting logstash100[4-6] for kernel update | 
  [production] | 
            
  | 14:00 | 
  <moritzm> | 
  rebooting logstash100[1-3] for kernel update | 
  [production] | 
            
  | 13:59 | 
  <ema> | 
  cache_misc: upgrade to varnish 4.1.7-1wm1 and reboot for kernel update | 
  [production] | 
            
  | 13:48 | 
  <apergos> | 
  re-enabling puppet on snapshot1001, 1005 for testing | 
  [production] | 
            
  | 13:46 | 
  <moritzm> | 
  rebooting restbase1011 for kernel update | 
  [production] | 
            
  | 13:44 | 
  <zeljkof> | 
  EU SWAT finished! | 
  [production] | 
            
  | 13:43 | 
  <zfilipin@tin> | 
  Synchronized wmf-config/Wikibase-production.php: SWAT: [[gerrit:362986|Set Wikibase readFullEntityIdColumn setting to false]] (duration: 00m 42s) | 
  [production] |