| 2017-07-05
      
      § | 
    
  | 23:34 | <eileen> | civicrm updated from a9e3e0c55ce1c2a1efc162c1b2d25e6d6e91857c to 89147827da40f2d90784fb444fd3c5ef782a6239 | [production] | 
            
  | 22:47 | <Reedy> | running `mwscript updateArticleCount.php --wiki=commonswiki --update` on screen on terbium T169822 | [production] | 
            
  | 22:29 | <mutante> | subra/suhail: re-enabled puppet, now with role::spare, no more poolcounter, scheduled icinga downtimes for decom (T169506) | [production] | 
            
  | 22:27 | <niharika29@tin> | Synchronized wmf-config/InitialiseSettings.php: Syncing InitialiseSettings for CodeMirror deployment (take 4) (duration: 00m 42s) | [production] | 
            
  | 22:26 | <niharika29@tin> | scap failed: average error rate on 1/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/3888cca979647b9381a7739b0bdbc88e for details) | [production] | 
            
  | 22:21 | <niharika29@tin> | Synchronized wmf-config/InitialiseSettings.php: Syncing InitialiseSettings for CodeMirror deployment (take 2) (duration: 00m 42s) | [production] | 
            
  | 22:20 | <demon@tin> | Synchronized wmf-config/CommonSettings.php: apache_request_headers protection (duration: 00m 42s) | [production] | 
            
  | 22:16 | <mutante> | subra/suhail: disabling puppet, stopping poolcounterd, stopping other services, first step of decom, replaced by poolcounter200[12] (T169506) | [production] | 
            
  | 22:13 | <niharika29@tin> | Finished scap: Deploying Codemirror on testwiki- full scap (T169284) (duration: 20m 43s) | [production] | 
            
  | 22:09 | <eileen> | upgrade CiviCRM from ea9e3afa9062a8af5aa6202933a11e86e7f62775 to a9e3e0c55ce1c2a1efc162c1b2d25e6d6e91857c | [production] | 
            
  | 21:53 | <niharika29@tin> | Started scap: Deploying Codemirror on testwiki- full scap (T169284) | [production] | 
            
  | 21:53 | <niharika29@tin> | Synchronized wmf-config/InitialiseSettings.php: Syncing InitialiseSettings for CodeMirror deployment (duration: 00m 42s) | [production] | 
            
  | 21:51 | <niharika29@tin> | scap aborted: Deploying Codemirror on testwiki- full scap (T169284) (duration: 03m 10s) | [production] | 
            
  | 21:47 | <niharika29@tin> | Started scap: Deploying Codemirror on testwiki- full scap (T169284) | [production] | 
            
  | 21:38 | <niharika29@tin> | Synchronized php-1.30.0-wmf.7/extensions/CodeMirror/: Deploying CodeMirror to testwiki (T169284) (duration: 00m 44s) | [production] | 
            
  | 21:03 | <chasemp> | add madhuvishy to wmf-nda phab group | [production] | 
            
  | 20:58 | <eileen> | update CiviCRM  from e53d62193e51e839229c6aa78015ca0055ed8474 to ea9e3afa9062a8af5aa6202933a11e86e7f62775 | [production] | 
            
  | 20:14 | <RainbowSprinkles> | commonswiki: nevermind that article count thing | [production] | 
            
  | 20:07 | <mutante> | phab2001 - deleted /etc/systemd/system/phd.service (base::service_unit uses /lib/systemd/system/phd.service both have DIFFERENT content and conflicted, causing systemd degradation after reboot) | [production] | 
            
  | 19:48 | <RainbowSprinkles> | commonswiki: running updateArticleCount.php (against the vslow slave) | [production] | 
            
  | 19:31 | <mutante> | phab2001 - rebooting for kernel upgrade | [production] | 
            
  | 19:19 | <niharika29@tin> | Synchronized php-1.30.0-wmf.7/extensions/MobileApp/config/android.json: Syncing in hopes of invalidating cache (duration: 00m 42s) | [production] | 
            
  | 18:59 | <niharika29@tin> | Synchronized wmf-config/InitialiseSettings.php: Fix nowikisource template namespace subpages [mediawiki-config] - https://gerrit.wikimedia.org/r/362272 (duration: 00m 42s) | [production] | 
            
  | 18:46 | <niharika29@tin> | Synchronized wmf-config/InitialiseSettings.php:  Add 'WP' namespace alias to ruwiki [mediawiki-config] - https://gerrit.wikimedia.org/r/362267 (duration: 00m 42s) | [production] | 
            
  | 18:41 | <niharika29@tin> | Synchronized wmf-config/InitialiseSettings.php: Add H as wgNamespaceAlias to NS_HELP for en.wikisource [mediawiki-config] - https://gerrit.wikimedia.org/r/362508 (duration: 00m 42s) | [production] | 
            
  | 18:36 | <niharika29@tin> | Synchronized php-1.30.0-wmf.7/extensions/MobileApp/: Enable description editing for all wikis except enwiki. (T146705) (duration: 00m 43s) | [production] | 
            
  | 18:26 | <niharika29@tin> | Synchronized wmf-config/InitialiseSettings.php:  Set wgCategoryCollation to 'numeric' at he.wikisource [mediawiki-config] - https://gerrit.wikimedia.org/r/362592 (duration: 00m 43s) | [production] | 
            
  | 18:14 | <niharika29@tin> | Synchronized wmf-config/InitialiseSettings.php: Enable OOjs UI EditPage buttons on es/fr/it/ja/ru-wiki and meta [mediawiki-config] - https://gerrit.wikimedia.org/r/360370 (duration: 00m 45s) | [production] | 
            
  | 18:08 | <niharika29@tin> | Synchronized wmf-config/InitialiseSettings.php: Enable mobile non-JavaScript editing on ptwiki [mediawiki-config] - https://gerrit.wikimedia.org/r/361455 (duration: 00m 45s) | [production] | 
            
  | 18:00 | <moritzm> | rebooting tungsten for kernel update | [production] | 
            
  | 17:53 | <moritzm> | rebooting osmium for kernel update | [production] | 
            
  | 17:46 | <gehel> | cleaning /srv/wdqs/import on all wdqs servers | [production] | 
            
  | 17:41 | <apergos> | re-enabled puppet on stat1003 (last dataset nfs client), manually mounted /mnt/data because puppet run has an unrelated error | [production] | 
            
  | 16:33 | <jynus> | restart mysql on db2062 | [production] | 
            
  | 16:04 | <ema> | restart pybal on lvs200[12] to make them reconnect to conf2001 | [production] | 
            
  | 16:03 | <ema> | restart pybal on lvs200[45] to make them reconnect to conf2001 | [production] | 
            
  | 15:54 | <jynus> | restart mysql on db2072 | [production] | 
            
  | 15:30 | <apergos> | re-enabled puppet on stat1002, did a manual run, dataset filesystem available again there | [production] | 
            
  | 15:09 | <apergos> | re-enabled puppet on snapshot6,7, still watching dataset1001 performance | [production] | 
            
  | 15:09 | <ema> | restart pybal on lvs2003 to make it reconnect to conf2001 | [production] | 
            
  | 14:45 | <ema> | bounce pybal on lvs2006, not synced with etcd information | [production] | 
            
  | 14:40 | <moritzm> | rebooting restbase1012 for kernel update | [production] | 
            
  | 14:19 | <moritzm> | rebooting logstash100[4-6] for kernel update | [production] | 
            
  | 14:00 | <moritzm> | rebooting logstash100[1-3] for kernel update | [production] | 
            
  | 13:59 | <ema> | cache_misc: upgrade to varnish 4.1.7-1wm1 and reboot for kernel update | [production] | 
            
  | 13:48 | <apergos> | re-enabling puppet on snapshot1001, 1005 for testing | [production] | 
            
  | 13:46 | <moritzm> | rebooting restbase1011 for kernel update | [production] | 
            
  | 13:44 | <zeljkof> | EU SWAT finished! | [production] |