| 
      
        2015-12-08
      
      §
     | 
  
    
  | 09:56 | 
  <hashar> | 
  gallium: upgraded python-diamond and java. Restarting Jenkins | 
  [production] | 
            
  | 09:48 | 
  <hashar> | 
  gallium: removing bunch of :i386 packages which were used for Android build but got removed ( https://gerrit.wikimedia.org/r/#/c/183790/3/modules/androidsdk/manifests/dependencies.pp,unified ) | 
  [production] | 
            
  | 09:15 | 
  <godog> | 
  reimage restbase1008 | 
  [production] | 
            
  | 05:45 | 
  <gwicke> | 
  restbase1008: disable cassandra with `systemctl mask cassandra` | 
  [production] | 
            
  | 04:00 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Tue Dec  8 04:00:02 UTC 2015 (duration 1h 34m 44s) | 
  [production] | 
            
  | 03:12 | 
  <gwicke> | 
  Keeping puppet on restbase production cluster disabled until Marko & Filippo can deploy tomorrow morning. PLEASE DO NOT ENABLE! | 
  [production] | 
            
  | 02:25 | 
  <mwdeploy@tin> | 
  sync-l10n completed (1.27.0-wmf.7) (duration: 09m 56s) | 
  [production] | 
            
  | 01:16 | 
  <catrope@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Also blacklist Minerva for WPB (duration: 00m 28s) | 
  [production] | 
            
  | 00:59 | 
  <gwicke> | 
  disabling puppet in production restbase cluster in preparation for testing https://gerrit.wikimedia.org/r/#/c/257408/ in staging | 
  [production] | 
            
  | 00:39 | 
  <catrope@tin> | 
  Synchronized php-1.27.0-wmf.7/extensions/MobileFrontend/: SWAT (duration: 00m 28s) | 
  [production] | 
            
  | 00:38 | 
  <catrope@tin> | 
  Synchronized php-1.27.0-wmf.7/extensions/MwEmbedSupport/: SWAT (duration: 00m 28s) | 
  [production] | 
            
  | 00:37 | 
  <catrope@tin> | 
  Synchronized php-1.27.0-wmf.7/resources/src/oojs-ui-local.js: SWAT: connect OOjs UI to MW's l10n system (duration: 00m 28s) | 
  [production] | 
            
  | 00:37 | 
  <catrope@tin> | 
  Synchronized php-1.27.0-wmf.7/resources/ResourcesOOUI.php: SWAT: connect OOjs UI to MW's l10n system (duration: 00m 27s) | 
  [production] | 
            
  | 00:34 | 
  <catrope@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: enable banners on mobile web beta on enwiki; remove MobileFrontend Browse config (duration: 00m 27s) | 
  [production] | 
            
  | 00:31 | 
  <catrope@tin> | 
  Synchronized wmf-config/squid.php: SWAT: stop using separate address for upload in wgHTCPRouting (duration: 00m 29s) | 
  [production] | 
            
  | 00:07 | 
  <catrope@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Enable Flow opt-in beta feature on bswiki and urwiki (duration: 00m 28s) | 
  [production] | 
            
  
    | 
      
        2015-12-07
      
      §
     | 
  
    
  | 22:29 | 
  <ori@tin> | 
  Synchronized php-1.27.0-wmf.7/extensions/MobileFrontend: I8c94425693: Improve disableImages cookie code (T120151) (duration: 00m 30s) | 
  [production] | 
            
  | 22:22 | 
  <ebernhardson@tin> | 
  Synchronized portals/prod: Deploy updated portals (duration: 00m 27s) | 
  [production] | 
            
  | 22:01 | 
  <mdholloway> | 
  mobileapps deployed 984f14b | 
  [production] | 
            
  | 21:31 | 
  <hoo@tin> | 
  Synchronized php-1.27.0-wmf.7/extensions/Wikidata/: (no message) (duration: 00m 37s) | 
  [production] | 
            
  | 21:15 | 
  <subbu> | 
  finished deploying parsoid sha 4a7df427 (cf0b9ef + cherry-pick of d65debd) | 
  [production] | 
            
  | 21:09 | 
  <subbu> | 
  restart parsoid on wtp1002 as a canary | 
  [production] | 
            
  | 21:05 | 
  <subbu> | 
  starting parsoid deploy | 
  [production] | 
            
  | 20:33 | 
  <andrewbogott> | 
  enabling puppet on labcontrol1002, testing over | 
  [production] | 
            
  | 20:07 | 
  <andrewbogott> | 
  disabling puppet on labcontrol1002 for an ldap/pdns test | 
  [production] | 
            
  | 19:52 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool es1015 at 100% load (duration: 00m 27s) | 
  [production] | 
            
  | 19:52 | 
  <andrewbogott> | 
  restarting nova-compute on all labvirt1X nodes | 
  [production] | 
            
  | 19:20 | 
  <andrewbogott> | 
  restarted pdns on labcontrol1001 and 1002 to catch up with recent opendj restarts | 
  [production] | 
            
  | 19:11 | 
  <andrewbogott> | 
  restarting ldap on neptunium and nembus due to replication warnings in the logs | 
  [production] | 
            
  | 18:36 | 
  <jynus> | 
  es1019 and its management interface became unresponsive | 
  [production] | 
            
  | 18:16 | 
  <mutante> | 
  deleting pmtpa host groups from nagios/icinga  | 
  [production] | 
            
  | 17:04 | 
  <thcipriani@tin> | 
  Synchronized php-1.27.0-wmf.7/extensions/MobileApp/config/config.json: SWAT: Roll out RESTBase usage to Android Beta app: 10% [[gerrit:254045]] (duration: 00m 29s) | 
  [production] | 
            
  | 17:02 | 
  <thcipriani> | 
  reset uncommited change to includes/jobqueue/JobRunner.php in /srv/mediawiki-staging/php-1.27.0-wmf.7 | 
  [production] | 
            
  | 17:00 | 
  <hashar> | 
  Restarted Jenkins to start the ZeroMQ publisher https://phabricator.wikimedia.org/T120668 | 
  [production] | 
            
  | 16:56 | 
  <_joe_> | 
  upgrading pybal on primaries in esams, ulsfo, codfw | 
  [production] | 
            
  | 16:44 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: Namespace configuration for en.wiktionary [[gerrit:254476]] and Enable subpages on custom aliases from 112 to 119 [[gerrit:254475]] (duration: 00m 27s) | 
  [production] | 
            
  | 16:43 | 
  <_joe_> | 
  installing pybal on eqiad backups | 
  [production] | 
            
  | 16:43 | 
  <jynus> | 
  restarting mysql, upgrading and rebooting mysql on es1019 | 
  [production] | 
            
  | 16:36 | 
  <_joe_> | 
  installing the new pybal version on the backup lvss in esams and ulsfo | 
  [production] | 
            
  | 16:31 | 
  <_joe_> | 
  upgrading pybal on all the backup LVSs in codfw | 
  [production] | 
            
  | 16:28 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: Rights configuration on fa.wikipedia [[gerrit:254486]] (duration: 00m 29s) | 
  [production] | 
            
  | 16:28 | 
  <_joe_> | 
  upgrading pybal on lvs1007-12 | 
  [production] | 
            
  | 16:19 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: Namespace configuration for ur.wikipedia [[gerrit:254665]] (duration: 00m 30s) | 
  [production] | 
            
  | 16:18 | 
  <_joe_> | 
  uploaded pybal 1.13.2 to reprepro | 
  [production] | 
            
  | 16:14 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: Translate project namesapce for jbowiki [[gerrit:255954]] (duration: 00m 28s) | 
  [production] | 
            
  | 15:39 | 
  <moritzm> | 
  uploaded openssl 1.0.2e-1~wmf1 to carbon | 
  [production] | 
            
  | 15:37 | 
  <yurik> | 
  deployed kartotherian | 
  [production] | 
            
  | 15:25 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool es1019; es1017 at 100% load; pool es1015 with low weight (duration: 00m 28s) | 
  [production] | 
            
  | 14:56 | 
  <yurik> | 
  deployed latest tilerator | 
  [production] | 
            
  | 14:46 | 
  <_joe_> | 
  also restarted pybal on lvs3003 | 
  [production] |