| 
      
        2015-12-15
      
      §
     | 
  
    
  | 17:29 | 
  <urandom> | 
  beginning `nodetool cleanup' on restbase1002.eqiad (https://phabricator.wikimedia.org/T121535) | 
  [production] | 
            
  | 17:03 | 
  <ebernhardson@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Update cirrus avro schema to 111448028943 (duration: 00m 29s) | 
  [production] | 
            
  | 17:00 | 
  <jynus> | 
  restarting and reconfiguring mysql at db2018 | 
  [production] | 
            
  | 16:34 | 
  <thcipriani@tin> | 
  Synchronized portals: SWAT: Bump portals to master (duration: 00m 29s) | 
  [production] | 
            
  | 16:30 | 
  <jynus> | 
  restarting and reconfiguring mysql on db1042 | 
  [production] | 
            
  | 16:26 | 
  <godog> | 
  decommission restbase1004 | 
  [production] | 
            
  | 16:23 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: VisualEditor: Centralise feedback from test2wiki to MediaWiki.org [[gerrit:259041]] (duration: 00m 30s) | 
  [production] | 
            
  | 16:21 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: VisualEditor: Enable single edit tab mode on test2wiki [[gerrit:259039]] (duration: 00m 29s) | 
  [production] | 
            
  | 16:17 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/CommonSettings.php: SWAT: In VisualEditor on single edit tab wikis, set the default editor appropriately [[gerrit:258403]] (duration: 00m 28s) | 
  [production] | 
            
  | 16:14 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: BetaFeatures: Update language and dates of "retirement" [[gerrit:258409]] (duration: 00m 29s) | 
  [production] | 
            
  | 16:14 | 
  <jynus> | 
  switch db2018's master from s3-master to db1027 | 
  [production] | 
            
  | 16:09 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: Enable cross-wiki upload A/B test on English-language wikis [[gerrit:259258]] (duration: 00m 29s) | 
  [production] | 
            
  | 16:08 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/db-eqiad.php: SWATish: Depool db1042 for maintenance (duration: 00m 29s) | 
  [production] | 
            
  | 15:50 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1042 for maintenance (duration: 00m 29s) | 
  [production] | 
            
  | 15:18 | 
  <jynus> | 
  restarting db2018 for upgrade and configuration change | 
  [production] | 
            
  | 14:41 | 
  <jynus> | 
  restarting mysql on db1027 to apply new configuration | 
  [production] | 
            
  | 13:53 | 
  <bblack> | 
  disabling puppet on neon to avoid race-condition ipsec alert spam | 
  [production] | 
            
  | 13:45 | 
  <hashar> | 
  reverted composer upgrade on CI with https://gerrit.wikimedia.org/r/#/c/259241/ | 
  [production] | 
            
  | 13:41 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1018 after maintenance; depool db1027 for maintenance (duration: 00m 29s) | 
  [production] | 
            
  | 13:37 | 
  <hashar> | 
  bumping composer on CI to  1.0.0-alpha11 https://gerrit.wikimedia.org/r/#/c/258933/ | 
  [production] | 
            
  | 12:48 | 
  <mobrovac> | 
  restbase deploy end of 844a41d | 
  [production] | 
            
  | 12:39 | 
  <mobrovac> | 
  restbase deploy start of 844a41d | 
  [production] | 
            
  | 11:46 | 
  <jynus> | 
  restarting and upgrading dbstore2002 | 
  [production] | 
            
  | 11:33 | 
  <paravoid> | 
  force-rebooting stat1002, kernel borked because of fuse | 
  [production] | 
            
  | 11:25 | 
  <paravoid> | 
  rebooting lvs4003/lvs4004 for kernel upgrade | 
  [production] | 
            
  | 11:21 | 
  <paravoid> | 
  rebooting lvs3004 for kernel upgrade | 
  [production] | 
            
  | 11:01 | 
  <jynus> | 
  reloading haproxy on dbproxy1002 | 
  [production] | 
            
  | 10:20 | 
  <jynus> | 
  stopped eventlogging on dbstore1002 and db1047 | 
  [production] | 
            
  | 10:09 | 
  <jynus> | 
  enabling ferm, and restarting mysql at db1046 (m4-master, eventlogging) | 
  [production] | 
            
  | 10:02 | 
  <jynus> | 
  stopping eventlogging mysql consumers | 
  [production] | 
            
  | 09:32 | 
  <moritzm> | 
  umounted/remounted hdfs mount on stat1002 (got stuck due to kernel bug, see T121492) | 
  [production] | 
            
  | 09:32 | 
  <hashar@tin> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: enable EventBus logging channel (currently only in beta) https://phabricator.wikimedia.org/T116786 (duration: 08m 57s) | 
  [production] | 
            
  | 08:47 | 
  <hashar> | 
  restarted zuul-merger on gallium | 
  [production] | 
            
  | 08:29 | 
  <hashar> | 
  stopping zuul-merger on gallium for maintenance | 
  [production] | 
            
  | 07:48 | 
  <_joe_> | 
  rebooting pollux | 
  [production] | 
            
  | 07:18 | 
  <_joe_> | 
  logged into console on pollux, that made it responsive | 
  [production] | 
            
  | 03:09 | 
  <krenair@tin> | 
  Synchronized wmf-config/throttle.php: https://gerrit.wikimedia.org/r/#/c/259011/ and https://gerrit.wikimedia.org/r/#/c/259010/1 (duration: 00m 30s) | 
  [production] | 
            
  | 02:32 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Tue Dec 15 02:32:25 UTC 2015 (duration 6m 59s) | 
  [production] | 
            
  | 02:25 | 
  <mwdeploy@tin> | 
  sync-l10n completed (1.27.0-wmf.8) (duration: 11m 38s) | 
  [production] | 
            
  | 02:03 | 
  <ori> | 
  deployed I6ebffe559 to job runners | 
  [production] | 
            
  | 01:32 | 
  <ebernhardson@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Revert cirrus avro schema to 101446746400 due to camus not picking up events from new schema (duration: 00m 30s) | 
  [production] | 
            
  | 00:34 | 
  <Reedy> | 
  puppet disabled on silver since last Puppet run was at Fri Dec 11 15:27:28 UTC 2015 due to 'testing osm debugging' | 
  [production] | 
            
  | 00:33 | 
  <catrope@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: Graph config updates (duration: 00m 28s) | 
  [production] | 
            
  | 00:32 | 
  <catrope@tin> | 
  Synchronized wmf-config/CommonSettings.php: SWAT: Graph config updates (duration: 00m 29s) | 
  [production] | 
            
  | 00:19 | 
  <catrope@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 29s) | 
  [production] | 
            
  | 00:17 | 
  <catrope@tin> | 
  Synchronized wmf-config/: SWAT: Use event-schemas repository for avro schemas (duration: 00m 29s) | 
  [production] | 
            
  | 00:10 | 
  <catrope@tin> | 
  Synchronized php-1.27.0-wmf.8/extensions/MobileFrontend/: SWAT: fix page invalidation in mobile API (duration: 00m 36s) | 
  [production] | 
            
  | 00:06 | 
  <catrope@tin> | 
  Synchronized wmf-config/: SWAT: Wikidata config changes (duration: 00m 28s) | 
  [production] |