| 
      
        2019-04-03
      
      §
     | 
  
    
  | 17:14 | 
  <herron> | 
  depooling kafka1001 to restart eventbus and kafka services for security updates | 
  [production] | 
            
  | 17:04 | 
  <Lucas_WMDE> | 
  EU SWAT done | 
  [production] | 
            
  | 17:04 | 
  <Lucas_WMDE> | 
  lucaswerkmeister-wmde@mwmaint1002:~$ mwscript maintenance/namespaceDupes.php --wiki=srwiki --fix # T214428 – 0 pages to fix, 0 links to fix, Looks good! | 
  [production] | 
            
  | 17:03 | 
  <lucaswerkmeister-wmde@deploy1001> | 
  Synchronized wmf-config/throttle.php: SWAT: [[gerrit:500987|Add new throttle rule (T220001)]] (duration: 00m 58s) | 
  [production] | 
            
  | 17:00 | 
  <lucaswerkmeister-wmde@deploy1001> | 
  Synchronized php-1.33.0-wmf.24/extensions/EventBus: SWAT: [[gerrit:500959|Incorrect order of calls in createPageDeleteEvent.]] (duration: 00m 59s) | 
  [production] | 
            
  | 16:51 | 
  <gehel@cumin2001> | 
  END (FAIL) - Cookbook sre.elasticsearch.rolling-reboot (exit_code=99) | 
  [production] | 
            
  | 16:44 | 
  <gehel@cumin2001> | 
  START - Cookbook sre.elasticsearch.rolling-reboot | 
  [production] | 
            
  | 16:37 | 
  <Lucas_WMDE> | 
  lucaswerkmeister-wmde@mwmaint1002:~$ mwscript maintenance/namespaceDupes.php --wiki=idwiktionary --fix # T218796 – 41 links to fix, 41 were resolvable, Looks good! | 
  [production] | 
            
  | 16:36 | 
  <lucaswerkmeister-wmde@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: [[gerrit:499530|Add namespace "Lampiran" at id.wiktionary (T218796)]] (duration: 00m 59s) | 
  [production] | 
            
  | 16:29 | 
  <lucaswerkmeister-wmde@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:500761|Enable Draft namespace on srwiki (T214428)]] (duration: 01m 00s) | 
  [production] | 
            
  | 16:22 | 
  <lucaswerkmeister-wmde@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:500154|Add three domains at wgCopyUploadDomains (T216886, T219075)]] (duration: 01m 00s) | 
  [production] | 
            
  | 16:16 | 
  <lucaswerkmeister-wmde@deploy1001> | 
  Synchronized wmf-config/flaggedrevs.php: SWAT: [[gerrit:500153|Remove namespace 104 from FlaggedRevs configuration for arwiki (T217507)]] (duration: 01m 00s) | 
  [production] | 
            
  | 15:18 | 
  <volans> | 
  shutdown ms-be2026 for firmware upgrade - T219854 | 
  [production] | 
            
  | 15:16 | 
  <volans@cumin1001> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | 
  [production] | 
            
  | 15:16 | 
  <volans@cumin1001> | 
  START - Cookbook sre.hosts.downtime | 
  [production] | 
            
  | 15:00 | 
  <anomie@mwmaint1002> | 
  Fixing empty values for 'target_author_actor' in log_search on wikitech for T215525 | 
  [production] | 
            
  | 15:00 | 
  <anomie@mwmaint1002> | 
  Fixing empty values for 'target_author_actor' in log_search on section 8 wikis for T215525 | 
  [production] | 
            
  | 15:00 | 
  <anomie@mwmaint1002> | 
  Fixing empty values for 'target_author_actor' in log_search on section 7 wikis for T215525 | 
  [production] | 
            
  | 15:00 | 
  <anomie@mwmaint1002> | 
  Fixing empty values for 'target_author_actor' in log_search on section 6 wikis for T215525 | 
  [production] | 
            
  | 15:00 | 
  <anomie@mwmaint1002> | 
  Fixing empty values for 'target_author_actor' in log_search on section 5 wikis for T215525 | 
  [production] | 
            
  | 15:00 | 
  <anomie@mwmaint1002> | 
  Fixing empty values for 'target_author_actor' in log_search on section 4 wikis for T215525 | 
  [production] | 
            
  | 15:00 | 
  <anomie@mwmaint1002> | 
  Fixing empty values for 'target_author_actor' in log_search on remaining section 3 wikis for T215525 | 
  [production] | 
            
  | 15:00 | 
  <anomie@mwmaint1002> | 
  Fixing empty values for 'target_author_actor' in log_search on section 2 wikis for T215525 | 
  [production] | 
            
  | 14:59 | 
  <anomie@mwmaint1002> | 
  Fixing empty values for 'target_author_actor' in log_search on section 1 wikis for T215525 | 
  [production] | 
            
  | 14:56 | 
  <anomie@deploy1001> | 
  Synchronized php-1.33.0-wmf.24/maintenance/includes/MigrateActors.php: Backporting fix from [[gerrit:500754]] (duration: 01m 01s) | 
  [production] | 
            
  | 14:55 | 
  <anomie@deploy1001> | 
  Synchronized php-1.33.0-wmf.23/maintenance/includes/MigrateActors.php: Backporting fix from [[gerrit:500754]] (duration: 01m 01s) | 
  [production] | 
            
  | 14:18 | 
  <marostegui> | 
  Stop replication on pc2007 for testing - T210725 | 
  [production] | 
            
  | 14:03 | 
  <andrewbogott> | 
  restarting rabbitmq on cloudcontrol1003 | 
  [production] | 
            
  | 13:59 | 
  <andrewbogott> | 
  restarting neutron-l3-agent on cloudnet1003 and cloudnet1004 | 
  [production] | 
            
  | 13:46 | 
  <andrewbogott> | 
  restarting neutron-metadata-agent on cloudnet1003 | 
  [production] | 
            
  | 13:44 | 
  <gilles@deploy1001> | 
  Synchronized php-1.33.0-wmf.23/includes/media/MediaTransformOutput.php: T216499 Identify images that should have had high importance (duration: 00m 59s) | 
  [production] | 
            
  | 13:34 | 
  <moritzm> | 
  reverting dbmonitor2001 to deb8u12+wmf1 build | 
  [production] | 
            
  | 13:02 | 
  <gehel@cumin2001> | 
  END (FAIL) - Cookbook sre.elasticsearch.rolling-reboot (exit_code=99) | 
  [production] | 
            
  | 13:01 | 
  <gehel@cumin2001> | 
  START - Cookbook sre.elasticsearch.rolling-reboot | 
  [production] | 
            
  | 12:49 | 
  <gehel@cumin2001> | 
  END (FAIL) - Cookbook sre.elasticsearch.rolling-reboot (exit_code=99) | 
  [production] | 
            
  | 12:45 | 
  <gehel@cumin2001> | 
  START - Cookbook sre.elasticsearch.rolling-reboot | 
  [production] | 
            
  | 12:42 | 
  <arturo> | 
  T219626 reimaging cloudcontrol2001-dev | 
  [production] | 
            
  | 12:31 | 
  <mutante> | 
  restarting gerrit service to apply change 498431 | 
  [production] | 
            
  | 11:25 | 
  <Amir1> | 
  EU SWAT is done | 
  [production] | 
            
  | 11:16 | 
  <jbond42> | 
  rolling security updates for apache | 
  [production] | 
            
  | 10:29 | 
  <mutante> | 
  planet1001/2001 - apt autoremove un-required packages | 
  [production] | 
            
  | 10:27 | 
  <mutante> | 
  planet1001/2001 - upgrade apache2, openssh, locales, rsyslog .. | 
  [production] | 
            
  | 10:25 | 
  <arturo> | 
  updating puppet compiler facts | 
  [production] | 
            
  | 10:19 | 
  <volans> | 
  upgraded spicerack to 0.0.21 on cumin[12]001 | 
  [production] | 
            
  | 10:17 | 
  <volans> | 
  uploaded spicerack_0.0.21-1_amd64.deb to apt.wikimedia.org stretch-wikimedia | 
  [production] | 
            
  | 09:56 | 
  <marostegui> | 
  Alter empty job table on s6 primary master - T219887 | 
  [production] | 
            
  | 09:55 | 
  <moritzm> | 
  upgrading beta to hhvm wikidiff 1.8.1 (T203069) | 
  [production] | 
            
  | 09:54 | 
  <mutante> | 
  running mysql select queries on m3-slave to get data from phabricator conpherence as requested by andre | 
  [production] | 
            
  | 09:45 | 
  <moritzm> | 
  removed labtestnet2003.codfw.wmnet from debmonitor (T219776) | 
  [production] | 
            
  | 09:29 | 
  <ema> | 
  cp-ats-codfw: test ATS rolling restart T213263 | 
  [production] |