| 2019-04-03
      
      § | 
    
  | 18:14 | <thcipriani> | gerrit back on 2.15.12 | [production] | 
            
  | 18:12 | <thcipriani> | restarting gerrit for 2.15.12 update | [production] | 
            
  | 18:11 | <thcipriani@deploy1001> | Finished deploy [gerrit/gerrit@e416edf]: Gerrit to 2.15.12 on cobalt (restart to follow) (duration: 00m 11s) | [production] | 
            
  | 18:11 | <thcipriani@deploy1001> | Started deploy [gerrit/gerrit@e416edf]: Gerrit to 2.15.12 on cobalt (restart to follow) | [production] | 
            
  | 18:09 | <thcipriani@deploy1001> | Finished deploy [gerrit/gerrit@e416edf]: Gerrit to 2.15.12 on gerrit2001 only (duration: 00m 11s) | [production] | 
            
  | 18:09 | <thcipriani@deploy1001> | Started deploy [gerrit/gerrit@e416edf]: Gerrit to 2.15.12 on gerrit2001 only | [production] | 
            
  | 17:57 | <elukey> | restart hadoop-hdfs-namenode on an-master1001 as precautionary measure after the outage (currently standby) | [production] | 
            
  | 17:44 | <herron> | shortly postponing restarts of eventbus and kafka services for security updates due to unrelated firefighting - repooling kafka1001 | [production] | 
            
  | 17:19 | <elukey> | restart hadoop-hdfs-namenode on an-master1002 after forced shutdown due to errors | [production] | 
            
  | 17:14 | <herron> | depooling kafka1001 to restart eventbus and kafka services for security updates | [production] | 
            
  | 17:04 | <Lucas_WMDE> | EU SWAT done | [production] | 
            
  | 17:04 | <Lucas_WMDE> | lucaswerkmeister-wmde@mwmaint1002:~$ mwscript maintenance/namespaceDupes.php --wiki=srwiki --fix # T214428 – 0 pages to fix, 0 links to fix, Looks good! | [production] | 
            
  | 17:03 | <lucaswerkmeister-wmde@deploy1001> | Synchronized wmf-config/throttle.php: SWAT: [[gerrit:500987|Add new throttle rule (T220001)]] (duration: 00m 58s) | [production] | 
            
  | 17:00 | <lucaswerkmeister-wmde@deploy1001> | Synchronized php-1.33.0-wmf.24/extensions/EventBus: SWAT: [[gerrit:500959|Incorrect order of calls in createPageDeleteEvent.]] (duration: 00m 59s) | [production] | 
            
  | 16:51 | <gehel@cumin2001> | END (FAIL) - Cookbook sre.elasticsearch.rolling-reboot (exit_code=99) | [production] | 
            
  | 16:44 | <gehel@cumin2001> | START - Cookbook sre.elasticsearch.rolling-reboot | [production] | 
            
  | 16:37 | <Lucas_WMDE> | lucaswerkmeister-wmde@mwmaint1002:~$ mwscript maintenance/namespaceDupes.php --wiki=idwiktionary --fix # T218796 – 41 links to fix, 41 were resolvable, Looks good! | [production] | 
            
  | 16:36 | <lucaswerkmeister-wmde@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: [[gerrit:499530|Add namespace "Lampiran" at id.wiktionary (T218796)]] (duration: 00m 59s) | [production] | 
            
  | 16:29 | <lucaswerkmeister-wmde@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:500761|Enable Draft namespace on srwiki (T214428)]] (duration: 01m 00s) | [production] | 
            
  | 16:22 | <lucaswerkmeister-wmde@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:500154|Add three domains at wgCopyUploadDomains (T216886, T219075)]] (duration: 01m 00s) | [production] | 
            
  | 16:16 | <lucaswerkmeister-wmde@deploy1001> | Synchronized wmf-config/flaggedrevs.php: SWAT: [[gerrit:500153|Remove namespace 104 from FlaggedRevs configuration for arwiki (T217507)]] (duration: 01m 00s) | [production] | 
            
  | 15:18 | <volans> | shutdown ms-be2026 for firmware upgrade - T219854 | [production] | 
            
  | 15:16 | <volans@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 15:16 | <volans@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 15:00 | <anomie@mwmaint1002> | Fixing empty values for 'target_author_actor' in log_search on wikitech for T215525 | [production] | 
            
  | 15:00 | <anomie@mwmaint1002> | Fixing empty values for 'target_author_actor' in log_search on section 8 wikis for T215525 | [production] | 
            
  | 15:00 | <anomie@mwmaint1002> | Fixing empty values for 'target_author_actor' in log_search on section 7 wikis for T215525 | [production] | 
            
  | 15:00 | <anomie@mwmaint1002> | Fixing empty values for 'target_author_actor' in log_search on section 6 wikis for T215525 | [production] | 
            
  | 15:00 | <anomie@mwmaint1002> | Fixing empty values for 'target_author_actor' in log_search on section 5 wikis for T215525 | [production] | 
            
  | 15:00 | <anomie@mwmaint1002> | Fixing empty values for 'target_author_actor' in log_search on section 4 wikis for T215525 | [production] | 
            
  | 15:00 | <anomie@mwmaint1002> | Fixing empty values for 'target_author_actor' in log_search on remaining section 3 wikis for T215525 | [production] | 
            
  | 15:00 | <anomie@mwmaint1002> | Fixing empty values for 'target_author_actor' in log_search on section 2 wikis for T215525 | [production] | 
            
  | 14:59 | <anomie@mwmaint1002> | Fixing empty values for 'target_author_actor' in log_search on section 1 wikis for T215525 | [production] | 
            
  | 14:56 | <anomie@deploy1001> | Synchronized php-1.33.0-wmf.24/maintenance/includes/MigrateActors.php: Backporting fix from [[gerrit:500754]] (duration: 01m 01s) | [production] | 
            
  | 14:55 | <anomie@deploy1001> | Synchronized php-1.33.0-wmf.23/maintenance/includes/MigrateActors.php: Backporting fix from [[gerrit:500754]] (duration: 01m 01s) | [production] | 
            
  | 14:18 | <marostegui> | Stop replication on pc2007 for testing - T210725 | [production] | 
            
  | 14:03 | <andrewbogott> | restarting rabbitmq on cloudcontrol1003 | [production] | 
            
  | 13:59 | <andrewbogott> | restarting neutron-l3-agent on cloudnet1003 and cloudnet1004 | [production] | 
            
  | 13:46 | <andrewbogott> | restarting neutron-metadata-agent on cloudnet1003 | [production] | 
            
  | 13:44 | <gilles@deploy1001> | Synchronized php-1.33.0-wmf.23/includes/media/MediaTransformOutput.php: T216499 Identify images that should have had high importance (duration: 00m 59s) | [production] | 
            
  | 13:34 | <moritzm> | reverting dbmonitor2001 to deb8u12+wmf1 build | [production] | 
            
  | 13:02 | <gehel@cumin2001> | END (FAIL) - Cookbook sre.elasticsearch.rolling-reboot (exit_code=99) | [production] | 
            
  | 13:01 | <gehel@cumin2001> | START - Cookbook sre.elasticsearch.rolling-reboot | [production] | 
            
  | 12:49 | <gehel@cumin2001> | END (FAIL) - Cookbook sre.elasticsearch.rolling-reboot (exit_code=99) | [production] | 
            
  | 12:45 | <gehel@cumin2001> | START - Cookbook sre.elasticsearch.rolling-reboot | [production] | 
            
  | 12:42 | <arturo> | T219626 reimaging cloudcontrol2001-dev | [production] | 
            
  | 12:31 | <mutante> | restarting gerrit service to apply change 498431 | [production] | 
            
  | 11:25 | <Amir1> | EU SWAT is done | [production] | 
            
  | 11:16 | <jbond42> | rolling security updates for apache | [production] | 
            
  | 10:29 | <mutante> | planet1001/2001 - apt autoremove un-required packages | [production] |