| 2018-11-26
      
      ยง | 
    
  | 23:50 | <ottomata> | temporarily disabling puppet on stat1007 to copy over eventbus validation logs (not using stat1007 after all) | [production] | 
            
  | 23:48 | <ottomata> | temporarily disabling puppet on stat1007 to copy over eventbus validation logs | [production] | 
            
  | 23:24 | <sbassett@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Remove unblockself right everywhere 2046d8df3 T150826 (duration: 00m 47s) | [production] | 
            
  | 23:15 | <XioNoX> | depool ulsfo for transport providers maintenance | [production] | 
            
  | 20:14 | <ebernhardson@deploy1001> | Synchronized php-1.33.0-wmf.4/extensions/Wikibase/repo/includes/Search/Elastic/EntitySearchElastic.php: SWAT T209402 Make wbsearchentities tie-breaker configurable (duration: 00m 47s) | [production] | 
            
  | 19:33 | <ebernhardson@deploy1001> | Synchronized wmf-config/WikibaseSearchSettings.php: SWAT T209402 Search profiles for wbsearchentities AB test (duration: 00m 46s) | [production] | 
            
  | 19:25 | <ebernhardson@deploy1001> | Synchronized php-1.33.0-wmf.4/extensions/WikimediaEvents/includes/: SWAT T210003 T210004 EditorJourney: Adjust DeferredUpdates usage (duration: 00m 46s) | [production] | 
            
  | 19:24 | <XioNoX> | remove IP from blacklist on Amsterdam routers - T201411 | [production] | 
            
  | 19:24 | <cmjohnson1> | cloudvirt1019 is going down to check something for HPE | [production] | 
            
  | 19:16 | <ebernhardson@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT T209432 Enable NewUserMessage extension on tcy.wikipedia (duration: 00m 48s) | [production] | 
            
  | 18:50 | <mutante> | stopping icinga service on einsteinium, is a role(spare) now T209738 | [production] | 
            
  | 18:46 | <mutante> | removed allowed sender addresses from AQL (mail2SMS gateway) portal: @einsteinium  @tegmen addresses  T208824 T209738 | [production] | 
            
  | 18:45 | <ppchelko@deploy1001> | Finished deploy [changeprop/deploy@c89bff5]: Prepared for ORES error response T197000 (duration: 01m 13s) | [production] | 
            
  | 18:44 | <ppchelko@deploy1001> | Started deploy [changeprop/deploy@c89bff5]: Prepared for ORES error response T197000 | [production] | 
            
  | 18:41 | <XioNoX> | re-activate BGP to AS41692 on cr2-esams | [production] | 
            
  | 18:15 | <onimisionipe@deploy1001> | Finished deploy [wdqs/wdqs@8bfea2b]: GUI updates and updater with dump and revision logging. (duration: 11m 13s) | [production] | 
            
  | 18:04 | <onimisionipe@deploy1001> | Started deploy [wdqs/wdqs@8bfea2b]: GUI updates and updater with dump and revision logging. | [production] | 
            
  | 17:54 | <bblack@neodymium> | conftool action : set/pooled=yes; selector: name=cp5001.eqsin.wmnet | [production] | 
            
  | 17:53 | <bblack> | re-pooling cp5001 - T199675 | [production] | 
            
  | 17:53 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Fully repool db1122 (duration: 00m 46s) | [production] | 
            
  | 17:44 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase traffic for db1122 (duration: 00m 46s) | [production] | 
            
  | 17:35 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase traffic for db1122 (duration: 00m 46s) | [production] | 
            
  | 17:26 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase traffic for db1122 (duration: 00m 45s) | [production] | 
            
  | 17:22 | <jdrewniak@deploy1001> | Synchronized portals: Wikimedia Portals Update: [[gerrit:475791|Reverting: Bumping portals to master (T128546)]] (duration: 00m 46s) | [production] | 
            
  | 17:22 | <jdrewniak@deploy1001> | Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:475791|Reverting: Bumping portals to master (T128546)]] (duration: 00m 46s) | [production] | 
            
  | 17:16 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1090:3312 and db1122 (duration: 00m 46s) | [production] | 
            
  | 16:01 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1090:3312 to clone db1122 (duration: 00m 46s) | [production] | 
            
  | 16:00 | <marostegui> | Stop MySQL on db1090:3312 to clone db1122 | [production] | 
            
  | 15:57 | <marostegui> | Stop MySQL on db1122 - it will be recloned | [production] | 
            
  | 15:50 | <ppchelko@deploy1001> | Finished deploy [changeprop/deploy@77be2c6]: Change schema for revision-score events and start emitting again T197000 (duration: 01m 24s) | [production] | 
            
  | 15:48 | <ppchelko@deploy1001> | Started deploy [changeprop/deploy@77be2c6]: Change schema for revision-score events and start emitting again T197000 | [production] | 
            
  | 15:32 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1122 - actor table missing (duration: 00m 46s) | [production] | 
            
  | 15:27 | <ppchelko@deploy1001> | Finished deploy [changeprop/deploy@b97e8eb]: Temporary stop emitting revision-score events for schema change T197000 (duration: 01m 21s) | [production] | 
            
  | 15:26 | <ppchelko@deploy1001> | Started deploy [changeprop/deploy@b97e8eb]: Temporary stop emitting revision-score events for schema change T197000 | [production] | 
            
  | 15:24 | <anomie@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Setting actor migration to write-both/read-old on group 1 (T188327) (duration: 00m 46s) | [production] | 
            
  | 13:47 | <moritzm> | rebooting releases1001 | [production] | 
            
  | 13:36 | <moritzm> | rebooting releases2001 | [production] | 
            
  | 13:33 | <moritzm> | rebooting netmon1003 | [production] | 
            
  | 12:04 | <_joe_> | uploaded php-excimer for component thirdparty/php72 to stretch-wikimedia T205059 | [production] | 
            
  | 12:00 | <kartik@deploy1001> | Finished deploy [cxserver/deploy@da41227]: Disable Youdao MT until service is back (duration: 04m 01s) | [production] | 
            
  | 11:56 | <kartik@deploy1001> | Started deploy [cxserver/deploy@da41227]: Disable Youdao MT until service is back | [production] | 
            
  | 11:41 | <arturo> | icinga downtime cloudcontrol1004 for some systemd slice tests | [production] | 
            
  | 11:01 | <jdrewniak@deploy1001> | Synchronized portals: Wikimedia Portals Update: [[gerrit:475721|Bumping portals to master (T128546)]] (duration: 00m 46s) | [production] | 
            
  | 11:00 | <jdrewniak@deploy1001> | Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:475721|Bumping portals to master (T128546)]] (duration: 00m 47s) | [production] | 
            
  | 10:32 | <moritzm> | rebooting boron | [production] | 
            
  | 09:58 | <banyek> | performing schema change on s6 master - db1061 for frwiki (T85757) | [production] | 
            
  | 09:51 | <banyek> | performing schema change on s6 master - db1061 for ruwiki (T85757) | [production] | 
            
  | 09:44 | <banyek> | performing schema change on s6 master - db1061 for jawiki (T85757) | [production] | 
            
  | 08:35 | <moritzm> | removed labvirt1015 from debmonitor DB (got renamed to cloudvirt1015) | [production] | 
            
  | 08:22 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1096:3316 - T202167 (duration: 00m 46s) | [production] |