| 2018-09-18
      
      § | 
    
  | 18:40 | <ppchelko@deploy1001> | Finished deploy [restbase/deploy@4c3128f]: Remove restrictions table T203835, Split 25% PDF traffic to Proton T186748, Metrics endpoints improvements, don't monitor PDF endpoints, take 2, feed timing out (duration: 07m 58s) | [production] | 
            
  | 18:32 | <ppchelko@deploy1001> | Started deploy [restbase/deploy@4c3128f]: Remove restrictions table T203835, Split 25% PDF traffic to Proton T186748, Metrics endpoints improvements, don't monitor PDF endpoints, take 2, feed timing out | [production] | 
            
  | 18:31 | <ppchelko@deploy1001> | Finished deploy [restbase/deploy@4c3128f]: Remove restrictions table T203835, Split 25% PDF traffic to Proton T186748, Metrics endpoints improvements, don't monitor PDF endpoints (duration: 08m 55s) | [production] | 
            
  | 18:22 | <ppchelko@deploy1001> | Started deploy [restbase/deploy@4c3128f]: Remove restrictions table T203835, Split 25% PDF traffic to Proton T186748, Metrics endpoints improvements, don't monitor PDF endpoints | [production] | 
            
  | 18:08 | <ppchelko@deploy1001> | Finished deploy [restbase/deploy@55100d4]: Remove restrictions table T203835, Split 25% PDF traffic to Proton T186748, Metrics endpoints improvements (duration: 03m 37s) | [production] | 
            
  | 18:04 | <ppchelko@deploy1001> | Started deploy [restbase/deploy@55100d4]: Remove restrictions table T203835, Split 25% PDF traffic to Proton T186748, Metrics endpoints improvements | [production] | 
            
  | 17:29 | <mutante> | scandium - move from role(spare) to role(parsoid_testing), making it equal to ruthenium (T201366) | [production] | 
            
  | 16:45 | <addshore@deploy1001> | Synchronized php-1.32.0-wmf.22/includes/watcheditem/WatchedItemStore.php: [[gerrit:461155|WatchedItemStore::countVisitingWatchersMultiple() fix]] T204729 (duration: 00m 57s) | [production] | 
            
  | 16:43 | <addshore@deploy1001> | Synchronized php-1.32.0-wmf.20/includes/watcheditem/WatchedItemStore.php: [[gerrit:461154|WatchedItemStore::countVisitingWatchersMultiple() fix]] T204729 (duration: 00m 59s) | [production] | 
            
  | 16:33 | <XioNoX> | delete `filter common-infrastructure4` on cr1/2-eqiad, unused/obsolete after T198623 | [production] | 
            
  | 16:33 | <mutante> | mwmaint2001 - nagios-nrpe-server had status 'failed' and caused all NRPE Icinga checks to fail but recovered after simply starting it again | [production] | 
            
  | 16:32 | <mutante> | radon - re-enabled disabled puppet without reason (decom) T202040 | [production] | 
            
  | 16:32 | <mutante> | mwmaint2001 - starting nagios-nrpe-server | [production] | 
            
  | 16:22 | <XioNoX> | delete `term cumin` from cr1/2-eqiad analytics filter (already permited by established-tcp term) | [production] | 
            
  | 16:02 | <moritzm> | installing policykit-1 security updates on jessie | [production] | 
            
  | 15:55 | <elukey@deploy1001> | Finished deploy [analytics/refinery@1a6235a]: Fix cron scrips from the NYC offsite (duration: 09m 32s) | [production] | 
            
  | 15:53 | <XioNoX> | add cumin2001 to mr* security policies - T204730 | [production] | 
            
  | 15:47 | <moritzm> | installing spice security updates | [production] | 
            
  | 15:46 | <elukey@deploy1001> | Started deploy [analytics/refinery@1a6235a]: Fix cron scrips from the NYC offsite | [production] | 
            
  | 15:26 | <XioNoX> | add cumin2001 to labs-in4 on cr1/2-eqiad | [production] | 
            
  | 15:23 | <hashar@deploy1001> | Finished scap: Sync again testwiki to php-1.32.0-wmf.20, I might have screwed up l10ncache (duration: 06m 31s) | [production] | 
            
  | 15:20 | <hashar> | hashar scap for testwiki is actually php-1.32.0-wmf.22 | [production] | 
            
  | 15:19 | <mepps> | updated process-control to c03857f6a6 | [production] | 
            
  | 15:17 | <hashar@deploy1001> | Started scap: Sync again testwiki to php-1.32.0-wmf.20, I might have screwed up l10ncache | [production] | 
            
  | 15:15 | <mepps> | updated process-control to f9ab984c5d | [production] | 
            
  | 15:07 | <hashar@deploy1001> | Finished scap: testwiki to php-1.32.0-wmf.20 (duration: 35m 46s) | [production] | 
            
  | 14:31 | <hashar@deploy1001> | Started scap: testwiki to php-1.32.0-wmf.20 | [production] | 
            
  | 14:19 | <marostegui> | Drop T153638_echo_XXX tables from db1123 | [production] | 
            
  | 14:02 | <marostegui> | Drop T153638_echo_XXX tables from db1095:3313 - T153638 | [production] | 
            
  | 13:58 | <papaul> | upgrading BIOS on ms-be2030 | [production] | 
            
  | 13:57 | <banyek@deploy1001> | Synchronized wmf-config/db-eqiad.php: T203565: Repool db1114 and db1119 (duration: 00m 49s) | [production] | 
            
  | 13:56 | <godog> | poweroff ms-be2030 - T204567 | [production] | 
            
  | 13:48 | <moritzm> | updating intel-microcode on Debian jessie/stretch to 3.20180807a.1 | [production] | 
            
  | 13:43 | <moritzm> | installing redis security updates on maps* servers | [production] | 
            
  | 13:32 | <godog> | repair sdd on ms-be2041 - T199198 | [production] | 
            
  | 13:31 | <marostegui> | Rename echo_XXX tables on db1095 and db1123 | [production] | 
            
  | 13:26 | <moritzm> | reimaging mw2245 (spare host) to test reimages from cumin2001 | [production] | 
            
  | 13:24 | <marostegui> | Drop T153638_echo_XXX tables from db1078 - T153638 | [production] | 
            
  | 13:21 | <hashar> | Cutting branches wmf/1.32.0-wmf.22 | T191068 | [production] | 
            
  | 13:10 | <marostegui> | Drop T153638_echo_XXX tables from db1077 - T153638 | [production] | 
            
  | 12:12 | <moritzm> | rebooting labnodepool1001 for kernel security update | [production] | 
            
  | 10:36 | <jynus> | stopping dbstore2002:s2 mariadb instance | [production] | 
            
  | 10:31 | <jynus> | stop db2041 to clone to dbstore2002 | [production] | 
            
  | 10:25 | <jynus@deploy1001> | Synchronized wmf-config/db-codfw.php: Depool db2041 (duration: 00m 49s) | [production] | 
            
  | 10:24 | <marostegui> | Rename echo_XXX tables on db1077 and db1078  - T153638 | [production] | 
            
  | 10:12 | <jynus@deploy1001> | Synchronized wmf-config/db-codfw.php: Tune the s3 and s5 database loads (duration: 00m 49s) | [production] | 
            
  | 10:09 | <marostegui> | Drop T153638_echo_XXX tables from dbstore2002:3313 - T153638 | [production] | 
            
  | 10:06 | <jynus@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1105 (duration: 00m 49s) | [production] | 
            
  | 10:04 | <hashar> | ci: updating Quibble Jenkins jobs to 0.0.26 | [production] | 
            
  | 10:01 | <marostegui> | Rename echo_XXX tables on dbstore2002:3313  - T153638 | [production] |