| 2017-05-19
      
      § | 
    
  | 16:44 | <reedy@tin> | Synchronized wmf-config/throttle.php: Wikimedia Vienna Hackathon (duration: 00m 39s) | [production] | 
            
  | 15:40 | <mutante> | planet10001 - manually deleting cron job for deleted sr.planet (should puppetize the "absence" too) | [production] | 
            
  | 13:58 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Repool db2047 - T165743 (duration: 00m 38s) | [production] | 
            
  | 13:47 | <marostegui> | Deploy alter table s7.frwiktionary db1033 - T165743 | [production] | 
            
  | 13:31 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Depool db2047 - T165743 (duration: 00m 39s) | [production] | 
            
  | 13:09 | <moritzm> | downgraded mw1161 to HHVM 3.12 (crashes often compared to app servers, downgrade over the weekend) | [production] | 
            
  | 12:58 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Repool db2068 - T165743 (duration: 00m 39s) | [production] | 
            
  | 12:40 | <marostegui> | Deploy alter table s7.frwiktionary on db2068 - T165743 | [production] | 
            
  | 12:40 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Depool db2068 - T165743 (duration: 00m 40s) | [production] | 
            
  | 11:39 | <marostegui> | Deploy alter table s2.revision table on labsdb1003 - T162611 | [production] | 
            
  | 11:05 | <moritzm> | uploaded nutcracker 0.4.1-1+wm3~jessie1 to apt.wikimedia.org (T163795) | [production] | 
            
  | 10:31 | <ebernhardson> | restarting elsaticsearch on relforge1001 to pull in remote reindex | [production] | 
            
  | 10:19 | <moritzm> | powercycling mw2221, stuck in reboot and serial console unresponsive | [production] | 
            
  | 10:08 | <_joe_> | moved stale repos to /srv/deployment/STALE on tin, T129290 | [production] | 
            
  | 10:07 | <moritzm> | rebooting mw2220/mw2221 for update to Linux 4.9 / HHVM 3.18 / nutcracker tests | [production] | 
            
  | 09:15 | <reedy@tin> | Synchronized dblists/: Update size dblists (duration: 00m 39s) | [production] | 
            
  | 09:01 | <reedy@tin> | Synchronized php-1.30.0-wmf.1/extensions/WikimediaMaintenance/makeSizeDBLists.php: Catch a silly error (duration: 00m 39s) | [production] | 
            
  | 08:14 | <jynus@tin> | Synchronized wmf-config/db-codfw.php: Depool db2048 for reimage (duration: 00m 39s) | [production] | 
            
  | 07:36 | <akosiaris> | reboot kubernetes2001 for tests | [production] | 
            
  | 06:51 | <moritzm> | installing openjdk-7/trusty regression update | [production] | 
            
  | 06:34 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1051 - T159753 T164530 (duration: 00m 38s) | [production] | 
            
  | 06:23 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1051 - T159753 T164530 (duration: 00m 39s) | [production] | 
            
  | 06:09 | <marostegui> | Deploy alter table s2.revision table - db1018 - https://phabricator.wikimedia.org/T162611 | [production] | 
            
  | 06:07 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1060 - T162611 (duration: 00m 40s) | [production] | 
            
  | 05:56 | <jynus> | shutting down db2049 and preparing it for reimage | [production] | 
            
  | 02:28 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Fri May 19 02:28:08 UTC 2017 (duration 6m 0s) | [production] | 
            
  | 02:22 | <l10nupdate@tin> | scap sync-l10n completed (1.30.0-wmf.1) (duration: 07m 53s) | [production] | 
            
  
    | 2017-05-18
      
      § | 
    
  | 20:47 | <mutante> | wasat - git pull - bring to latest, the last changed had never been deployed here like on terbium, but it's also not a backend for dbtree yet (T163141) | [production] | 
            
  | 20:44 | <mutante> | terbium / dbtree - deploying gerrit:353388 (sudo -u mwdeploy git pull origin   in /srv/dbtree) (T163143) | [production] | 
            
  | 20:03 | <urandom> | T164865: restarting RESTBase-dev, range delete-based render retention | [production] | 
            
  | 19:52 | <urandom> | T164865: restarting RESTBase-dev to apply range delete-based render retention | [production] | 
            
  | 19:06 | <urandom> | T164865: configure RESTBase tables for size-tiered compaction (dev env only) | [production] | 
            
  | 18:37 | <dereckson@tin> | Synchronized php-1.30.0-wmf.1/extensions/SecurePoll/includes/pages/DumpPage.php: Revert "Dump should return decrypted votes" (T145695) (duration: 00m 48s) | [production] | 
            
  | 17:10 | <robh> | mr1-ulsfo having oob connection re-routed at ulsfo, will flap a bit from 1700-1730 gmt | [production] | 
            
  | 17:09 | <moritzm> | upgrading mw2130-mw2139 to Linux 4.9 and HHVM 3.18 | [production] | 
            
  | 16:28 | <moritzm> | restarting cassandra on restbase1010, restbase1011, restbase1016, restbase1018 to pick up OpenJDK security updates | [production] | 
            
  | 16:11 | <elukey> | upgraded cassandra-tools-wmf on aqs hosts | [production] | 
            
  | 15:54 | <_joe_> | uploaded package cni to jessie-wikimedia | [production] | 
            
  | 15:34 | <marostegui> | Deploy alter table s2.revision table - db1060 - https://phabricator.wikimedia.org/T162611 | [production] | 
            
  | 15:34 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1074, depool db1060 - T162611 (duration: 00m 39s) | [production] | 
            
  | 14:46 | <moritzm> | rebooting restbase1008 for update to Linux 4.9 and to pick up OpenJDK security updates | [production] | 
            
  | 14:32 | <XioNoX> | rebooting mr1-ulsfo for software upgrade - T164970 | [production] | 
            
  | 14:12 | <akosiaris> | perform a final reboot on kubernetes200X | [production] | 
            
  | 13:47 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1055 - T159753 T164530 (duration: 00m 39s) | [production] | 
            
  | 13:40 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1055 - T159753 T164530 (duration: 01m 03s) | [production] |