| 2017-06-30
      
      § | 
    
  | 23:16 | <dzahn@neodymium> | conftool action : set/pooled=no; selector: name=mw1196.eqiad.wmnet | [production] | 
            
  | 23:12 | <legoktm@tin> | Synchronized wmf-config/InitialiseSettings.php: Limit thanks for new users at pl.wikipedia to 3 per day - T169268 (duration: 02m 49s) | [production] | 
            
  | 23:05 | <mutante> | librenms has been deployed on netmon1002 - works on stretch now - except Letsencrypt part, expected. not switched yet | [production] | 
            
  | 22:42 | <mutante> | green unicorn now running on cubalibre (this means gunicornd used by the librenms role now works on stretch :) | [production] | 
            
  | 20:03 | <ariel@tin> | Finished deploy [dumps/dumps@02c71bc]: permit batching of abstract jobs, fix a dryrun reporting typo, smaller stub/abstract queries (duration: 00m 03s) | [production] | 
            
  | 20:03 | <ariel@tin> | Started deploy [dumps/dumps@02c71bc]: permit batching of abstract jobs, fix a dryrun reporting typo, smaller stub/abstract queries | [production] | 
            
  | 19:41 | <cmjohnson1> | powering off mw1196 for unresponsive idrac | [production] | 
            
  | 19:37 | <cmjohnson1> | powering off mw1191 for unresponsive idrac | [production] | 
            
  | 19:31 | <cmjohnson1> | powering off mw1190 to reestablish idrac connection | [production] | 
            
  | 19:21 | <cmjohnson1> | mw1182 powering down to due to unresponsive idrac | [production] | 
            
  | 17:01 | <paravoid> | rebooting mw1196 | [production] | 
            
  | 15:39 | <gehel> | unbanning elastic1019 from cluster and keeping an eye on it | [production] | 
            
  | 14:51 | <gehel> | banning elastic1019 from cluster to move heavy shards around | [production] | 
            
  | 14:16 | <bblack> | reboot cp4021 | [production] | 
            
  | 13:39 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1028 - T166208 (duration: 00m 42s) | [production] | 
            
  | 13:32 | <bawolff> | Reset 2FA of wikitech [[User:Samtar]] (T169332) | [production] | 
            
  | 12:47 | <jynus> | just upgraded wmf-mariadb101-client on mariadb::client hosts | [production] | 
            
  | 12:26 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Add comments to db1060 about its future usage as a sanitarium master - T153743 (duration: 00m 42s) | [production] | 
            
  | 12:08 | <akosiaris@tin> | Synchronized wmf-config/ProductionServices.php: Replace subra/suhail as poolcounters (duration: 00m 43s) | [production] | 
            
  | 12:07 | <akosiaris> | replace subra and suhail as poolcounters in codfw | [production] | 
            
  | 11:22 | <_joe_> | rebooting copper for kernel upgrade | [production] | 
            
  | 11:17 | <_joe_> | purging varnish, varnish-dbg from copper | [production] | 
            
  | 11:08 | <jynus> | removing leftover data on tegmen T149557 | [production] | 
            
  | 10:55 | <elukey> | deploy kafkatee 0.1.6-1 to oxygen | [production] | 
            
  | 10:41 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1026 - T168661 (duration: 00m 42s) | [production] | 
            
  | 10:38 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1026 - T168661 (duration: 00m 42s) | [production] | 
            
  | 09:54 | <elukey> | uploaded kafkatee 0.1.6-1 to reprepro - T151748 | [production] | 
            
  | 09:10 | <marostegui> | Deploy alter table on s5 all eqiad hosts (primary master not included) - T168661 | [production] | 
            
  | 09:01 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1037 - T168661 (duration: 00m 42s) | [production] | 
            
  | 08:58 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1037 - T168661 (duration: 00m 42s) | [production] | 
            
  | 08:34 | <ayounsi@tin> | Finished deploy [librenms/librenms@3f407a7]: (no justification provided) (duration: 00m 05s) | [production] | 
            
  | 08:34 | <ayounsi@tin> | Started deploy [librenms/librenms@3f407a7]: (no justification provided) | [production] | 
            
  | 08:29 | <ayounsi@tin> | Finished deploy [librenms/librenms@b10cc7c]: (no justification provided) (duration: 00m 02s) | [production] | 
            
  | 08:29 | <ayounsi@tin> | Started deploy [librenms/librenms@b10cc7c]: (no justification provided) | [production] | 
            
  | 08:16 | <akosiaris> | poweroff labcontrol1003. It was in the deian installer | [production] | 
            
  | 07:20 | <akosiaris> | restart pdfrender on scb1002 | [production] | 
            
  | 06:45 | <_joe_> | started manually burrow on krypton, could not start due to a stale pidfile | [production] | 
            
  | 06:38 | <marostegui> | Deploy alter table on s6 all eqiad hosts (primary master not included) - T168661 | [production] | 
            
  | 06:12 | <marostegui> | Deploy alter table on db1018 on s2 - T168661 | [production] | 
            
  | 06:12 | <marostegui> | Deploy alter table on db1090 on s2 - T168661 | [production] | 
            
  | 06:11 | <marostegui> | Deploy alter table on db1076 on s2 - T168661 | [production] | 
            
  | 06:10 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1060 - T168661 (duration: 00m 42s) | [production] |