| 2017-11-14
      
      § | 
    
  | 19:09 | <chasemp> | for i in `OS_TENANT_NAME=testlabs openstack server list | grep stress | awk '{print $2}'`; do echo $i; OS_TENANT_NAME=testlabs openstack server delete $i; sleep 30; done T171473 | [production] | 
            
  | 19:02 | <demon@tin> | Started scap: bootstrap wmf.8 | [production] | 
            
  | 18:32 | <arlolra> | Updated Parsoid to e71937d0 (T178253) | [production] | 
            
  | 18:31 | <mholloway-shell@tin> | Finished deploy [mobileapps/deploy@9b10959]: Redeploying: Update mobileapps to c002862 (duration: 29m 12s) | [production] | 
            
  | 18:28 | <moritzm> | upgraded nginx on notebook* to 1.13.6 | [production] | 
            
  | 18:26 | <madhuvishy> | Upgraded notebook1001 and 1002 to kernel version 4.9.51-1~bpo8+1 | [production] | 
            
  | 18:22 | <arlolra@tin> | Finished deploy [parsoid/deploy@b150764]: Updating Parsoid to e71937d0 (duration: 09m 13s) | [production] | 
            
  | 18:21 | <ebernhardson@tin> | Finished deploy [search/mjolnir/deploy@e6905f4]: test mjolnir deployment (duration: 01m 13s) | [production] | 
            
  | 18:19 | <ebernhardson@tin> | Started deploy [search/mjolnir/deploy@e6905f4]: test mjolnir deployment | [production] | 
            
  | 18:13 | <arlolra@tin> | Started deploy [parsoid/deploy@b150764]: Updating Parsoid to e71937d0 | [production] | 
            
  | 18:08 | <ebernhardson@tin> | Finished deploy [search/mjolnir/deploy@cd6ddda]: (no justification provided) (duration: 04m 28s) | [production] | 
            
  | 18:07 | <moritzm> | rebooting notebook* hosts for update to 4.9.51 | [production] | 
            
  | 18:04 | <ebernhardson@tin> | Started deploy [search/mjolnir/deploy@cd6ddda]: (no justification provided) | [production] | 
            
  | 18:02 | <mholloway-shell@tin> | Started deploy [mobileapps/deploy@9b10959]: Redeploying: Update mobileapps to c002862 | [production] | 
            
  | 17:58 | <ebernhardson@tin> | Finished deploy [search/mjolnir/deploy@ceb5c2f]: (no justification provided) (duration: 00m 20s) | [production] | 
            
  | 17:57 | <ebernhardson@tin> | Started deploy [search/mjolnir/deploy@ceb5c2f]: (no justification provided) | [production] | 
            
  | 17:56 | <ebernhardson@tin> | Finished deploy [search/MjoLniR/deploy@607adfb]: (no justification provided) (duration: 00m 14s) | [production] | 
            
  | 17:56 | <ebernhardson@tin> | Started deploy [search/MjoLniR/deploy@607adfb]: (no justification provided) | [production] | 
            
  | 17:44 | <herron> | restarted puppetdb on nitrogen and nihal to pick up jre updates | [production] | 
            
  | 17:42 | <smalyshev@tin> | Finished deploy [wdqs/wdqs@b44cf27]: data reload/T176593 (duration: 00m 16s) | [production] | 
            
  | 17:42 | <smalyshev@tin> | Started deploy [wdqs/wdqs@b44cf27]: data reload/T176593 | [production] | 
            
  | 17:27 | <demon@tin> | Pruned MediaWiki: 1.31.0-wmf.3 (duration: 07m 58s) | [production] | 
            
  | 17:12 | <demon@tin> | Synchronized wmf-config/CommonSettings.php: Beta-only, no-op (duration: 00m 43s) | [production] | 
            
  | 17:11 | <demon@tin> | Synchronized wmf-config/extension-list-labs: No-op (duration: 00m 44s) | [production] | 
            
  | 17:10 | <demon@tin> | Pruned MediaWiki: 1.31.0-wmf.6 [keeping static files] (duration: 02m 48s) | [production] | 
            
  | 16:32 | <twentyafterfour> | Restarting apache2 on phab1001 (deploy phabricator hotfix: D876 ) | [production] | 
            
  | 16:23 | <jynus> | stop labsdb1010 mariadb to clone it later to labsdb1009 T179244 | [production] | 
            
  | 15:04 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Fully pool db1105 in s1 and s2 - T178359 (duration: 00m 45s) | [production] | 
            
  | 15:00 | <thcipriani@tin> | testing IRC logging | [production] | 
            
  | 15:00 | <urandom> | Decommissioning Cassandra, restbase1012-c.eqiad.wmnet (T179422) | [production] | 
            
  | 14:37 | <moritzm> | installing postgres security updates on maps* | [production] | 
            
  | 14:29 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 14:07 | <moritzm> | installing postgres security updates on labsdb1004 | [production] | 
            
  | 13:11 | <moritzm> | installing openssl updates | [production] | 
            
  | 13:10 | <akosiaris> | shutdown install1002 for disk resize | [production] | 
            
  | 12:57 | <godog> | upgrade grafana to 4.6.1 on https://grafana-labs.wikimedia.org/ - T180428 | [production] | 
            
  | 12:03 | <ema> | restart varnish-be on cp3007, requests failing with 'no backend connection' | [production] | 
            
  | 11:49 | <moritzm> | rebooting remaining app servers in eqiad for update to Linux 4.9.51 (and to pick up OpenSSL updates) | [production] | 
            
  | 11:22 | <moritzm> | rebooting remaining API servers in eqiad for update to Linux 4.9.51 (and to pick up OpenSSL updates) | [production] | 
            
  | 11:04 | <godog> | reimage restbase2002 - T179422 | [production] | 
            
  | 10:50 | <marostegui> | Deploy alter table on s5: db1104 db1100 db1106 - T174569 | [production] | 
            
  | 10:32 | <elukey> | removed old target configs from /srv/prometheus/analytics/targets on prometheus100[34] after https://gerrit.wikimedia.org/r/391179 | [production] | 
            
  | 10:23 | <moritzm> | rebooting image scalers in eqiad for update to Linux 4.9.51 (and to pick up OpenSSL updates) | [production] | 
            
  | 10:07 | <godog> | upload scap 3.7.2-1 - T127762 | [production] | 
            
  | 09:59 | <mobrovac@tin> | Synchronized wmf-config/jobqueue.php: JobQueue: Migrate RecordLintJob to EventBus - T175212 (duration: 00m 46s) | [production] | 
            
  | 09:56 | <marostegui> | Deploy alter table on s5 - dbstore1001 - T174569 | [production] | 
            
  | 09:49 | <foks> | Disabled 2FA for Jean-Frédéric | [production] | 
            
  | 09:46 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Pool db1105 as multi-instance host for s1 and s2 - T178359 (duration: 00m 46s) | [production] | 
            
  | 09:45 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Pool db1105 as multi-instance host for s1 and s2 - T178359 (duration: 00m 47s) | [production] | 
            
  | 09:43 | <godog> | upgrade prometheus to 1.8.1 with k8s on prometheus2004 - T177395 | [production] |