| 2017-06-06
      
      ยง | 
    
  | 18:55 | <maxsem@tin> | Finished scap: LoginNotify to testwiki - rebuild messages (duration: 38m 19s) | [production] | 
            
  | 18:16 | <maxsem@tin> | Started scap: LoginNotify to testwiki - rebuild messages | [production] | 
            
  | 18:15 | <maxsem@tin> | Synchronized wmf-config: https://gerrit.wikimedia.org/r/#/c/357317/2 (duration: 00m 44s) | [production] | 
            
  | 18:10 | <maxsem@tin> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/357317/2 (duration: 00m 44s) | [production] | 
            
  | 18:03 | <demon@tin> | Finished scap: testwiki to wmf.3, prepping l10n cache (duration: 31m 58s) | [production] | 
            
  | 17:31 | <demon@tin> | Started scap: testwiki to wmf.3, prepping l10n cache | [production] | 
            
  | 16:53 | <moritzm> | installing wireshark security updates on trusty (jessie already fixed) | [production] | 
            
  | 16:41 | <bblack> | rebooted lvs1007 (kernel update) | [production] | 
            
  | 16:35 | <bblack> | rebooted lvs1007 (kernel update) | [production] | 
            
  | 15:21 | <otto@tin> | Finished deploy [eventlogging/analytics@37233cd]: (no justification provided) (duration: 00m 04s) | [production] | 
            
  | 15:21 | <otto@tin> | Started deploy [eventlogging/analytics@37233cd]: (no justification provided) | [production] | 
            
  | 14:58 | <moritzm> | installing libsndfile security updates on trusty | [production] | 
            
  | 14:01 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Restore db1094 original weight (duration: 00m 40s) | [production] | 
            
  | 13:46 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Increase db1094 weight (duration: 00m 40s) | [production] | 
            
  | 13:39 | <elukey> | shutdown analytics1033 and analytics1039 to replace their BBU - T166140 | [production] | 
            
  | 13:33 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1094 with low weight (duration: 00m 40s) | [production] | 
            
  | 12:58 | <marostegui> | Shutdown db1094 for maintenance - T166518 | [production] | 
            
  | 12:58 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1094 for maintenance - T166518 (duration: 00m 39s) | [production] | 
            
  | 12:51 | <godog> | upgrade scap to 3.5.8 - T127762 | [production] | 
            
  | 12:41 | <mobrovac@tin> | Finished deploy [changeprop/deploy@e92dd66]: Bump src to bc8abf3 (duration: 01m 45s) | [production] | 
            
  | 12:40 | <mobrovac@tin> | Started deploy [changeprop/deploy@e92dd66]: Bump src to bc8abf3 | [production] | 
            
  | 12:16 | <bblack> | cp1049 - restaret varnish backend for mailbox lag | [production] | 
            
  | 12:08 | <gehel> | kill stuck osm replication on maps1001 | [production] | 
            
  | 11:28 | <akosiaris@tin> | Finished deploy [servermon/servermon@4a2288f]: (no justification provided) (duration: 00m 04s) | [production] | 
            
  | 11:28 | <akosiaris@tin> | Started deploy [servermon/servermon@4a2288f]: (no justification provided) | [production] | 
            
  | 11:16 | <moritzm> | uploaded ferm 2.3.2+wmf1 to apt.wikimedia.org/stretch-wikimedia (T166653) | [production] | 
            
  | 11:02 | <ladsgroup@tin> | Synchronized wmf-config/Wikibase-production.php: Enabling writing in full entity id in testwikidatawiki (T165197) (duration: 00m 39s) | [production] | 
            
  | 10:22 | <moritzm> | installing NSS security updates | [production] | 
            
  | 09:43 | <moritzm> | installing perl security updates | [production] | 
            
  | 09:41 | <akosiaris> | stop jobchron/jobrunner processes across jobrunner and videoscalers in codfw | [production] | 
            
  | 09:35 | <akosiaris> | restart jobchron service across videoscalers T129148 | [production] | 
            
  | 09:33 | <akosiaris> | restart jobchron service across jobrunners T129148 | [production] | 
            
  | 09:32 | <akosiaris@tin> | Finished deploy [jobrunner/jobrunner@161c84c]: (no justification provided) (duration: 01m 17s) | [production] | 
            
  | 09:31 | <akosiaris@tin> | Started deploy [jobrunner/jobrunner@161c84c]: (no justification provided) | [production] | 
            
  | 09:29 | <akosiaris> | running puppet on jobrunners T129148 | [production] | 
            
  | 09:25 | <akosiaris> | running puppet on videoscalers T129148 | [production] | 
            
  | 09:25 | <akosiaris> | moving around jobrunner/jobrunner was probably not required T129148 | [production] | 
            
  | 09:19 | <akosiaris> | running puppet again on tin, after moving /serv/deployment/jobrunner/jobrunner T129148 | [production] | 
            
  | 09:12 | <akosiaris> | running puppet on mw1161 T129148 | [production] | 
            
  | 09:11 | <akosiaris> | git pull and scap deploy --init for jobrunner T129148 | [production] | 
            
  | 09:08 | <akosiaris> | running puppet on tin T129148 | [production] | 
            
  | 09:04 | <akosiaris> | disable puppet on all jobrunners T129148 | [production] | 
            
  | 09:04 | <akosiaris> | disable puppet on all jobrunners | [production] | 
            
  | 08:54 | <dcausse> | restarting elastic2014 to reclaim free space on deleted log file | [production] | 
            
  | 08:43 | <jynus> | stopping db2035 and preparing for reimage | [production] | 
            
  | 08:39 | <gehel> | raise log level to WARN for TransportShardBulkAction on elasticsearch cirrus - T167091 | [production] | 
            
  | 07:53 | <gehel> | starting upgrade to elasticsearch 5.3.2 on cirrus eqiad cluster - T163708 | [production] | 
            
  | 06:40 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Add comments about current status of db1089 - T166935 (duration: 00m 39s) | [production] | 
            
  | 05:56 | <marostegui> | Deploy alter table s3 on db1075 (eqiad master) - T166278 | [production] | 
            
  | 02:27 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Tue Jun  6 02:27:37 UTC 2017 (duration 6m 3s) | [production] |