| 2017-05-31
      
      § | 
    
  | 21:29 | <AaronSchulz> | Restored mwdebug1001 to wmf1 with normal nutcracker/memcached and puppet running | [production] | 
            
  | 21:23 | <ejegg> | updated payments-wiki from 4786e7c223fe7bc61bc9d03b63d85a7eaee4c622 to d467d3ba2ee6be94d5654fa5fcff32b1e0e792c3 | [production] | 
            
  | 20:17 | <RainbowSprinkles> | gerrit: bringing offline for a few minutes for point release (2.13.4 -> 2.13.8, T158946) | [production] | 
            
  | 20:15 | <mobrovac@tin> | Finished deploy [citoid/deploy@7d69554]: Relaxing date validation - T132308 (duration: 02m 32s) | [production] | 
            
  | 20:13 | <mobrovac@tin> | Started deploy [citoid/deploy@7d69554]: Relaxing date validation - T132308 | [production] | 
            
  | 19:31 | <demon@tin> | Synchronized scap/plugins/clean.py: cleanup r us (duration: 00m 42s) | [production] | 
            
  | 19:13 | <gehel@tin> | Finished deploy [wdqs/wdqs@af495a2]: (no justification provided) (duration: 01m 29s) | [production] | 
            
  | 19:11 | <gehel@tin> | Started deploy [wdqs/wdqs@af495a2]: (no justification provided) | [production] | 
            
  | 17:30 | <godog> | swift eqiad-prod decom ms-be100[128] - T166489 | [production] | 
            
  | 16:53 | <ema> | restart varnish-backend on cp1074 | [production] | 
            
  | 16:53 | <ema> | merge cache_maps into cache_upload: finished moving LVS IPs T164608 | [production] | 
            
  | 16:33 | <hoo@tin> | Synchronized wmf-config/InitialiseSettings.php: Index article placeholders up to Q16956 on cywiki (T162244) (duration: 00m 42s) | [production] | 
            
  | 15:58 | <hoo> | Updated the Wikidata property suggester with data from last Monday's JSON dump and applied the T132839 workarounds | [production] | 
            
  | 15:31 | <ema> | merge cache_maps into cache_upload: move LVS IPs T164608 | [production] | 
            
  | 14:34 | <XioNoX> | init7 fixed the issue, ping works from the init7 interface, reenabling the BGP session - T166663 | [production] | 
            
  | 14:02 | <moritzm> | upgrading install2002 to reprepro 5.1.1 | [production] | 
            
  | 13:26 | <hoo@tin> | Synchronized wmf-config/Wikibase-production.php: WikibaseClient: Don't persist Statement usages (T151717) (duration: 00m 41s) | [production] | 
            
  | 13:21 | <ema> | cache_eqiad: upgrade to jessie 8.8 point release T164703 | [production] | 
            
  | 13:19 | <hoo@tin> | Synchronized wmf-config/InitialiseSettings.php: Log "api-readonly" errors (T164191, T123867) (duration: 00m 43s) | [production] | 
            
  | 13:15 | <ema> | cache_codfw: upgrade to jessie 8.8 point release T164703 | [production] | 
            
  | 13:10 | <ema> | cache_esams: upgrade to jessie 8.8 point release T164703 | [production] | 
            
  | 13:08 | <marostegui> | Stop MySQL on db1048 and shutdown the host for maintenance - T160731 | [production] | 
            
  | 13:08 | <moritzm> | uploaded zookeeper 3.4.5+dfsg-2+deb8u2 to apt.wikimedia.org | [production] | 
            
  | 12:36 | <ema> | cache_ulsfo: upgrade to jessie 8.8 point release T164703 | [production] | 
            
  | 12:35 | <marostegui> | Deploy alter table on s3 revision table - db1035 - https://phabricator.wikimedia.org/T166278 | [production] | 
            
  | 12:35 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1077, depool db1035 - T166278 (duration: 00m 41s) | [production] | 
            
  | 12:22 | <ema> | cp1008: upgrade to jessie 8.8 point release T164703 | [production] | 
            
  | 12:11 | <XioNoX> | Disable v6 BGP session with Init7 in knams because of routing loop on their network | [production] | 
            
  | 12:04 | <volans> | merged stringify_facts=false for production hosts T166372 | [production] | 
            
  | 10:59 | <jynus> | preparing for backup and reimage to jessie of db2044 | [production] | 
            
  | 10:35 | <moritzm> | updated reprepro on install1002 to 5.1.1 from backports (for support of dbgsym and buildinfo files) | [production] | 
            
  | 10:29 | <godog> | remove salt-minion salt-common from stretch-wikimedia - T166646 | [production] | 
            
  | 09:30 | <marostegui> | Deploy alter table on s3 revision table - db1078 - https://phabricator.wikimedia.org/T166278 | [production] | 
            
  | 09:27 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1078, depool db1077 - T166278 (duration: 00m 42s) | [production] | 
            
  | 09:24 | <_joe_> | etcd in eqiad in read-write mode | [production] | 
            
  | 09:22 | <_joe_> | started etcd replica eqiad => codfw | [production] | 
            
  | 09:15 | <_joe_> | etcd replica codfw => eqiad now stopped | [production] | 
            
  | 09:09 | <_joe_> | etcd in read-only mode for switchover to eqiad | [production] | 
            
  | 08:27 | <godog> | complete linux 4.9 upgrade on Debian ms-be2* machines | [production] | 
            
  | 08:24 | <moritzm> | installing imagemagick security updates on trusty (jessie already fixed) | [production] | 
            
  | 07:47 | <elukey> | restart kafka on kafka10[14,22,20] for jvm upgrades | [production] | 
            
  | 06:45 | <moritzm> | installing sudo security updates | [production] | 
            
  | 06:45 | <marostegui> | Deploy alter table s3 revision table - dbstore1002 - T166278 | [production] | 
            
  | 06:31 | <marostegui> | Deploy alter table on s4 - db1059 - T166206 | [production] | 
            
  | 06:31 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1081, depool db1059 - T166206 (duration: 00m 41s) | [production] | 
            
  | 06:12 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1078 - T166278 (duration: 00m 43s) | [production] | 
            
  | 06:04 | <marostegui> | Deploy alter table on s3 revision table - db1078 - T166278 | [production] | 
            
  | 06:04 | <marostegui> | Deploy alter table on s3 revision table - db1095 - T166278 | [production] | 
            
  | 02:25 | <l10nupdate@tin> | scap sync-l10n completed (1.30.0-wmf.1) (duration: 07m 45s) | [production] |