| 2019-04-02
      
      § | 
    
  | 08:50 | <marostegui> | Execute schema change on db1069 x1 master with replication enabled on the following small wikis: aawiki aawikibooks aawiktionary abwiki abwiktionary acewiki advisorswiki advisorywiki adywiki afwiki T143763 | [production] | 
            
  | 08:20 | <marostegui> | Compress wikishared.urlshortcodes table on x1, directly on the master with replication (table has 1 row) - T219777 | [production] | 
            
  | 08:16 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool all slaves in x1 T219777 T143763 (duration: 00m 53s) | [production] | 
            
  | 08:13 | <moritzm> | installing debdeploy updates on remaining hosts in eqiad/codfw | [production] | 
            
  | 08:05 | <moritzm> | installing openssl1.0 security updates | [production] | 
            
  | 07:52 | <moritzm> | removed labvirt1008 from debmonitor (T216661) | [production] | 
            
  | 06:38 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1120 (duration: 00m 50s) | [production] | 
            
  | 06:31 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1120 (duration: 00m 52s) | [production] | 
            
  | 06:26 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1064 (duration: 00m 52s) | [production] | 
            
  | 06:16 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1064 (duration: 00m 54s) | [production] | 
            
  | 06:02 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool pc1008 (duration: 00m 53s) | [production] | 
            
  | 05:58 | <oblivian@deploy1001> | Finished deploy [docker-pkg/deploy@2a090ef]: New version for T219778 (duration: 00m 19s) | [production] | 
            
  | 05:58 | <oblivian@deploy1001> | Started deploy [docker-pkg/deploy@2a090ef]: New version for T219778 | [production] | 
            
  | 05:55 | <marostegui> | Upgrade pc1008 | [production] | 
            
  | 05:55 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool pc1008 (duration: 00m 56s) | [production] | 
            
  | 04:14 | <onimisionipe> | restarted tilerator on maps200[1-3] - connection refused | [production] | 
            
  | 01:17 | <XioNoX> | replacing accepted-prefix-limit with prefix-limit on cr1-eqiad - T211730 | [production] | 
            
  | 01:14 | <XioNoX> | replacing accepted-prefix-limit with prefix-limit in eqord - T211730 | [production] | 
            
  | 00:52 | <XioNoX> | depool eqsin due to Telia eqsin-codfw link outage | [production] | 
            
  | 00:40 | <XioNoX> | replacing accepted-prefix-limit with prefix-limit in [co|eq]dfw - T211730 | [production] | 
            
  | 00:25 | <XioNoX> | replacing accepted-prefix-limit with prefix-limit on all ulsfo peers - T211730 | [production] | 
            
  | 00:19 | <XioNoX> | replacing accepted-prefix-limit with prefix-limit on one ulsfo peer - T211730 | [production] | 
            
  | 00:06 | <XioNoX> | jnt push to msw switches | [production] | 
            
  
    | 2019-04-01
      
      § | 
    
  | 23:54 | <shdubsh> | restarting kafka on kafka-jumbo1004 | [production] | 
            
  | 23:47 | <shdubsh> | restarting kafka on kafka-jumbo1003 | [production] | 
            
  | 23:36 | <shdubsh> | restart kafka on kafka-jumbo1002 | [production] | 
            
  | 23:28 | <shdubsh> | restart kafka on kafka-jumbo1001 | [production] | 
            
  | 23:16 | <XioNoX> | jnt push to csw2-esams | [production] | 
            
  | 22:52 | <XioNoX> | restart pdfrender on scb1003 - T174916 | [production] | 
            
  | 21:44 | <sbassett@deploy1001> | Synchronized private/PrivateSettings.php: Remove kowiki spam mitigations T212679 (duration: 00m 54s) | [production] | 
            
  | 21:28 | <XioNoX> | Push AS specific policy-statements to cr1/2-eqsin v4 peers - T211930 | [production] | 
            
  | 21:10 | <dcausse> | elasticsearch search cluster: reindex spaceless languages (T219533) | [production] | 
            
  | 19:48 | <gilles@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: T216499 Renew Priority Hints origin trial token (duration: 00m 54s) | [production] | 
            
  | 19:48 | <bblack> | authdns2001 (ns1) upgrade gdnsd -> 3.1.0 | [production] | 
            
  | 18:58 | <XioNoX> | re-set ulsfo-codfw ospf cost to previous default - T219591 | [production] | 
            
  | 18:52 | <shdubsh> | restart mjolnir-kafka-msearch on relforge1002 to adopt new logging config | [production] | 
            
  | 18:44 | <dcausse> | Morning SWAT done | [production] | 
            
  | 18:42 | <dcausse@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: T219268: [cirrus] Use bm25 similarity for all wikis (duration: 00m 51s) | [production] | 
            
  | 18:33 | <dcausse@deploy1001> | Synchronized wmf-config/CirrusSearch-production.php: T210381: [cirrus] Cleanup transitional states (duration: 00m 53s) | [production] | 
            
  | 18:22 | <lucaswerkmeister-wmde@deploy1001> | Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:498913|ExternalGuidance: Allow google translate hosts as known services (T218948)]] (duration: 00m 53s) | [production] | 
            
  | 18:18 | <bblack> | multatuli (ns2) upgrade gdnsd -> 3.1.0 | [production] | 
            
  | 18:10 | <lucaswerkmeister-wmde@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:499999|Add tmpSerializeEmptyListsAsObjects Wikibase repo config (T138104)]] (duration: 00m 54s) | [production] | 
            
  | 17:55 | <XioNoX> | remove asw2-c-eqiad:et-3/1/2 from disabled interfaces - T218059 | [production] | 
            
  | 17:31 | <bblack> | authdns1001 (ns0) upgrade gdnsd -> 3.1.0 | [production] | 
            
  | 17:22 | <bblack> | upgrade gdnsd -> 3.1.0 (wmf2) on cp1099 (authdns test) | [production] | 
            
  | 17:21 | <bblack> | uploading gdnsd-3.1.0-1~wmf2 to stretch-wikimedia | [production] | 
            
  | 17:15 | <onimisionipe@deploy1001> | Finished deploy [wdqs/wdqs@115a6bf]: Added more endpoint, GUI updates and new bot pattern (duration: 12m 10s) | [production] | 
            
  | 17:07 | <arturo> | restart dhcp server in install2002 to release old lease for labtestnet2003 | [production] | 
            
  | 17:03 | <onimisionipe@deploy1001> | Started deploy [wdqs/wdqs@115a6bf]: Added more endpoint, GUI updates and new bot pattern | [production] | 
            
  | 16:32 | <vgutierrez> | slowly reenabling puppet in cache text cluster - T213705 | [production] |