| 2018-09-20
      
      ยง | 
    
  | 19:02 | <thcipriani@deploy1001> | Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:460034|Set $wgSiteMatrixNonGlobalSites global for SiteMatrix]] [[gerrit:461707|List $wgSiteMatrixNonGlobalSites as global]] (duration: 00m 52s) | [production] | 
            
  | 18:54 | <reedy@deploy1001> | Synchronized php-1.32.0-wmf.22/extensions/DisableAccount/: maintenance script (duration: 00m 52s) | [production] | 
            
  | 18:53 | <thcipriani@deploy1001> | Synchronized wmf-config/CommonSettings.php: Revert on canaries: SWAT: [[gerrit:460034|Set $wgSiteMatrixNonGlobalSites global for SiteMatrix]] (duration: 00m 53s) | [production] | 
            
  | 18:45 | <thcipriani@deploy1001> | scap failed: average error rate on 6/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/2cc7028226a539553178454fc2f14459 for details) | [production] | 
            
  | 18:43 | <SMalyshev> | Initiating in-place reindex for wikidatawiki (T147505) | [production] | 
            
  | 18:31 | <thcipriani@deploy1001> | Synchronized php-1.32.0-wmf.22/extensions/PageTriage/modules: SWAT: [[gerrit:461424|Correctly sync the form when afc_state === "all"]] T204629 [[gerrit:461648|Use same api params for list and stats on page load]] T204629 (duration: 00m 54s) | [production] | 
            
  | 18:21 | <thcipriani@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:461117|Enable logging for CitationUsage and CitationUsagePageLoad]] T191086 (duration: 00m 51s) | [production] | 
            
  | 17:59 | <bblack> | reinstalling multatuli | [production] | 
            
  | 17:35 | <thcipriani@deploy1001> | Finished scap: Noop (hopefully) test of php7.0 (duration: 03m 07s) | [production] | 
            
  | 17:31 | <thcipriani@deploy1001> | Started scap: Noop (hopefully) test of php7.0 | [production] | 
            
  | 17:24 | <ladsgroup@deploy1001> | Finished deploy [ores/deploy@ee2d28b]: Returning 429 instead of 408 in case of too many requests (T204956) (duration: 21m 15s) | [production] | 
            
  | 17:24 | <godog> | repair sdk on ms-be2043 - T199198 | [production] | 
            
  | 17:24 | <godog> | upload scap 3.8.6-1 - T204383 | [production] | 
            
  | 17:03 | <ladsgroup@deploy1001> | Started deploy [ores/deploy@ee2d28b]: Returning 429 instead of 408 in case of too many requests (T204956) | [production] | 
            
  | 15:56 | <anomie@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Setting MCR migration stage to write-both/read-new on testwiki (T198309) (duration: 00m 59s) | [production] | 
            
  | 15:17 | <moritzm> | installing glib2.0 security updates for trusty | [production] | 
            
  | 15:15 | <stephanebisson> | Starting mwscript extensions/PageTriage/maintenance/populateDraftQueue.php --wiki enwiki (T203184) | [production] | 
            
  | 15:14 | <stephanebisson> | Finished mwscript extensions/PageTriage/maintenance/DeleteAfcStates.php --wiki enwiki (T203184) | [production] | 
            
  | 15:11 | <stephanebisson> | Starting mwscript extensions/PageTriage/maintenance/DeleteAfcStates.php --wiki enwiki (T203184) | [production] | 
            
  | 15:05 | <hashar> | 1.32.0-wmf.22 on group2 seems fine so far \o/ | [production] | 
            
  | 15:05 | <moritzm> | installing bind9 security updates (client-side tools and libraries) | [production] | 
            
  | 14:48 | <godog> | repair sdn on ms-be2040 - T199198 | [production] | 
            
  | 14:44 | <gehel> | reduce replication factor to 2 on cassandra maps eqiad - T194966 | [production] | 
            
  | 14:38 | <hashar@deploy1001> | rebuilt and synchronized wikiversions files: all wikis to 1.32.0-wmf.22 | [production] | 
            
  | 14:28 | <hashar@deploy1001> | Synchronized typos: Dummy sync to verify list of canaries for T204907 (duration: 00m 59s) | [production] | 
            
  | 14:27 | <herron> | maps1001:~# tune2fs -m0 /dev/mapper/maps1001--vg-data | [production] | 
            
  | 14:22 | <marostegui> | Deploy schema change on s5 eqiad master with replication  T204006 | [production] | 
            
  | 14:15 | <moritzm> | rebooting rdb1001 for kernel security update | [production] | 
            
  | 14:15 | <bblack> | upgrade authdns1001 gdnsd 2.99.9 -> 2.99.42 | [production] | 
            
  | 14:12 | <bblack> | upload gdnsd-2.99.42-beta to stretch-wikimedia | [production] | 
            
  | 14:11 | <herron> | removing unused wiki-mail.wikimedia.org cname (gerrit 143762) | [production] | 
            
  | 14:05 | <moritzm> | rebooting rdb1002 for kernel security update | [production] | 
            
  | 13:27 | <jynus@deploy1001> | Synchronized wmf-config/db-codfw.php: Tune codfw database weights (duration: 00m 58s) | [production] | 
            
  | 13:20 | <gtirloni> | T204667 reimage labtestnet2003 | [production] | 
            
  | 12:14 | <gehel> | starting elasticsearch codfw cluster restart for new systemd unit | [production] | 
            
  | 12:07 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 12:01 | <moritzm> | rebooting mc1036 for kernel security update | [production] | 
            
  | 11:48 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:455395|Create new namespaces in zhwikiversity (T201675)]] (duration: 00m 57s) | [production] | 
            
  | 11:46 | <moritzm> | rebooting mc1035 for kernel security update | [production] | 
            
  | 11:38 | <moritzm> | rebooting mc1034 for kernel security update | [production] | 
            
  | 11:35 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:455853|Introduce engineer user group on Czech Wikipedia (T203000)]] (duration: 00m 58s) | [production] | 
            
  | 11:28 | <moritzm> | rebooting mc1033 for kernel security update | [production] | 
            
  | 11:19 | <dcausse@deploy1001> | Synchronized ./docroot/search.wikimedia.org/index.php: search.wikimedia.org should properly handle multivalue separation char (0x1F) (duration: 00m 58s) | [production] | 
            
  | 11:15 | <jynus> | rebooting es200X hosts for upgrade | [production] | 
            
  | 11:07 | <moritzm> | rebooting mc1032 for kernel security update | [production] | 
            
  | 11:03 | <gehel> | elasticsearch eqiad cluster restart for new systemd unit completed | [production] | 
            
  | 10:58 | <moritzm> | rebooting mc1031 for kernel security update | [production] | 
            
  | 10:43 | <moritzm> | rebooting mc1030 for kernel security update | [production] | 
            
  | 10:30 | <moritzm> | rebooting mc1029 for kernel security update | [production] | 
            
  | 10:16 | <moritzm> | rebooting mc1028 for kernel security update | [production] |