| 2018-09-20
      
      ยง | 
    
  | 23:49 | <ejegg> | updated fundraising CiviCRM from 7f58670e88 to b0223f56b0 | [production] | 
            
  | 23:06 | <ejegg> | updated payments-wiki from e7d373fa71 to 1af8f8c8c0 | [production] | 
            
  | 21:47 | <ejegg> | updated payments-wiki from 43923fadd9 to e7d373fa71 | [production] | 
            
  | 21:26 | <mutante> | releases1001 - rm /usr/local/sbin/sync-srv-org-wikimedia-releases  (bromine remnants) | [production] | 
            
  | 21:26 | <mutante> | releases1001 - deleting cronjob remnants for releases from bromine | [production] | 
            
  | 21:17 | <mutante> | releases2001 - manually rsync releases files from releases1001 | [production] | 
            
  | 21:16 | <hashar> | 1.32.0-wmf.22 is fully deployed. A quick summary and thanks words are at https://phabricator.wikimedia.org/T191068#4604040 | [production] | 
            
  | 20:55 | <jforrester@deploy1001> | Synchronized wmf-config/CommonSettings.php: Comment clean-up no-op (duration: 00m 50s) | [production] | 
            
  | 20:54 | <jforrester@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Comment clean-up no-op (duration: 00m 51s) | [production] | 
            
  | 20:22 | <SMalyshev> | Started wikidata reindex again, hopefully better luck this time | [production] | 
            
  | 20:07 | <reedy@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Bye bye tidy config! (duration: 00m 50s) | [production] | 
            
  | 20:00 | <gehel> | elasticsearch codfw cluster restart for new systemd unit completed | [production] | 
            
  | 19:57 | <reedy@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Disable DisableAccount T106067 (duration: 00m 51s) | [production] | 
            
  | 19:50 | <reedy@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Temporarily re-enable DisableAccount on wikis it was previous enabled (duration: 00m 51s) | [production] | 
            
  | 19:36 | <reedy@deploy1001> | Pruned MediaWiki: 1.32.0-wmf.15 (duration: 03m 16s) | [production] | 
            
  | 19:32 | <reedy@deploy1001> | Pruned MediaWiki: 1.32.0-wmf.14 (duration: 02m 05s) | [production] | 
            
  | 19:22 | <tzatziki> | Add email to account Abalg~commonswiki | [production] | 
            
  | 19:22 | <reedy@deploy1001> | clean aborted: Pruned MediaWiki: 1.32.0-wmf.14 (duration: 00m 30s) | [production] | 
            
  | 19:21 | <reedy@deploy1001> | Pruned MediaWiki: 1.32.0-wmf.14 [keeping static files] (duration: 02m 03s) | [production] | 
            
  | 19:19 | <bblack> | reboot multatuli | [production] | 
            
  | 19:13 | <reedy@deploy1001> | clean aborted: Pruned MediaWiki: 1.32.0-wmf.4 (duration: 01m 03s) | [production] | 
            
  | 19:12 | <thcipriani@deploy1001> | Synchronized php-1.32.0-wmf.22/extensions/CentralNotice/resources/subscribing/ext.centralNotice.display.js: SWAT: [[gerrit:461485|Add performance mark for when banner is inserted]] T195840 (duration: 00m 51s) | [production] | 
            
  | 19:06 | <reedy@deploy1001> | Pruned MediaWiki: 1.32.0-wmf.4 [keeping static files] (duration: 01m 58s) | [production] | 
            
  | 19:02 | <thcipriani@deploy1001> | Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:460034|Set $wgSiteMatrixNonGlobalSites global for SiteMatrix]] [[gerrit:461707|List $wgSiteMatrixNonGlobalSites as global]] (duration: 00m 52s) | [production] | 
            
  | 18:54 | <reedy@deploy1001> | Synchronized php-1.32.0-wmf.22/extensions/DisableAccount/: maintenance script (duration: 00m 52s) | [production] | 
            
  | 18:53 | <thcipriani@deploy1001> | Synchronized wmf-config/CommonSettings.php: Revert on canaries: SWAT: [[gerrit:460034|Set $wgSiteMatrixNonGlobalSites global for SiteMatrix]] (duration: 00m 53s) | [production] | 
            
  | 18:45 | <thcipriani@deploy1001> | scap failed: average error rate on 6/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/2cc7028226a539553178454fc2f14459 for details) | [production] | 
            
  | 18:43 | <SMalyshev> | Initiating in-place reindex for wikidatawiki (T147505) | [production] | 
            
  | 18:31 | <thcipriani@deploy1001> | Synchronized php-1.32.0-wmf.22/extensions/PageTriage/modules: SWAT: [[gerrit:461424|Correctly sync the form when afc_state === "all"]] T204629 [[gerrit:461648|Use same api params for list and stats on page load]] T204629 (duration: 00m 54s) | [production] | 
            
  | 18:21 | <thcipriani@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:461117|Enable logging for CitationUsage and CitationUsagePageLoad]] T191086 (duration: 00m 51s) | [production] | 
            
  | 17:59 | <bblack> | reinstalling multatuli | [production] | 
            
  | 17:35 | <thcipriani@deploy1001> | Finished scap: Noop (hopefully) test of php7.0 (duration: 03m 07s) | [production] | 
            
  | 17:31 | <thcipriani@deploy1001> | Started scap: Noop (hopefully) test of php7.0 | [production] | 
            
  | 17:24 | <ladsgroup@deploy1001> | Finished deploy [ores/deploy@ee2d28b]: Returning 429 instead of 408 in case of too many requests (T204956) (duration: 21m 15s) | [production] | 
            
  | 17:24 | <godog> | repair sdk on ms-be2043 - T199198 | [production] | 
            
  | 17:24 | <godog> | upload scap 3.8.6-1 - T204383 | [production] | 
            
  | 17:03 | <ladsgroup@deploy1001> | Started deploy [ores/deploy@ee2d28b]: Returning 429 instead of 408 in case of too many requests (T204956) | [production] | 
            
  | 15:56 | <anomie@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Setting MCR migration stage to write-both/read-new on testwiki (T198309) (duration: 00m 59s) | [production] | 
            
  | 15:17 | <moritzm> | installing glib2.0 security updates for trusty | [production] | 
            
  | 15:15 | <stephanebisson> | Starting mwscript extensions/PageTriage/maintenance/populateDraftQueue.php --wiki enwiki (T203184) | [production] | 
            
  | 15:14 | <stephanebisson> | Finished mwscript extensions/PageTriage/maintenance/DeleteAfcStates.php --wiki enwiki (T203184) | [production] | 
            
  | 15:11 | <stephanebisson> | Starting mwscript extensions/PageTriage/maintenance/DeleteAfcStates.php --wiki enwiki (T203184) | [production] | 
            
  | 15:05 | <hashar> | 1.32.0-wmf.22 on group2 seems fine so far \o/ | [production] | 
            
  | 15:05 | <moritzm> | installing bind9 security updates (client-side tools and libraries) | [production] | 
            
  | 14:48 | <godog> | repair sdn on ms-be2040 - T199198 | [production] | 
            
  | 14:44 | <gehel> | reduce replication factor to 2 on cassandra maps eqiad - T194966 | [production] | 
            
  | 14:38 | <hashar@deploy1001> | rebuilt and synchronized wikiversions files: all wikis to 1.32.0-wmf.22 | [production] | 
            
  | 14:28 | <hashar@deploy1001> | Synchronized typos: Dummy sync to verify list of canaries for T204907 (duration: 00m 59s) | [production] | 
            
  | 14:27 | <herron> | maps1001:~# tune2fs -m0 /dev/mapper/maps1001--vg-data | [production] | 
            
  | 14:22 | <marostegui> | Deploy schema change on s5 eqiad master with replication  T204006 | [production] |