| 2018-09-21
      
      § | 
    
  | 19:10 | <XioNoX> | shutdown cr3/4-ulsfo (not in prod) | [production] | 
            
  | 18:19 | <bawolff> | deploy patch related to T197279 T204825 | [production] | 
            
  | 18:08 | <bblack> | upgrade multatuli to gdnsd-2.99.1729-beta | [production] | 
            
  | 18:06 | <bblack> | uploaded 2.99.1729-beta-1+wmf1 to stretch-wikimedia | [production] | 
            
  | 17:59 | <mutante> | *.toolserver.org also moved from eqiad to eqiad-r region in cloud vps, which gave it new IP addresses | [production] | 
            
  | 17:58 | <mutante> | toolserver.org and subdomains (wiki.toolserver, status.toolserver, stable.toolserver) legacy URLs have been switched to new stretch backend, away from trusty | [production] | 
            
  | 16:37 | <XioNoX> | route ns2-v6 to multatuli.wikimedia.org on cr1/2-esams | [production] | 
            
  | 16:33 | <mutante> | puppetmaster1001: cergen --base-path /srv/private/modules/secret/secrets/mcrouter/ --generate /etc/cergen/mcrouter.manifests.d | [production] | 
            
  | 16:32 | <mutante> | puppetmaster1001: mcrouter_generate_certs --generate | [production] | 
            
  | 16:29 | <mutante> | puppetmaster: running mcrouter_generate_certs to add an mcrouter cert for mwmaint1002 (T201343) https://wikitech.wikimedia.org/wiki/Mcrouter#Generate_certs_for_a_new_host | [production] | 
            
  | 15:39 | <bblack> | upgrading gdnsd to 2.99.42 on authdns2001 | [production] | 
            
  | 15:16 | <XioNoX> | route ns2 to multatuli.wikimedia.org on cr1/2-eqiad | [production] | 
            
  | 13:35 | <ladsgroup@deploy1001> | Finished deploy [ores/deploy@7b987a7]: Pass the real IP (T205087) (duration: 24m 10s) | [production] | 
            
  | 13:11 | <ladsgroup@deploy1001> | Started deploy [ores/deploy@7b987a7]: Pass the real IP (T205087) | [production] | 
            
  | 13:01 | <volans> | wiping netbox DB to re-import it cleanly from racktables - T199083 | [production] | 
            
  | 12:43 | <banyek> | adding wmf-pt-kill_2.2.20-1+wmf1 package for jessie | [production] | 
            
  | 12:31 | <banyek> | adding wmf-pt-kill_2.2.20-1+wmf1 package for strech | [production] | 
            
  | 12:24 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool pc1006 (duration: 00m 49s) | [production] | 
            
  | 12:13 | <marostegui> | Stop MySQL on pc1006 for kernel upgrade | [production] | 
            
  | 12:13 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool pc1006 (duration: 00m 50s) | [production] | 
            
  | 07:17 | <moritzm> | uploaded debdeploy 0.0.99.6 to apt.wikimedia.org | [production] | 
            
  | 07:00 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool pc1005 (duration: 00m 50s) | [production] | 
            
  | 06:51 | <marostegui> | Stop MySQL on pc1005 for kernel upgrade | [production] | 
            
  | 06:51 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool pc1005 (duration: 00m 51s) | [production] | 
            
  
    | 2018-09-20
      
      § | 
    
  | 23:49 | <ejegg> | updated fundraising CiviCRM from 7f58670e88 to b0223f56b0 | [production] | 
            
  | 23:06 | <ejegg> | updated payments-wiki from e7d373fa71 to 1af8f8c8c0 | [production] | 
            
  | 21:47 | <ejegg> | updated payments-wiki from 43923fadd9 to e7d373fa71 | [production] | 
            
  | 21:26 | <mutante> | releases1001 - rm /usr/local/sbin/sync-srv-org-wikimedia-releases  (bromine remnants) | [production] | 
            
  | 21:26 | <mutante> | releases1001 - deleting cronjob remnants for releases from bromine | [production] | 
            
  | 21:17 | <mutante> | releases2001 - manually rsync releases files from releases1001 | [production] | 
            
  | 21:16 | <hashar> | 1.32.0-wmf.22 is fully deployed. A quick summary and thanks words are at https://phabricator.wikimedia.org/T191068#4604040 | [production] | 
            
  | 20:55 | <jforrester@deploy1001> | Synchronized wmf-config/CommonSettings.php: Comment clean-up no-op (duration: 00m 50s) | [production] | 
            
  | 20:54 | <jforrester@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Comment clean-up no-op (duration: 00m 51s) | [production] | 
            
  | 20:22 | <SMalyshev> | Started wikidata reindex again, hopefully better luck this time | [production] | 
            
  | 20:07 | <reedy@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Bye bye tidy config! (duration: 00m 50s) | [production] | 
            
  | 20:00 | <gehel> | elasticsearch codfw cluster restart for new systemd unit completed | [production] | 
            
  | 19:57 | <reedy@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Disable DisableAccount T106067 (duration: 00m 51s) | [production] | 
            
  | 19:50 | <reedy@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Temporarily re-enable DisableAccount on wikis it was previous enabled (duration: 00m 51s) | [production] | 
            
  | 19:36 | <reedy@deploy1001> | Pruned MediaWiki: 1.32.0-wmf.15 (duration: 03m 16s) | [production] | 
            
  | 19:32 | <reedy@deploy1001> | Pruned MediaWiki: 1.32.0-wmf.14 (duration: 02m 05s) | [production] | 
            
  | 19:22 | <tzatziki> | Add email to account Abalg~commonswiki | [production] | 
            
  | 19:22 | <reedy@deploy1001> | clean aborted: Pruned MediaWiki: 1.32.0-wmf.14 (duration: 00m 30s) | [production] | 
            
  | 19:21 | <reedy@deploy1001> | Pruned MediaWiki: 1.32.0-wmf.14 [keeping static files] (duration: 02m 03s) | [production] | 
            
  | 19:19 | <bblack> | reboot multatuli | [production] | 
            
  | 19:13 | <reedy@deploy1001> | clean aborted: Pruned MediaWiki: 1.32.0-wmf.4 (duration: 01m 03s) | [production] | 
            
  | 19:12 | <thcipriani@deploy1001> | Synchronized php-1.32.0-wmf.22/extensions/CentralNotice/resources/subscribing/ext.centralNotice.display.js: SWAT: [[gerrit:461485|Add performance mark for when banner is inserted]] T195840 (duration: 00m 51s) | [production] | 
            
  | 19:06 | <reedy@deploy1001> | Pruned MediaWiki: 1.32.0-wmf.4 [keeping static files] (duration: 01m 58s) | [production] | 
            
  | 19:02 | <thcipriani@deploy1001> | Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:460034|Set $wgSiteMatrixNonGlobalSites global for SiteMatrix]] [[gerrit:461707|List $wgSiteMatrixNonGlobalSites as global]] (duration: 00m 52s) | [production] | 
            
  | 18:54 | <reedy@deploy1001> | Synchronized php-1.32.0-wmf.22/extensions/DisableAccount/: maintenance script (duration: 00m 52s) | [production] | 
            
  | 18:53 | <thcipriani@deploy1001> | Synchronized wmf-config/CommonSettings.php: Revert on canaries: SWAT: [[gerrit:460034|Set $wgSiteMatrixNonGlobalSites global for SiteMatrix]] (duration: 00m 53s) | [production] |