| 2017-10-18
      
      § | 
    
  | 13:21 | <gehel> | repooling wdqs1003 now that it has catched up on updates | [production] | 
            
  | 13:15 | <zfilipin@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:383378|pagePreviews: Restart A/B test on enwiki and dewiki (T176469)]] (duration: 00m 51s) | [production] | 
            
  | 13:05 | <moritzm> | uploaded wikidiff2 1.5.1 to apt.wikimedia.org | [production] | 
            
  | 12:11 | <mobrovac@tin> | Finished deploy [restbase/deploy@3c7abf6]: Bug fix: Remove the space in the summary table name (duration: 07m 13s) | [production] | 
            
  | 12:04 | <mobrovac@tin> | Started deploy [restbase/deploy@3c7abf6]: Bug fix: Remove the space in the summary table name | [production] | 
            
  | 11:54 | <mobrovac@tin> | Finished deploy [restbase/deploy@99052c1]: Use Cass3 storage for ruwiki summaries (duration: 08m 59s) | [production] | 
            
  | 11:47 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Add db1105 to help db1071 because db1082 has crashed (duration: 00m 50s) | [production] | 
            
  | 11:45 | <mobrovac@tin> | Started deploy [restbase/deploy@99052c1]: Use Cass3 storage for ruwiki summaries | [production] | 
            
  | 11:31 | <moritzm> | upgrading mw1262-mw1265 (canaries) to wikidiff2 1.5.1 | [production] | 
            
  | 11:26 | <marostegui> | Optimize pagelinks and templatelinks on db1102 s7 - T174509 | [production] | 
            
  | 11:21 | <moritzm> | upgrading mw1261 to wikidiff2 1.5.1 | [production] | 
            
  | 11:11 | <mobrovac@tin> | Finished deploy [restbase/deploy@15619e0]: Introduce the page/summary proxy (no-op for now), part #2 (duration: 08m 53s) | [production] | 
            
  | 11:03 | <mobrovac@tin> | Started deploy [restbase/deploy@15619e0]: Introduce the page/summary proxy (no-op for now), part #2 | [production] | 
            
  | 11:02 | <mobrovac@tin> | Finished deploy [restbase/deploy@15619e0]: Introduce the page/summary proxy (no-op for now) (duration: 05m 23s) | [production] | 
            
  | 10:57 | <mobrovac@tin> | Started deploy [restbase/deploy@15619e0]: Introduce the page/summary proxy (no-op for now) | [production] | 
            
  | 10:50 | <moritzm> | rebooting multatuli for kernel update | [production] | 
            
  | 10:21 | <moritzm> | imported linux 4.9.30-2+deb9u5~bpo8+1 for jessie-wikimedia | [production] | 
            
  | 09:51 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1098, depool db1082 (crashed) (duration: 00m 50s) | [production] | 
            
  | 09:39 | <moritzm> | installing xserver/xvfb security updates | [production] | 
            
  | 09:36 | <jynus> | reloading dbproxy1010's haproxy configuration | [production] | 
            
  | 09:30 | <elukey> | drop MobileWikiAppToCInteraction_10375484_15423246 from the log database on dbstore1002,db1047,db1046 - T177960 | [production] | 
            
  | 08:41 | <hoo@tin> | Synchronized wmf-config/InitialiseSettings.php: Re-enable Statement usage tracking on cawiki (T151717) (duration: 00m 50s) | [production] | 
            
  | 08:25 | <marostegui> | Stop MySQL on db2019 to copy its data to db2084 - T178359 | [production] | 
            
  | 08:23 | <mobrovac@tin> | Finished deploy [changeprop/deploy@065a06e]: Bug fix: Apply ignore_errors on a per-request basis (duration: 01m 17s) | [production] | 
            
  | 08:22 | <mobrovac@tin> | Started deploy [changeprop/deploy@065a06e]: Bug fix: Apply ignore_errors on a per-request basis | [production] | 
            
  | 08:09 | <hoo@tin> | Synchronized wmf-config/InitialiseSettings.php: Enable description usage tracking on a few test wikis (T177155) (duration: 00m 50s) | [production] | 
            
  | 07:49 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1056 - T174509 (duration: 00m 49s) | [production] | 
            
  | 07:46 | <marostegui> | Optimize pagelinks and templatelinks on db1056 - T174509 | [production] | 
            
  | 07:44 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1034 - T174509 (duration: 00m 59s) | [production] | 
            
  | 07:14 | <gehel> | depooling wdqs1003 until it catches up on updates | [production] | 
            
  | 07:02 | <marostegui> | Stop MySQL on db2079 to copy its data to db2084 - T178359 | [production] | 
            
  | 06:46 | <_joe_> | powercycling wdqs1003 | [production] | 
            
  | 05:48 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1072 - T164488 (duration: 00m 49s) | [production] | 
            
  | 05:43 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1055 - T174509 (duration: 00m 50s) | [production] | 
            
  | 05:40 | <marostegui> | Optimize pagelinks and templatelinks on db1055 - T174509 | [production] | 
            
  | 05:37 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1098 - T174509 (duration: 00m 49s) | [production] | 
            
  | 05:36 | <marostegui> | Optimize pagelinks and templatelinks on db1098 - T174509 | [production] | 
            
  | 05:27 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1067 - T174509 (duration: 00m 50s) | [production] | 
            
  | 05:25 | <marostegui> | Optimize pagelinks and templatelinks on db1102 for s2 - T174509 | [production] | 
            
  | 03:17 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Wed Oct 18 03:17:01 UTC 2017 (duration 7m 3s) | [production] | 
            
  | 03:09 | <l10nupdate@tin> | scap sync-l10n completed (1.31.0-wmf.4) (duration: 14m 58s) | [production] | 
            
  | 02:33 | <l10nupdate@tin> | scap sync-l10n completed (1.31.0-wmf.3) (duration: 08m 21s) | [production] | 
            
  
    | 2017-10-17
      
      § | 
    
  | 23:31 | <thcipriani@tin> | Synchronized php-1.31.0-wmf.4/extensions/Citoid/modules/ve.ui.CiteFromIdInspector.css: SWAT: [[gerrit:384817|ve.ui.CiteFromIdInspector: Fix CSS for context menus after changes in OOjs UI]] T178324 (duration: 00m 50s) | [production] | 
            
  | 23:29 | <thcipriani@tin> | Synchronized php-1.31.0-wmf.4/extensions/VisualEditor/modules/ve-mw/ui/styles/widgets/ve.ui.MWMediaInfoFieldWidget.css: SWAT: [[gerrit:384748|ve.ui.MWMediaInfoFieldWidget: Fix positioning of icons]] T178415 (duration: 00m 50s) | [production] | 
            
  | 23:22 | <thcipriani@tin> | Synchronized php-1.31.0-wmf.3/includes/shell/Command.php: SWAT: [[gerrit:384790|Shell\Command: Better walltime fallback]] T178314 (duration: 00m 51s) | [production] | 
            
  | 23:15 | <thcipriani@tin> | Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:366869|Remove setting no longer in MediaWiki]] (duration: 00m 50s) | [production] | 
            
  | 23:06 | <mutante> | disabling Icinga notifications for service recommendation_api on scb hosts - please remember to re-enable once ticket is resolved (T178445) (https://icinga.wikimedia.org/cgi-bin/icinga/status.cgi?search_string=recommendation_api%20endpoints) | [production] | 
            
  | 22:28 | <ejegg> | updated CiviCRM from fb513ccaa0bd7a13862aaa2b6fdd94ed97ef81df to 7c26791589af7ee2798def303aaaf863038a65c9 | [production] | 
            
  | 21:55 | <foks> | Removed 2FA from User:Amakuru | [production] | 
            
  | 21:39 | <robh> | cp4026 being returned to service post memory replacement.  puppet runs fine and all icinga checks are green. repooled. | [production] |