| 
      
        2018-02-26
      
      §
     | 
  
    
  | 20:34 | 
  <demon@tin> | 
  Synchronized docroot/noc/conf/: Fix urlencoding (duration: 00m 57s) | 
  [production] | 
            
  | 19:46 | 
  <catrope@tin> | 
  Synchronized php-1.31.0-wmf.22/extensions/WikibaseQualityConstraints/: T184937 (duration: 01m 03s) | 
  [production] | 
            
  | 19:46 | 
  <mutante> | 
  running puppet on cache::misc servers to add new director for design.wm | 
  [production] | 
            
  | 19:29 | 
  <catrope@tin> | 
  Synchronized wmf-config/CommonSettings.php: Simplify 2017 wikitext editor config (part 1) (duration: 00m 54s) | 
  [production] | 
            
  | 19:26 | 
  <catrope@tin> | 
  Synchronized wmf-config/throttle.php: Add throttle rule (T188129) (duration: 00m 56s) | 
  [production] | 
            
  | 19:22 | 
  <catrope@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Add mushroomobserver.org to wgCopyUploadsDomains (T188203) (duration: 00m 57s) | 
  [production] | 
            
  | 19:08 | 
  <herron> | 
  codfw puppet master kernel updates complete re-enabling puppet agents | 
  [production] | 
            
  | 19:01 | 
  <herron> | 
  codfw puppet master kernel updates complete re-enabling puppet agents | 
  [production] | 
            
  | 19:01 | 
  <herron> | 
  -- | 
  [production] | 
            
  | 19:01 | 
  <herron> | 
  codfw puppet master kernel updates complete — re-enabling puppet agents | 
  [production] | 
            
  | 18:54 | 
  <herron> | 
  disabling puppet agents and rebooting codfw puppet masters for kernel update | 
  [production] | 
            
  | 18:31 | 
  <gehel@tin> | 
  Finished deploy [wdqs/wdqs@f74cbd1]: new forAllCategoryWikis.sh (duration: 06m 28s) | 
  [production] | 
            
  | 18:24 | 
  <gehel@tin> | 
  Started deploy [wdqs/wdqs@f74cbd1]: new forAllCategoryWikis.sh | 
  [production] | 
            
  | 18:13 | 
  <demon@tin> | 
  Synchronized wmf-config/CommonSettings.php: ExtensionDistributor: Ignore empty repositories (duration: 00m 56s) | 
  [production] | 
            
  | 18:10 | 
  <gehel@tin> | 
  Finished deploy [wdqs/wdqs@4edbbaa]: new update, GUI and whitelist.txt (duration: 04m 44s) | 
  [production] | 
            
  | 18:05 | 
  <gehel@tin> | 
  Started deploy [wdqs/wdqs@4edbbaa]: new update, GUI and whitelist.txt | 
  [production] | 
            
  | 17:57 | 
  <mobrovac@tin> | 
  Started restart [electron-render/deploy@94d27d7]: Stuck, restart - T174916 | 
  [production] | 
            
  | 17:41 | 
  <demon@tin> | 
  Synchronized wmf-config/Wikibase-production.php: Revert "Enable caching of constraint check results" (duration: 00m 57s) | 
  [production] | 
            
  | 17:34 | 
  <jynus> | 
  deploying new query killer to db1109 | 
  [production] | 
            
  | 17:32 | 
  <akosiaris> | 
  shutdown sca1004 on ganeti1005 for T181121 | 
  [production] | 
            
  | 16:39 | 
  <andrewbogott> | 
  making wikitech read-only (via a local patch) while I migrate the database to m5 | 
  [production] | 
            
  | 16:33 | 
  <marostegui> | 
  Reboot db1111 storage crashed - T187526 | 
  [production] | 
            
  | 16:31 | 
  <papaul> | 
  Maintenance: removing Msw-d4-codfw for replacement:T187534 | 
  [production] | 
            
  | 16:29 | 
  <mutante> | 
  restarted stashbot on toolforge because it didn't react to !log | 
  [production] | 
            
  | 16:26 | 
  <mutante> | 
  test !log | 
  [production] | 
            
  | 16:08 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-codfw.php: Repool db2049 - T187534 (duration: 00m 56s) | 
  [production] | 
            
  | 15:45 | 
  <andrewbogott> | 
  made wikitech read/write again pending a bit more preliminary work | 
  [production] | 
            
  | 15:43 | 
  <cmjohnson1> | 
  swapping failed disk db1068 | 
  [production] | 
            
  | 15:42 | 
  <andrewbogott> | 
  marking wikitech read-only (via a local edit to CommonSettings.php)  for https://phabricator.wikimedia.org/T188029 | 
  [production] | 
            
  | 15:41 | 
  <andrewbogott> | 
  marking wikitech read-only (via a local edit to CommonSettings.php)  for https://phabricator.wikimedia.org/T188029 | 
  [production] | 
            
  | 15:32 | 
  <addshore> | 
  EU SWAT done | 
  [production] | 
            
  | 15:31 | 
  <addshore@tin> | 
  Finished scap: Updated mediawiki/extensions/AdvancedSearch i18n files for some translations (duration: 11m 29s) | 
  [production] | 
            
  | 15:19 | 
  <addshore@tin> | 
  Started scap: Updated mediawiki/extensions/AdvancedSearch i18n files for some translations | 
  [production] | 
            
  | 15:12 | 
  <Amir1> | 
  This might have performance implications roll it back if it affects these wikis too much | 
  [production] | 
            
  | 15:12 | 
  <gehel> | 
  reboot of relforge completed, cluster is green again | 
  [production] | 
            
  | 15:11 | 
  <ladsgroup@tin> | 
  Synchronized wmf-config/Wikibase-production.php: [[gerrit:414667|Enable reading full entity id from wb_terms table in three wikis (T114903)]] (duration: 00m 56s) | 
  [production] | 
            
  | 14:54 | 
  <ladsgroup@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: [[gerrit:414650|Add patrol rights/groups to fawikisource (T187662)]] (duration: 00m 56s) | 
  [production] | 
            
  | 14:52 | 
  <gehel> | 
  rebooting relforge for kernel upgrade | 
  [production] | 
            
  | 14:50 | 
  <godog> | 
  upload puppetdb 4.4.0-1~wmf1 to stretch-wikimedia - T177253 | 
  [production] | 
            
  | 14:48 | 
  <ladsgroup@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: [[gerrit:V|Enable statement usage tracking in several wikis (T151717)]] (duration: 00m 57s) | 
  [production] | 
            
  | 14:40 | 
  <zfilipin@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:407901|Add namespaces to urwiktionary (T186393)]] (duration: 00m 56s) | 
  [production] | 
            
  | 14:28 | 
  <zfilipin@tin> | 
  Synchronized wmf-config/Wikibase-production.php: SWAT: [[gerrit:413724|Enable caching of constraint check results (T184812)]] (duration: 00m 55s) | 
  [production] | 
            
  | 14:15 | 
  <moritzm> | 
  rebooting scb in codfw for kernel security updates | 
  [production] | 
            
  | 14:10 | 
  <zfilipin@tin> | 
  Synchronized php-1.31.0-wmf.22/extensions/UniversalLanguageSelector/maintenance/ULSCompactLinksDisablePref.php: SWAT: [[gerrit:414609|Added option to continue script from particular User ID]] [[gerrit:414608|Use a replica dedicated to slow queries (if available) (T187880)]] (duration: 00m 58s) | 
  [production] | 
            
  | 13:09 | 
  <moritzm> | 
  rebooting video scalers in eqiad for kernel security update | 
  [production] | 
            
  | 11:12 | 
  <jdrewniak@tin> | 
  Synchronized portals: Wikimedia Portals Update: [[gerrit:402805|Bumping portals to master (T128546)]] (duration: 00m 57s) | 
  [production] | 
            
  | 11:11 | 
  <jdrewniak@tin> | 
  Synchronized portals/prod/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:402805|Bumping portals to master (T128546)]] (duration: 00m 58s) | 
  [production] | 
            
  | 11:01 | 
  <moritzm> | 
  powercycling mw1264 (stuck after reboot) | 
  [production] | 
            
  | 10:10 | 
  <moritzm> | 
  rebooting mw canaries for kernel security update | 
  [production] | 
            
  | 09:29 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-codfw.php: Repool db2055 and db2070 (duration: 00m 55s) | 
  [production] |