| 
      
        2017-08-21
      
      §
     | 
  
    
  | 09:29 | 
  <moritzm> | 
  upgrading hhvm-luasandbox on mw1262-1265 | 
  [production] | 
            
  | 09:17 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Remove db1015 - T173570 (duration: 00m 44s) | 
  [production] | 
            
  | 09:15 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-codfw.php: Remove db1015 - T173570 (duration: 00m 44s) | 
  [production] | 
            
  | 09:01 | 
  <moritzm> | 
  upgrading hhvm-luasandbox on mw1261 | 
  [production] | 
            
  | 08:08 | 
  <marostegui> | 
  Rename tables article_assessment, article_assessment_pages, article_assessment_ratings tables from testwiki on db1078 - T173590 | 
  [production] | 
            
  | 07:42 | 
  <marostegui> | 
  Drop cx_drafts table from x1 - T172364 | 
  [production] | 
            
  | 07:13 | 
  <marostegui> | 
  Stop s4 replication thread on db1095 - T172996 | 
  [production] | 
            
  | 07:09 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-codfw.php: Repool db2047 (duration: 00m 45s) | 
  [production] | 
            
  | 02:36 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Mon Aug 21 02:36:58 UTC 2017 (duration 7m 3s) | 
  [production] | 
            
  | 02:29 | 
  <l10nupdate@tin> | 
  scap sync-l10n completed (1.30.0-wmf.14) (duration: 08m 57s) | 
  [production] | 
            
  
    | 
      
        2017-08-18
      
      §
     | 
  
    
  | 21:05 | 
  <mutante> | 
  gerrit2001 - restarted gerrit again after reverting gerrit:372426, using systemctl commands, not 'service' or init.d | 
  [production] | 
            
  | 20:55 | 
  <mutante> | 
  restarting gerrit on gerrit2001 | 
  [production] | 
            
  | 20:48 | 
  <demon@tin> | 
  Synchronized scap/plugins/clean.py: Completeness (duration: 00m 44s) | 
  [production] | 
            
  | 20:43 | 
  <RainbowSprinkles> | 
  prior thing was a no-op, testing | 
  [production] | 
            
  | 20:42 | 
  <demon@tin> | 
  Pruned MediaWiki: 1.30.0-wmf.9 [keeping static files] (duration: 01m 43s) | 
  [production] | 
            
  | 19:03 | 
  <bblack> | 
  cp1074 - varnish backend restart (mailbox lag) | 
  [production] | 
            
  | 19:01 | 
  <bblack> | 
  reboot cp4021-8 | 
  [production] | 
            
  | 18:21 | 
  <bblack> | 
  puppeting cp4021-8 - expect possibility of ipsec alerts, etc... | 
  [production] | 
            
  | 13:32 | 
  <Amir1> | 
  another run of /usr/local/bin/mwscript extensions/Wikidata/extensions/Wikibase/repo/maintenance/rebuildTermSqlIndex.php --wiki wikidatawiki --entity-type=item --from-id $(tail -100 /tmp/rebuildTermSqlIndex.log | grep -E "Processed up to page (\d+?)" | sed -E "s/Processed up to page //; s/ \(Q.+?//" | tail -1) >>/tmp/rebuildTermSqlIndex.log 2>&1 | 
  [production] | 
            
  | 13:26 | 
  <Amir1> | 
  ladsgroup@terbium:~$ mwscript namespaceDupes.php --wiki=hiwikiversity (T172977) | 
  [production] | 
            
  | 12:44 | 
  <Amir1> | 
  start of ladsgroup@terbium:~$ time /usr/local/bin/mwscript extensions/Wikidata/extensions/Wikibase/repo/maintenance/rebuildTermSqlIndex.php --wiki wikidatawiki --entity-type=item | 
  [production] | 
            
  | 11:36 | 
  <jynus> | 
  change topology of dbstore2001:x1 and dbstore2002:x1 | 
  [production] | 
            
  | 11:00 | 
  <elukey> | 
  reboot dbstore1002 for kernel updates | 
  [production] | 
            
  | 10:34 | 
  <elukey> | 
  restart mysql on dbstore1002 - attempt to reclaim space after big table drop (stop slaves and el_sync, check running queries, stop mysql, check process, start mysql) | 
  [production] | 
            
  | 09:55 | 
  <Amir1> | 
  one small pass of ladsgroup@terbium:~$ time /usr/local/bin/mwscript extensions/Wikidata/extensions/Wikibase/repo/maintenance/rebuildTermSqlIndex.php --wiki wikidatawiki --entity-type=entity (T171460) | 
  [production] | 
            
  | 09:46 | 
  <Amir1> | 
  ladsgroup@terbium:~$ time /usr/local/bin/mwscript extensions/Wikidata/extensions/Wikibase/repo/maintenance/rebuildTermSqlIndex.php --wiki wikidatawiki --entity-type=property (T171460) | 
  [production] | 
            
  | 09:42 | 
  <moritzm> | 
  installing libmspack security updates | 
  [production] | 
            
  | 09:16 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-codfw.php: Repool db2077 - T168409 (duration: 00m 44s) | 
  [production] | 
            
  | 07:28 | 
  <marostegui> | 
  Stop MySQL on db2077 to copy it to dbstore2001 - T168409 | 
  [production] | 
            
  | 07:26 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-codfw.php: Deoool db2077 - T168409 (duration: 00m 44s) | 
  [production] | 
            
  | 07:20 | 
  <moritzm> | 
  installing openjdk-7 security updates on trusty | 
  [production] | 
            
  | 06:58 | 
  <jynus> | 
  and nginx | 
  [production] | 
            
  | 06:55 | 
  <jynus> | 
  systemctl restart squid3.service on install2002, apt seem stuck on some servers | 
  [production] | 
            
  | 06:24 | 
  <jynus> | 
  stopping and upgrading db2033 | 
  [production] | 
            
  | 05:43 | 
  <jynus> | 
  upgrading and restarting all mariadb instances on dbstore2002 | 
  [production] | 
            
  | 01:27 | 
  <ejegg|afk> | 
  updated fundraising dash from 696a3fffdd2595331132da9b999c6dc382d0ed69 to 7dfc9691492561b63ff91888b827ad496431d150 | 
  [production] | 
            
  | 00:48 | 
  <ebernhardson@tin> | 
  Synchronized php-1.30.0-wmf.14/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: T171213: Increase sampling rate of cirrus satisfaction schema (again) to 1k per bucket per day (duration: 00m 44s) | 
  [production] | 
            
  | 00:18 | 
  <ebernhardson@tin> | 
  Synchronized php-1.30.0-wmf.14/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: T171213: Increase sampling rate of cirrus satisfaction schema (duration: 00m 44s) | 
  [production] | 
            
  
    | 
      
        2017-08-17
      
      §
     | 
  
    
  | 23:31 | 
  <thcipriani@tin> | 
  Synchronized php-1.30.0-wmf.14/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: SWAT: [[gerrit:372476|Revert "Disable cirrus MLR ab test"]] (duration: 00m 44s) | 
  [production] | 
            
  | 23:21 | 
  <thcipriani@tin> | 
  Synchronized php-1.30.0-wmf.14/resources/src/mediawiki.rcfilters/dm/mw.rcfilters.dm.FilterGroup.js: SWAT: [[gerrit:372449|RCFilters: Fix validation for single_option groups]] T173303 (duration: 00m 44s) | 
  [production] | 
            
  | 23:14 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:372446|Reapply "Remove temporary wgStructuredChangeFiltersEnableExperimentalViews setting"]] (duration: 00m 45s) | 
  [production] | 
            
  | 22:10 | 
  <ppchelko@tin> | 
  Finished deploy [changeprop/deploy@2c553a6]: Lower the concurrecy for transcludes to decrease cassandra load during cluster reshaping (duration: 01m 14s) | 
  [production] | 
            
  | 22:09 | 
  <thcipriani@tin> | 
  Synchronized php-1.30.0-wmf.14/includes/specials/SpecialNewpages.php: [[gerrit:372465|Restore the newFromId() approach in SpecialNewpages::feedItemDesc]] T173541 (duration: 00m 46s) | 
  [production] | 
            
  | 22:09 | 
  <ppchelko@tin> | 
  Started deploy [changeprop/deploy@2c553a6]: Lower the concurrecy for transcludes to decrease cassandra load during cluster reshaping | 
  [production] | 
            
  | 22:07 | 
  <gwicke> | 
  restarting pdfrender on scb100* nodes | 
  [production] | 
            
  | 21:38 | 
  <ejegg> | 
  updated dash from bec0077599737c774cc716851171365b38a8b02a to 696a3fffdd2595331132da9b999c6dc382d0ed69 | 
  [production] |