| 2018-05-23
      
      ยง | 
    
  | 16:31 | <SMalyshev> | starting wikidata full reindex for T163642 | [production] | 
            
  | 16:11 | <addshore@tin> | Finished scap: WikibaseLexeme: Do not refer to the spelling variant as language, T193603, [[gerrit:434691|Patch 1]], [[gerrit:434690|Patch 2]] (duration: 103m 38s) | [production] | 
            
  | 16:10 | <anomie> | Running deduplicateArchiveRevId.php on group 0 for T193180 | [production] | 
            
  | 15:53 | <anomie> | Running populateExternallinksIndex60.php on group 0 for T59176 | [production] | 
            
  | 15:30 | <jynus> | stop db2044 for cloning to db2078 + upgrade | [production] | 
            
  | 14:52 | <jynus> | restart db2078 for upgrade and to convert it to multiinstance | [production] | 
            
  | 14:30 | <moritzm> | installing curl security updates on mediawiki canaries along with HHVM restart to pick up new library version | [production] | 
            
  | 14:28 | <addshore@tin> | Started scap: WikibaseLexeme: Do not refer to the spelling variant as language, T193603, [[gerrit:434691|Patch 1]], [[gerrit:434690|Patch 2]] | [production] | 
            
  | 14:12 | <addshore@tin> | Synchronized wmf-config/InitialiseSettings.php: [[gerrit:434600|Enable HD logos for wikimania2018wiki]] T194340 (duration: 01m 20s) | [production] | 
            
  | 14:05 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 14:01 | <zfilipin@tin> | Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:434697|Disable wikidiff2 inline moved paragraphs by default (T194271)]] (duration: 01m 18s) | [production] | 
            
  | 13:55 | <jynus> | stopping db1065 database to move it to m2 | [production] | 
            
  | 13:47 | <zfilipin@tin> | Synchronized static/images/project-logos/: SWAT: [[gerrit:434598|Change logo assets for wikimania2018wiki (T194340)]] (duration: 01m 20s) | [production] | 
            
  | 13:32 | <zfilipin@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:434692|Disable wikidiff2 inline moved paragraphs on production (T194271)]] (duration: 01m 21s) | [production] | 
            
  | 13:22 | <zfilipin@tin> | Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:434693|Revert "Disable wikidiff2 inline moved paragraphs by default" (T194271)]] (duration: 01m 19s) | [production] | 
            
  | 13:17 | <zfilipin@tin> | scap failed: average error rate on 7/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/2cc7028226a539553178454fc2f14459 for details) | [production] | 
            
  | 13:05 | <jynus> | starting logical dump of m3-master | [production] | 
            
  | 13:00 | <jynus> | starting logical dump of m2-master | [production] | 
            
  | 12:47 | <addshore> | addshore@terbium:~$ echo 'https://www.wikidata.org/wiki/Special:EntityData/L1.rdf' | mwscript purgeList.php | [production] | 
            
  | 12:43 | <addshore@tin> | Synchronized wmf-config/Wikibase.php: [[gerrit:434683|Fix disabledRdfExportEntityTypes for wikidata]] T168260 (duration: 01m 20s) | [production] | 
            
  | 12:16 | <XioNoX> | set normal metric on codfw-eqsin link | [production] | 
            
  | 12:06 | <elukey> | upgrade druid public to druid 0.11 (druid100[4-6]) | [production] | 
            
  | 11:45 | <akosiaris> | reimage ganeti2002, ganeti2006 as debian stretch | [production] | 
            
  | 11:45 | <ppchelko@tin> | Finished deploy [cpjobqueue/deploy@59674ba]: Correctly commit pending messages for multi-topic rules (duration: 00m 47s) | [production] | 
            
  | 11:44 | <ppchelko@tin> | Started deploy [cpjobqueue/deploy@59674ba]: Correctly commit pending messages for multi-topic rules | [production] | 
            
  | 11:33 | <addshore> | addshore@mw1317:~$ scap pull # It seemed to be missing changes..... | [production] | 
            
  | 11:30 | <moritzm> | installing curl security updates | [production] | 
            
  | 11:09 | <addshore> | Lexeme deploy window probably done (unless something explodes) | [production] | 
            
  | 10:42 | <addshore> | addshore@terbium mwscript extensions/WikibaseLexeme/maintenance/createBlacklistedLexemes.php --wiki testwikidatawiki | [production] | 
            
  | 10:40 | <addshore@tin> | Synchronized wmf-config/InitialiseSettings.php: Enable WikibaseLexeme on wikidata.org T191457 T168260 https://gerrit.wikimedia.org/r/#/c/434453 (duration: 01m 20s) | [production] | 
            
  | 10:32 | <jynus> | stop db1065 for cloning (proxys will complain) | [production] | 
            
  | 10:27 | <ppchelko@tin> | Finished deploy [cpjobqueue/deploy@ffdc19a]: Logging improvements (duration: 00m 47s) | [production] | 
            
  | 10:26 | <ppchelko@tin> | Started deploy [cpjobqueue/deploy@ffdc19a]: Logging improvements | [production] | 
            
  | 10:21 | <jynus> | restarting db1117 for setup and upgrade | [production] | 
            
  | 10:17 | <dcausse> | manually updating mapping on wikidatawiki elastic indices to add new lexeme fields | [production] | 
            
  | 10:15 | <addshore> | updateSearchIndexConfig.php with --justMapping failed :( | [production] | 
            
  | 10:15 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1101:3318 after alter table (duration: 01m 20s) | [production] | 
            
  | 10:14 | <addshore> | addshore@wasat:~$ mwscript extensions/CirrusSearch/maintenance/updateSearchIndexConfig.php --wiki wikidatawiki --justMapping --cluster codfw | [production] | 
            
  | 09:35 | <addshore> | Finished, forceSearchIndex.php --wiki testwikidatawiki | [production] | 
            
  | 09:34 | <moritzm> | upgrading remaining job runners in eqiad to HHVM 3,18.5+dfsg-1+wmf8+deb9u1 | [production] | 
            
  | 09:30 | <marostegui> | Deploy schema change on db1101:3318 - T191519 T188299 T190148 T194270 | [production] | 
            
  | 09:30 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1101:3318 for alter table (duration: 01m 20s) | [production] | 
            
  | 09:03 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1099:3318 after alter table (duration: 01m 19s) | [production] | 
            
  | 09:02 | <addshore> | addshore@terbium:~$ mwscript extensions/CirrusSearch/maintenance/forceSearchIndex.php --wiki testwikidatawiki --queue | [production] | 
            
  | 09:00 | <addshore@tin> | Synchronized wmf-config/InitialiseSettings.php: [[gerrit:434642|[testwikidata] Add Lexeme NS to ContentNamespaces]] (duration: 01m 20s) | [production] | 
            
  | 08:31 | <moritzm> | upgrading remaining app/API servers in codfw to HHVM 3,18.5+dfsg-1+wmf8+deb9u1 | [production] | 
            
  | 08:21 | <marostegui> | Deploy schema change on db1099:3318 - T191519 T188299 T190148 T194270 | [production] | 
            
  | 08:20 | <addshore> | all the updateSearchIndexConfig runs from wasat also had --cluster=codfw | [production] | 
            
  | 08:20 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1099:3318 for alter table (duration: 01m 20s) | [production] | 
            
  | 08:18 | <addshore> | addshore@wasat:~$ mwscript extensions/CirrusSearch/maintenance/updateSearchIndexConfig.php --wiki testwikidatawiki --reindexAndRemoveOk --indexIdentifier=now | [production] |