| 
      
        2018-06-14
      
      ยง
     | 
  
    
  | 21:27 | 
  <thcipriani@deploy1001> | 
  Pruned MediaWiki: 1.32.0-wmf.1 (duration: 06m 54s) | 
  [production] | 
            
  | 21:18 | 
  <thcipriani@deploy1001> | 
  Finished scap: testwiki to 1.32.0-wmf.999 (multi-content-revisions T196585) and rebuild l10n cache (duration: 65m 50s) | 
  [production] | 
            
  | 21:12 | 
  <bblack> | 
  re-enable and run puppet on cache_upload - T192555 | 
  [production] | 
            
  | 20:45 | 
  <bblack> | 
  re-enable and run puppet on rest of cache_text (eqiad, eqsin, esams) - T192555 | 
  [production] | 
            
  | 20:21 | 
  <bblack> | 
  re-enable and run puppet on text@ulsfo - T192555 | 
  [production] | 
            
  | 20:12 | 
  <thcipriani@deploy1001> | 
  Started scap: testwiki to 1.32.0-wmf.999 (multi-content-revisions T196585) and rebuild l10n cache | 
  [production] | 
            
  | 20:11 | 
  <bblack> | 
  re-enable and run puppet on text@codfw - T192555 | 
  [production] | 
            
  | 19:21 | 
  <vgutierrez> | 
  Reenable puppet in cache:misc nodes - T192555 | 
  [production] | 
            
  | 19:13 | 
  <thcipriani@deploy1001> | 
  rebuilt and synchronized wikiversions files: all wikis to 1.32.0-wmf.8 | 
  [production] | 
            
  | 18:17 | 
  <niharika29@deploy1001> | 
  Synchronized wmf-config/CommonSettings.php: Bump ExtensionDistributor default to REL1_31 (duration: 00m 57s) | 
  [production] | 
            
  | 18:14 | 
  <niharika29@deploy1001> | 
  Synchronized langlist-labs: beta: declare beta sr.wikipedia and beta crh.wikipedia to langlist-labs (duration: 00m 58s) | 
  [production] | 
            
  | 18:10 | 
  <niharika29@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: Enable RemexHtml on a few more wikis - T195263 (duration: 01m 00s) | 
  [production] | 
            
  | 17:34 | 
  <gehel> | 
  rolling restart of elasticsearch codfw completed - T194245 | 
  [production] | 
            
  | 17:10 | 
  <ottomata> | 
  bouncing kafka broker on kafka2003 to make sure ACLs are okk | 
  [production] | 
            
  | 17:08 | 
  <ottomata> | 
  applying ACLs to Kafka main-codfw and main-eqiad - T196081 | 
  [production] | 
            
  | 16:41 | 
  <vgutierrez> | 
  disable puppet on cache nodes before merging gerrit/440114 - T192555 | 
  [production] | 
            
  | 15:39 | 
  <ottomata> | 
  switching EventStreams service to be backed by main-eqiad - T185225 | 
  [production] | 
            
  | 14:48 | 
  <ejegg> | 
  disabled donations and refund queue consumers | 
  [production] | 
            
  | 14:45 | 
  <ejegg> | 
  updated CiviCRM from 69091d8b5f4f3e2dd to f54f9810ab6742463 | 
  [production] | 
            
  | 14:40 | 
  <mutante> | 
  moving wikidata query dispatcher from terbium to mwmaint1001 - scheduled downtime - check turned into a WARN - disabling puppet on mwmaint1001, removing crons on terbium, waiting a couple minutes for them to finish, re-enabling puppet on mwmaint1001 (T192092) | 
  [production] | 
            
  | 14:32 | 
  <moritzm> | 
  (slow) initial rollout of debmonitor-client | 
  [production] | 
            
  | 13:47 | 
  <zeljkof> | 
  EU SWAT finished | 
  [production] | 
            
  | 13:46 | 
  <zfilipin@deploy1001> | 
  Synchronized php-1.32.0-wmf.8/extensions/Wikibase: SWAT: [[gerrit:440343| Revert "Statement transclusion: when entity of unknown type in statement, display ID as string" (T195615)]] (duration: 01m 21s) | 
  [production] | 
            
  | 13:35 | 
  <zfilipin@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:438283|Set a few of namespace aliases on ruwikisource (T196719)]] (duration: 00m 59s) | 
  [production] | 
            
  | 13:11 | 
  <volans@deploy1001> | 
  Finished deploy [debmonitor/deploy@476fd8b]: Release v0.1.4 (duration: 00m 19s) | 
  [production] | 
            
  | 13:10 | 
  <volans@deploy1001> | 
  Started deploy [debmonitor/deploy@476fd8b]: Release v0.1.4 | 
  [production] | 
            
  | 12:54 | 
  <hoo> | 
  Updated the Wikidata property suggester with data from Monday's JSON dump and applied the T132839 workarounds | 
  [production] | 
            
  | 12:29 | 
  <ema> | 
  cp3037: run update-ocsp-all | 
  [production] | 
            
  | 12:23 | 
  <gehel> | 
  rolling restart of elasticsearch codfw for plugin upgrade - T194245 | 
  [production] | 
            
  | 11:38 | 
  <marostegui> | 
  Deploy schema change on db1067 T191316 T192926 T89737 T195193 | 
  [production] | 
            
  | 11:25 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1067 for alter table (duration: 00m 57s) | 
  [production] | 
            
  | 11:16 | 
  <elukey> | 
  upgrade cassandra on aqs* to 2.2.6-wmf5 | 
  [production] | 
            
  | 11:16 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1114 after alter table (duration: 01m 01s) | 
  [production] | 
            
  | 10:04 | 
  <addshore> | 
  @terbium: for i in {2001..3000}; do echo Lexeme:L$i; done | mwscript purgePage.php --wiki wikidatawiki // T197222 | 
  [production] | 
            
  | 09:59 | 
  <addshore> | 
  @terbium: for i in {1001..2000}; do echo Lexeme:L$i; done | mwscript purgePage.php --wiki wikidatawiki // T197222 | 
  [production] | 
            
  | 09:57 | 
  <addshore> | 
  for i in {1..1000}; do echo Lexeme:L$i; done | mwscript purgePage.php --wiki wikidatawiki // T197222 | 
  [production] | 
            
  | 09:15 | 
  <elukey> | 
  add debmonitor term to analytics-in4 on cr1/cr2 eqiad | 
  [production] | 
            
  | 08:59 | 
  <ppchelko@deploy1001> | 
  Finished deploy [cpjobqueue/deploy@2680ba8]: Decrease the checkerJob delays recheck to 10 minutes (duration: 01m 18s) | 
  [production] | 
            
  | 08:58 | 
  <ppchelko@deploy1001> | 
  Started deploy [cpjobqueue/deploy@2680ba8]: Decrease the checkerJob delays recheck to 10 minutes | 
  [production] | 
            
  | 08:31 | 
  <elukey> | 
  restart hadoop hdfs master nodes to pick up the new journal node settings | 
  [production] | 
            
  | 08:29 | 
  <gehel> | 
  restart of elasticsearch / relforge for plugin updates | 
  [production] | 
            
  | 08:08 | 
  <mutante> | 
  switch backend for dbtree.wikimedia.org away from terbium to mwmaint1001 (T192092) | 
  [production] | 
            
  | 08:07 | 
  <elukey> | 
  roll restart of hadoop journal nodes to pick up the new configuration (two more journal nodes added) | 
  [production] | 
            
  | 08:03 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: BETAONLY: [[gerrit:440279|senses for beta wikidatas]] (duration: 00m 58s) | 
  [production] | 
            
  | 07:58 | 
  <moritzm> | 
  resuming rolling restart of cassandra on restbase2* to pick up OpenJDK security update | 
  [production] | 
            
  | 07:41 | 
  <marostegui> | 
  Deploy schema change on db1114 T191316 T192926 T89737 T195193 | 
  [production] | 
            
  | 07:41 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1114 for alter table (duration: 00m 58s) | 
  [production] | 
            
  | 07:37 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1083 after alter table (duration: 00m 58s) | 
  [production] | 
            
  | 05:47 | 
  <mutante> | 
  LDAP - added user mepps to wmf group (T192472) | 
  [production] | 
            
  | 05:15 | 
  <marostegui> | 
  Deploy schema change on db1083 T191316 T192926 T89737 T195193 | 
  [production] |