| 
      
        2018-12-13
      
      ยง
     | 
  
    
  | 18:11 | 
  <bblack> | 
  restart pybal on lvs1006 for config updates | 
  [production] | 
            
  | 18:07 | 
  <ladsgroup@deploy1001> | 
  Synchronized php-1.33.0-wmf.8/extensions/FlaggedRevs/frontend/specialpages/reports/ProblemChanges_body.php: Use the right index for change_tag (T211896) (duration: 00m 46s) | 
  [production] | 
            
  | 17:45 | 
  <ladsgroup@deploy1001> | 
  Finished deploy [ores/deploy@1a3de73]: T211267 (duration: 13m 53s) | 
  [production] | 
            
  | 17:41 | 
  <akosiaris> | 
  reapply the zotero calico policy to allow LVS endpoints | 
  [production] | 
            
  | 17:35 | 
  <dcausse> | 
  elastic@eqiad created cirrus metastore on psi&omega | 
  [production] | 
            
  | 17:32 | 
  <ladsgroup@deploy1001> | 
  Started deploy [ores/deploy@1a3de73]: T211267 | 
  [production] | 
            
  | 17:31 | 
  <arturo> | 
  T168967 added shiny-server .deb to stretch-wikimedia | 
  [production] | 
            
  | 17:20 | 
  <godog> | 
  run puppet and bounce pybal on lvs in eqiad to apply https://gerrit.wikimedia.org/r/c/operations/puppet/+/479184 | 
  [production] | 
            
  | 17:18 | 
  <akosiaris> | 
  T205919 create namespace for blubberoid on eqiad/codfw/staging clusters | 
  [production] | 
            
  | 17:00 | 
  <anomie> | 
  Set comment migration to new on group 1 (T166733) | 
  [production] | 
            
  | 16:33 | 
  <mutante> | 
  icinga1001 - started service again, enabeld puppet | 
  [production] | 
            
  | 16:27 | 
  <mutante> | 
  icinga1001 - disable puppet, stopped icinga, for cable replacement | 
  [production] | 
            
  | 16:18 | 
  <anomie> | 
  Deployed fix for T210937: API: Use parenthesized join in ApiQueryBase::showHiddenUsersAddBlockInfo | 
  [production] | 
            
  | 15:44 | 
  <moritzm> | 
  installing openssl 1.1 security updates on Hadoop workers | 
  [production] | 
            
  | 15:33 | 
  <moritzm> | 
  rebooting pybal-test hosts to pick up SSBD-enabled qemu | 
  [production] | 
            
  | 15:18 | 
  <anomie@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: Setting actor migration to write-both/read-old on all wikis (T188327) (duration: 00m 45s) | 
  [production] | 
            
  | 15:12 | 
  <anomie@deploy1001> | 
  Synchronized php-1.33.0-wmf.8/includes/api/ApiPageSet.php: Backport fix for T211804: ApiPageSet::initFromPageIds: Default $filterIds to true (duration: 00m 46s) | 
  [production] | 
            
  | 15:03 | 
  <akosiaris> | 
  ores2* deploy https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/479206/ | 
  [production] | 
            
  | 14:55 | 
  <moritzm> | 
  installing openssl 1.1 security updates on mw canaries (along with nginx restart/upgrade) | 
  [production] | 
            
  | 14:46 | 
  <cdanis> | 
  updating grafana/stretch-wikimedia to 5.4.2: reprepro --restrict grafana update stretch-wikimedia | 
  [production] | 
            
  | 14:40 | 
  <akosiaris> | 
  disable puppet on ores1* and ores2* machines to deploy https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/479206/ | 
  [production] | 
            
  | 14:36 | 
  <ladsgroup@deploy1001> | 
  Finished deploy [ores/deploy@a9d5e95]: noop (duration: 14m 59s) | 
  [production] | 
            
  | 14:23 | 
  <ladsgroup@deploy1001> | 
  Started deploy [ores/deploy@a9d5e95]: noop | 
  [production] | 
            
  | 14:21 | 
  <zfilipin@deploy1001> | 
  rebuilt and synchronized wikiversions files: all wikis to 1.33.0-wmf.8 | 
  [production] | 
            
  | 13:22 | 
  <dcausse> | 
  creating 300+ wiki indices on elastic-omega@codfw | 
  [production] | 
            
  | 13:15 | 
  <godog> | 
  stop restbase and cassandra on restbase200[1-6] - T211070 | 
  [production] | 
            
  | 12:59 | 
  <elukey> | 
  superset on analytics-tool1003 upgraded to 0.28.1 | 
  [production] | 
            
  | 12:41 | 
  <arturo> | 
  icinga downtime (30 mins) cloudcontrol1003, cloudnet1003 and cloudnet1004 for package upgrades | 
  [production] | 
            
  | 12:38 | 
  <zeljkof> | 
  EU SWAT finished | 
  [production] | 
            
  | 12:35 | 
  <zfilipin@deploy1001> | 
  Synchronized static/images/project-logos: SWAT: [[gerrit:479411|Update maiwiki logo (T211845)]] (duration: 00m 52s) | 
  [production] | 
            
  | 12:35 | 
  <oblivian@deploy1001> | 
  scap-helm zotero finished | 
  [production] | 
            
  | 12:35 | 
  <oblivian@deploy1001> | 
  scap-helm zotero cluster codfw completed | 
  [production] | 
            
  | 12:35 | 
  <oblivian@deploy1001> | 
  scap-helm zotero cluster eqiad completed | 
  [production] | 
            
  | 12:35 | 
  <oblivian@deploy1001> | 
  scap-helm zotero upgrade production -f ../zotero-values-codfw.yaml stable/zotero [namespace: zotero, clusters: eqiad,codfw] | 
  [production] | 
            
  | 12:26 | 
  <zfilipin@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:478138|Enable flood user group at ne.wiki (T211181)]] (duration: 00m 51s) | 
  [production] | 
            
  | 12:14 | 
  <zfilipin@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:478143|Namespace configuration on shnwiki (T210699)]] (duration: 00m 53s) | 
  [production] | 
            
  | 12:12 | 
  <mobrovac@deploy1001> | 
  Finished deploy [restbase/deploy@55fcd4b]: Remove restbase200[1-6], ensure body.tfa exists for feed responses and disable Citoid check - T211070 T211871 T211411 (duration: 18m 59s) | 
  [production] | 
            
  | 12:10 | 
  <oblivian@deploy1001> | 
  scap-helm -h finished | 
  [production] | 
            
  | 12:10 | 
  <oblivian@deploy1001> | 
  scap-helm -h cluster codfw completed | 
  [production] | 
            
  | 12:10 | 
  <oblivian@deploy1001> | 
  scap-helm -h cluster eqiad completed | 
  [production] | 
            
  | 12:10 | 
  <oblivian@deploy1001> | 
  scap-helm -h  [namespace: -h, clusters: eqiad,codfw] | 
  [production] | 
            
  | 12:00 | 
  <moritzm> | 
  rebooting ununpentium to pick up SSBD-enabled qemu | 
  [production] | 
            
  | 11:53 | 
  <mobrovac@deploy1001> | 
  Started deploy [restbase/deploy@55fcd4b]: Remove restbase200[1-6], ensure body.tfa exists for feed responses and disable Citoid check - T211070 T211871 T211411 | 
  [production] | 
            
  | 11:51 | 
  <elukey@deploy1001> | 
  Finished deploy [analytics/superset/deploy@35841a7]: (no justification provided) (duration: 00m 38s) | 
  [production] | 
            
  | 11:51 | 
  <elukey@deploy1001> | 
  Started deploy [analytics/superset/deploy@35841a7]: (no justification provided) | 
  [production] | 
            
  | 11:45 | 
  <mobrovac@deploy1001> | 
  Finished deploy [restbase/deploy@29a0902]: Remove restbase200[1-6] and ensure body.tfa exists for feed responses - T211070 T211871 (duration: 06m 08s) | 
  [production] | 
            
  | 11:43 | 
  <moritzm> | 
  rebooting vega/bromine to pick up SSBD-enabled qemu | 
  [production] | 
            
  | 11:39 | 
  <mobrovac@deploy1001> | 
  Started deploy [restbase/deploy@29a0902]: Remove restbase200[1-6] and ensure body.tfa exists for feed responses - T211070 T211871 | 
  [production] | 
            
  | 11:39 | 
  <mobrovac@deploy1001> | 
  Finished deploy [restbase/deploy@29a0902]: Remove restbase200[1-6] and ensure body.tfa exists for feed responses - T211070 T211871 (duration: 07m 08s) | 
  [production] | 
            
  | 11:38 | 
  <fsero@deploy1001> | 
  scap-helm zotero finished | 
  [production] |