| 2018-12-13
      
      ยง | 
    
  | 18:26 | <mholloway-shell@deploy1001> | Started deploy [mobileapps/deploy@93443fe]: Refine MW API queries | [production] | 
            
  | 18:24 | <jforrester@deploy1001> | Synchronized wmf-config/Wikibase.php: T204748 [Beta only] Use newly-fixed config for Wikibase->Commons federation (duration: 00m 44s) | [production] | 
            
  | 18:22 | <jforrester@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: T204748 Rename repo-only Wikibase config for clarity [no-op] (duration: 00m 45s) | [production] | 
            
  | 18:11 | <bblack> | restart pybal on lvs1006 for config updates | [production] | 
            
  | 18:07 | <ladsgroup@deploy1001> | Synchronized php-1.33.0-wmf.8/extensions/FlaggedRevs/frontend/specialpages/reports/ProblemChanges_body.php: Use the right index for change_tag (T211896) (duration: 00m 46s) | [production] | 
            
  | 17:45 | <ladsgroup@deploy1001> | Finished deploy [ores/deploy@1a3de73]: T211267 (duration: 13m 53s) | [production] | 
            
  | 17:41 | <akosiaris> | reapply the zotero calico policy to allow LVS endpoints | [production] | 
            
  | 17:35 | <dcausse> | elastic@eqiad created cirrus metastore on psi&omega | [production] | 
            
  | 17:32 | <ladsgroup@deploy1001> | Started deploy [ores/deploy@1a3de73]: T211267 | [production] | 
            
  | 17:31 | <arturo> | T168967 added shiny-server .deb to stretch-wikimedia | [production] | 
            
  | 17:20 | <godog> | run puppet and bounce pybal on lvs in eqiad to apply https://gerrit.wikimedia.org/r/c/operations/puppet/+/479184 | [production] | 
            
  | 17:18 | <akosiaris> | T205919 create namespace for blubberoid on eqiad/codfw/staging clusters | [production] | 
            
  | 17:00 | <anomie> | Set comment migration to new on group 1 (T166733) | [production] | 
            
  | 16:33 | <mutante> | icinga1001 - started service again, enabeld puppet | [production] | 
            
  | 16:27 | <mutante> | icinga1001 - disable puppet, stopped icinga, for cable replacement | [production] | 
            
  | 16:18 | <anomie> | Deployed fix for T210937: API: Use parenthesized join in ApiQueryBase::showHiddenUsersAddBlockInfo | [production] | 
            
  | 15:44 | <moritzm> | installing openssl 1.1 security updates on Hadoop workers | [production] | 
            
  | 15:33 | <moritzm> | rebooting pybal-test hosts to pick up SSBD-enabled qemu | [production] | 
            
  | 15:18 | <anomie@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Setting actor migration to write-both/read-old on all wikis (T188327) (duration: 00m 45s) | [production] | 
            
  | 15:12 | <anomie@deploy1001> | Synchronized php-1.33.0-wmf.8/includes/api/ApiPageSet.php: Backport fix for T211804: ApiPageSet::initFromPageIds: Default $filterIds to true (duration: 00m 46s) | [production] | 
            
  | 15:03 | <akosiaris> | ores2* deploy https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/479206/ | [production] | 
            
  | 14:55 | <moritzm> | installing openssl 1.1 security updates on mw canaries (along with nginx restart/upgrade) | [production] | 
            
  | 14:46 | <cdanis> | updating grafana/stretch-wikimedia to 5.4.2: reprepro --restrict grafana update stretch-wikimedia | [production] | 
            
  | 14:40 | <akosiaris> | disable puppet on ores1* and ores2* machines to deploy https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/479206/ | [production] | 
            
  | 14:36 | <ladsgroup@deploy1001> | Finished deploy [ores/deploy@a9d5e95]: noop (duration: 14m 59s) | [production] | 
            
  | 14:23 | <ladsgroup@deploy1001> | Started deploy [ores/deploy@a9d5e95]: noop | [production] | 
            
  | 14:21 | <zfilipin@deploy1001> | rebuilt and synchronized wikiversions files: all wikis to 1.33.0-wmf.8 | [production] | 
            
  | 13:22 | <dcausse> | creating 300+ wiki indices on elastic-omega@codfw | [production] | 
            
  | 13:15 | <godog> | stop restbase and cassandra on restbase200[1-6] - T211070 | [production] | 
            
  | 12:59 | <elukey> | superset on analytics-tool1003 upgraded to 0.28.1 | [production] | 
            
  | 12:41 | <arturo> | icinga downtime (30 mins) cloudcontrol1003, cloudnet1003 and cloudnet1004 for package upgrades | [production] | 
            
  | 12:38 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 12:35 | <zfilipin@deploy1001> | Synchronized static/images/project-logos: SWAT: [[gerrit:479411|Update maiwiki logo (T211845)]] (duration: 00m 52s) | [production] | 
            
  | 12:35 | <oblivian@deploy1001> | scap-helm zotero finished | [production] | 
            
  | 12:35 | <oblivian@deploy1001> | scap-helm zotero cluster codfw completed | [production] | 
            
  | 12:35 | <oblivian@deploy1001> | scap-helm zotero cluster eqiad completed | [production] | 
            
  | 12:35 | <oblivian@deploy1001> | scap-helm zotero upgrade production -f ../zotero-values-codfw.yaml stable/zotero [namespace: zotero, clusters: eqiad,codfw] | [production] | 
            
  | 12:26 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:478138|Enable flood user group at ne.wiki (T211181)]] (duration: 00m 51s) | [production] | 
            
  | 12:14 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:478143|Namespace configuration on shnwiki (T210699)]] (duration: 00m 53s) | [production] | 
            
  | 12:12 | <mobrovac@deploy1001> | Finished deploy [restbase/deploy@55fcd4b]: Remove restbase200[1-6], ensure body.tfa exists for feed responses and disable Citoid check - T211070 T211871 T211411 (duration: 18m 59s) | [production] | 
            
  | 12:10 | <oblivian@deploy1001> | scap-helm -h finished | [production] | 
            
  | 12:10 | <oblivian@deploy1001> | scap-helm -h cluster codfw completed | [production] | 
            
  | 12:10 | <oblivian@deploy1001> | scap-helm -h cluster eqiad completed | [production] | 
            
  | 12:10 | <oblivian@deploy1001> | scap-helm -h  [namespace: -h, clusters: eqiad,codfw] | [production] | 
            
  | 12:00 | <moritzm> | rebooting ununpentium to pick up SSBD-enabled qemu | [production] | 
            
  | 11:53 | <mobrovac@deploy1001> | Started deploy [restbase/deploy@55fcd4b]: Remove restbase200[1-6], ensure body.tfa exists for feed responses and disable Citoid check - T211070 T211871 T211411 | [production] | 
            
  | 11:51 | <elukey@deploy1001> | Finished deploy [analytics/superset/deploy@35841a7]: (no justification provided) (duration: 00m 38s) | [production] | 
            
  | 11:51 | <elukey@deploy1001> | Started deploy [analytics/superset/deploy@35841a7]: (no justification provided) | [production] | 
            
  | 11:45 | <mobrovac@deploy1001> | Finished deploy [restbase/deploy@29a0902]: Remove restbase200[1-6] and ensure body.tfa exists for feed responses - T211070 T211871 (duration: 06m 08s) | [production] | 
            
  | 11:43 | <moritzm> | rebooting vega/bromine to pick up SSBD-enabled qemu | [production] |