| 2019-03-20
      
      § | 
    
  | 13:29 | <otto@deploy1001> | scap-helm eventgate-analytics cluster staging completed | [production] | 
            
  | 13:29 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 13:29 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] | [production] | 
            
  | 11:51 | <akosiaris> | re-enable puppet across fleet | [production] | 
            
  | 11:45 | <Amir1> | EU SWAT is done | [production] | 
            
  | 11:44 | <ladsgroup@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:497578|Add wikimania as a special group to wikidata sitelinks (T217730)]] (duration: 00m 50s) | [production] | 
            
  | 11:40 | <ladsgroup@deploy1001> | Synchronized dblists/wikidataclient.dblist: SWAT: [[gerrit:497579|Add wikimaniawiki to wikidataclient.dblist (T217730)]] (duration: 00m 50s) | [production] | 
            
  | 11:34 | <ladsgroup@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:497500|Enable Advanced Mobile Contributions mode for ar,id,es and test wikis (T217643)]] (duration: 00m 50s) | [production] | 
            
  | 11:34 | <akosiaris> | disable puppet across fleet to avoid alert spam storm | [production] | 
            
  | 11:28 | <ladsgroup@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:497433|Partially revert "Enable musical notation datatype in wikidata" (T218535)]] (duration: 00m 50s) | [production] | 
            
  | 11:16 | <ladsgroup@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:496161|Increased maxSerializedEntitySize from 2500 to 3000 (T217739)]] (duration: 01m 47s) | [production] | 
            
  | 11:03 | <akosiaris> | restart gerrit for testing https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/497727/ | [production] | 
            
  | 10:28 | <akosiaris> | restart gerrit for merge of https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/497561/ | [production] | 
            
  | 10:26 | <godog> | reimage prometheus1003 with stretch - T205870 | [production] | 
            
  | 10:20 | <marostegui> | Repool dbproxy1010 and running wmcs-wikireplica-dns script | [production] | 
            
  | 10:12 | <marostegui> | Reboot dbproxy1010 for upgrade | [production] | 
            
  | 09:45 | <vgutierrez> | updated acme-chief to version 0.14 in acmechief[12]001 | [production] | 
            
  | 09:32 | <marostegui> | Deploy schema change on s7 codfw master, lag will appear on codfw | [production] | 
            
  | 09:06 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1087 (duration: 00m 48s) | [production] | 
            
  | 08:59 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1087 (duration: 00m 48s) | [production] | 
            
  | 08:55 | <filippo@puppetmaster1001> | conftool action : set/pooled=no; selector: name=prometheus1003.eqiad.wmnet | [production] | 
            
  | 08:53 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1109 (duration: 00m 48s) | [production] | 
            
  | 08:47 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1109 (duration: 00m 48s) | [production] | 
            
  | 08:33 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1092 (duration: 00m 48s) | [production] | 
            
  | 08:26 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1092 (duration: 00m 48s) | [production] | 
            
  | 08:20 | <ema> | cp2009, cp1071 (cp-ats): reboot for kernel upgrades | [production] | 
            
  | 07:32 | <elukey> | pool kafka1001 in pybal's eventbus service after yesterday's network maintenance | [production] | 
            
  | 06:09 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool databases in row A - T187960 (duration: 00m 49s) | [production] | 
            
  | 00:48 | <thcipriani@deploy1001> | Synchronized php-1.33.0-wmf.21/includes/Title.php: SWAT: [[gerrit:497649|Improve Caching in Title::loadRestrictions()]] (duration: 00m 51s) | [production] | 
            
  
    | 2019-03-19
      
      § | 
    
  | 22:20 | <otto@deploy1001> | Finished deploy [eventlogging/analytics@9aea626]: fix for production error where mw api is returning html instead of json schemas (duration: 00m 04s) | [production] | 
            
  | 22:20 | <otto@deploy1001> | Started deploy [eventlogging/analytics@9aea626]: fix for production error where mw api is returning html instead of json schemas | [production] | 
            
  | 21:50 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 21:50 | <otto@deploy1001> | scap-helm eventgate-analytics cluster eqiad completed | [production] | 
            
  | 21:50 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade production -f eventgate-analytics-eqiad-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad] | [production] | 
            
  | 21:50 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 21:50 | <otto@deploy1001> | scap-helm eventgate-analytics cluster codfw completed | [production] | 
            
  | 21:50 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade production -f eventgate-analytics-codfw-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: codfw] | [production] | 
            
  | 21:36 | <otto@deploy1001> | scap-helm eventgate-analytics cluster staging completed | [production] | 
            
  | 21:36 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 21:36 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] | [production] | 
            
  | 21:23 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 21:23 | <otto@deploy1001> | scap-helm eventgate-analytics cluster staging completed | [production] | 
            
  | 21:23 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] | [production] | 
            
  | 21:07 | <cdanis> | cdanis@wikitech-static.wikimedia.org: apt install sshguard | [production] | 
            
  | 21:06 | <otto@deploy1001> | scap-helm eventgate-analytics cluster staging completed | [production] | 
            
  | 21:06 | <otto@deploy1001> | scap-helm eventgate-analytics finished | [production] | 
            
  | 21:06 | <otto@deploy1001> | scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] | [production] | 
            
  | 20:58 | <XioNoX> | disable down ports with no description on switches | [production] | 
            
  | 20:44 | <cdanis> | enabling puppet on contint1001 | [production] | 
            
  | 19:54 | <gehel@cumin1001> | END (FAIL) - Cookbook sre.elasticsearch.e6-upgrade (exit_code=99) | [production] |