| 
      
        2019-04-09
      
      ยง
     | 
  
    
  | 16:49 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics finished | 
  [production] | 
            
  | 16:49 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics cluster eqiad completed | 
  [production] | 
            
  | 16:49 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics upgrade production -f eventgate-analytics-eqiad-values.yaml --reset-values stable/eventgate-analytics [namespace: eventgate-analytics, clusters: eqiad] | 
  [production] | 
            
  | 16:46 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics finished | 
  [production] | 
            
  | 16:46 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics cluster codfw completed | 
  [production] | 
            
  | 16:46 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics upgrade production -f eventgate-analytics-codfw-values.yaml --reset-values stable/eventgate-analytics [namespace: eventgate-analytics, clusters: codfw] | 
  [production] | 
            
  | 16:45 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics finished | 
  [production] | 
            
  | 16:45 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics cluster staging completed | 
  [production] | 
            
  | 16:45 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml --reset-values stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] | 
  [production] | 
            
  | 16:41 | 
  <herron> | 
  performing rolling restart of kafka main brokers and eventbus instances in eqiad to pick up security updates | 
  [production] | 
            
  | 16:32 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics finished | 
  [production] | 
            
  | 16:32 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics cluster staging completed | 
  [production] | 
            
  | 16:32 | 
  <otto@deploy1001> | 
  scap-helm eventgate-analytics upgrade staging -f eventgate-analytics-staging-values.yaml --reset-values stable/eventgate-analytics [namespace: eventgate-analytics, clusters: staging] | 
  [production] | 
            
  | 16:28 | 
  <jijiki> | 
  Restarting thumbor service on thumbor1001 | 
  [production] | 
            
  | 16:26 | 
  <jijiki> | 
  Upgrading thumbor1001 to python-thumbor-wikimedia_2.4-1+deb9u1 | 
  [production] | 
            
  | 16:18 | 
  <jijiki> | 
  Uploading python-thumbor-wikimedia_2.4-1+deb9u1 to component/thumbor in stretch-wikimedia | 
  [production] | 
            
  | 15:05 | 
  <moritzm> | 
  uploaded jenkins 2.164.1 for stretch-wikimedia/thirdparty/ci | 
  [production] | 
            
  | 15:04 | 
  <moritzm> | 
  uploaded jenkins 2.164.1 for jessie-wikimedia/thirdparty | 
  [production] | 
            
  | 14:42 | 
  <ejegg> | 
  updated payments-wiki from 15bcb3d1a6 to aa8dad50e7 | 
  [production] | 
            
  | 14:10 | 
  <ema> | 
  reboot lvs2010 with systemd 232 T209707 | 
  [production] | 
            
  | 14:09 | 
  <godog> | 
  bootstrapping cassandra-b, restbase2020 -- T208087 | 
  [production] | 
            
  | 13:19 | 
  <godog> | 
  bounce rsyslog on wezen | 
  [production] | 
            
  | 13:11 | 
  <fsero> | 
  building envoy docker image | 
  [production] | 
            
  | 13:07 | 
  <jbond42> | 
  rolling security updates of systemd on canary systems | 
  [production] | 
            
  | 12:35 | 
  <godog> | 
  bounce rsyslog on lithium | 
  [production] | 
            
  | 12:13 | 
  <elukey> | 
  powercycle logstash1012 - no ssh, no mgmt console available, seems completely stuck | 
  [production] | 
            
  | 12:10 | 
  <jbond42> | 
  remove facter2.4  from wikimedia-buster | 
  [production] | 
            
  | 11:26 | 
  <moritzm> | 
  upgrading API servers mw1276-mw1290 to HHVM 3.18.5+dfsg-1+wmf8+deb9u2 and wikidiff 1.8.1 (T203069) | 
  [production] | 
            
  | 11:07 | 
  <akosiaris> | 
  pool both DCs for newly created swift.recovery.wmnet RR | 
  [production] | 
            
  | 11:07 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/pooled=true; selector: name=.*,dnsdisc=swift | 
  [production] | 
            
  | 11:00 | 
  <ema> | 
  rebooting lvs2010 with systemd 241-1~bpo9+1 T209707 | 
  [production] | 
            
  | 10:57 | 
  <moritzm> | 
  updated buster installer to daily build from 9th of April | 
  [production] | 
            
  | 10:09 | 
  <godog> | 
  bootstrapping cassandra-a, restbase2020 -- T208087 | 
  [production] | 
            
  | 10:07 | 
  <moritzm> | 
  rebooting stat1005 for some tests again | 
  [production] | 
            
  | 09:49 | 
  <gilles@deploy1001> | 
  Synchronized php-1.33.0-wmf.24/extensions/NavigationTiming: T220476 Add originCountry to paintTiming context (duration: 00m 54s) | 
  [production] | 
            
  | 09:46 | 
  <moritzm> | 
  rebooting stat1005 for some tests | 
  [production] | 
            
  | 08:47 | 
  <akosiaris> | 
  switch swift to be accessed from varnish+ats active/active rw | 
  [production] | 
            
  | 08:38 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Remove old comment from db1089 (duration: 00m 51s) | 
  [production] | 
            
  | 08:33 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-codfw.php: Repool db2069 (duration: 00m 50s) | 
  [production] | 
            
  | 08:10 | 
  <marostegui> | 
  Upgrade db2069 | 
  [production] | 
            
  | 08:10 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-codfw.php: Depool db2069 (duration: 00m 51s) | 
  [production] | 
            
  | 07:52 | 
  <moritzm> | 
  upgrading app servers mw1319-mw1333 to HHVM 3.18.5+dfsg-1+wmf8+deb9u2 and wikidiff 1.8.1 (T203069) | 
  [production] | 
            
  | 07:48 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Deploy parsercache key change everywhere T210725 (duration: 00m 53s) | 
  [production] | 
            
  | 07:37 | 
  <moritzm> | 
  installing samba security updates | 
  [production] | 
            
  | 07:21 | 
  <marostegui> | 
  Change parsercache keys on mw[1230-1235,1238-1239] - T210725 | 
  [production] | 
            
  | 07:10 | 
  <jijiki> | 
  Depool thumbor1004 for testing - T187765 | 
  [production] | 
            
  | 07:09 | 
  <marostegui> | 
  Change parsercache keys on mw[1221-1229] - T210725 | 
  [production] | 
            
  | 07:03 | 
  <marostegui> | 
  Change parsercache keys on mw[1280-1289] - T210725 | 
  [production] | 
            
  | 06:51 | 
  <dcausse> | 
  elasticsearch search cluster: reindex all spaceless languages in eqiad and codfw (T219533) | 
  [production] | 
            
  | 06:47 | 
  <moritzm> | 
  installing libav security updates | 
  [production] |