| 2020-07-16
      
      § | 
    
  | 09:15 | <jmm@cumin2001> | START - Cookbook sre.hosts.reboot-single | [production] | 
            
  | 09:15 | <jmm@cumin2001> | END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) | [production] | 
            
  | 09:15 | <jmm@cumin2001> | START - Cookbook sre.hosts.reboot-single | [production] | 
            
  | 09:15 | <moritzm> | rebooting flowspec1001 | [production] | 
            
  | 08:52 | <jayme> | updated envoyproxy to 1.14.4-1 on mwdebug1001.eqiad.wmnet | [production] | 
            
  | 08:41 | <moritzm> | installing sqlite3 security updates | [production] | 
            
  | 08:39 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Repool db2081', diff saved to https://phabricator.wikimedia.org/P11924 and previous config saved to /var/cache/conftool/dbconfig/20200716-083954-marostegui.json | [production] | 
            
  | 08:35 | <XioNoX> | Remove PIM/IGMP related CR stanza (acls) - T257573 | [production] | 
            
  | 08:33 | <jmm@cumin2001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 08:33 | <jmm@cumin2001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 08:33 | <jmm@cumin2001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 08:33 | <jmm@cumin2001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 08:32 | <jmm@cumin2001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 08:32 | <jmm@cumin2001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 08:26 | <moritzm> | installing dbus security updates | [production] | 
            
  | 08:25 | <marostegui@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) | [production] | 
            
  | 08:24 | <XioNoX> | remove igmp-snooping from access switches - T257573 | [production] | 
            
  | 08:23 | <marostegui@cumin1001> | START - Cookbook sre.hosts.downtime | [production] | 
            
  | 08:15 | <moritzm> | installing python-urllib3 security updates | [production] | 
            
  | 08:15 | <XioNoX> | remove PIM config from eqord/eqdfw/knams routers - T257573 | [production] | 
            
  | 08:14 | <XioNoX> | remove PIM config from eqiad routers - T257573 | [production] | 
            
  | 08:11 | <XioNoX> | remove PIM config from esams routers - T257573 | [production] | 
            
  | 08:09 | <XioNoX> | remove PIM config from eqsin routers - T257573 | [production] | 
            
  | 08:08 | <jbond42> | update mail delivery for phabricator to use phabricator.discovery.wmnet cname | [production] | 
            
  | 08:07 | <XioNoX> | remove PIM config from codfw routers - T257573 | [production] | 
            
  | 08:06 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db2081', diff saved to https://phabricator.wikimedia.org/P11923 and previous config saved to /var/cache/conftool/dbconfig/20200716-080613-marostegui.json | [production] | 
            
  | 08:03 | <XioNoX> | remove PIM config from ulsfo routers - T257573 | [production] | 
            
  | 07:41 | <jayme> | imported envoyproxy_1.14.4-1 to stretch-wikimedia | [production] | 
            
  | 07:31 | <jayme> | imported envoyproxy_1.14.4-1 to buster-wikimedia | [production] | 
            
  | 07:28 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Fully repool db1131', diff saved to https://phabricator.wikimedia.org/P11922 and previous config saved to /var/cache/conftool/dbconfig/20200716-072838-marostegui.json | [production] | 
            
  | 07:25 | <marostegui> | Drop database reviewdb-test T255715 | [production] | 
            
  | 07:03 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool db1131', diff saved to https://phabricator.wikimedia.org/P11921 and previous config saved to /var/cache/conftool/dbconfig/20200716-070331-marostegui.json | [production] | 
            
  | 06:40 | <XioNoX> | remove peering with AS8403 in eqsin (peer left the IX) | [production] | 
            
  | 05:13 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool db1131', diff saved to https://phabricator.wikimedia.org/P11920 and previous config saved to /var/cache/conftool/dbconfig/20200716-051342-marostegui.json | [production] | 
            
  | 05:11 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool db1131', diff saved to https://phabricator.wikimedia.org/P11919 and previous config saved to /var/cache/conftool/dbconfig/20200716-051109-marostegui.json | [production] | 
            
  
    | 2020-07-15
      
      § | 
    
  | 23:54 | <eileen> | tools revision changed from 7b6018a16e to 711d671600 | [production] | 
            
  | 23:50 | <eileen> | process-control config revision is 1fc4a9686d | [production] | 
            
  | 23:21 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) | [production] | 
            
  | 23:04 | <bd808> | tools.admin Removed valhallasw from maintainers (T255697) | [production] | 
            
  | 23:02 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) | [production] | 
            
  | 22:58 | <dzahn@cumin1001> | START - Cookbook sre.ganeti.makevm | [production] | 
            
  | 22:52 | <dzahn@cumin1001> | START - Cookbook sre.ganeti.makevm | [production] | 
            
  | 22:52 | <dzahn@cumin1001> | END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) | [production] | 
            
  | 22:52 | <dzahn@cumin1001> | START - Cookbook sre.ganeti.makevm | [production] | 
            
  | 22:30 | <akosiaris@deploy1001> | helmfile [EQIAD] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . | [production] | 
            
  | 22:30 | <akosiaris@deploy1001> | helmfile [EQIAD] Ran 'sync' command on namespace 'mobileapps' for release 'production' . | [production] | 
            
  | 22:29 | <akosiaris@deploy1001> | helmfile [CODFW] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . | [production] | 
            
  | 22:29 | <akosiaris@deploy1001> | helmfile [CODFW] Ran 'sync' command on namespace 'mobileapps' for release 'production' . | [production] | 
            
  | 22:27 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . | [production] | 
            
  | 22:21 | <akosiaris@deploy1001> | helmfile [EQIAD] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . | [production] |