| 2020-07-16
      
      § | 
    
  | 08:15 | <moritzm> | installing python-urllib3 security updates | [production] | 
            
  | 08:15 | <XioNoX> | remove PIM config from eqord/eqdfw/knams routers - T257573 | [production] | 
            
  | 08:14 | <XioNoX> | remove PIM config from eqiad routers - T257573 | [production] | 
            
  | 08:11 | <XioNoX> | remove PIM config from esams routers - T257573 | [production] | 
            
  | 08:09 | <XioNoX> | remove PIM config from eqsin routers - T257573 | [production] | 
            
  | 08:08 | <jbond42> | update mail delivery for phabricator to use phabricator.discovery.wmnet cname | [production] | 
            
  | 08:07 | <XioNoX> | remove PIM config from codfw routers - T257573 | [production] | 
            
  | 08:06 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db2081', diff saved to https://phabricator.wikimedia.org/P11923 and previous config saved to /var/cache/conftool/dbconfig/20200716-080613-marostegui.json | [production] | 
            
  | 08:03 | <XioNoX> | remove PIM config from ulsfo routers - T257573 | [production] | 
            
  | 07:41 | <jayme> | imported envoyproxy_1.14.4-1 to stretch-wikimedia | [production] | 
            
  | 07:31 | <jayme> | imported envoyproxy_1.14.4-1 to buster-wikimedia | [production] | 
            
  | 07:28 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Fully repool db1131', diff saved to https://phabricator.wikimedia.org/P11922 and previous config saved to /var/cache/conftool/dbconfig/20200716-072838-marostegui.json | [production] | 
            
  | 07:25 | <marostegui> | Drop database reviewdb-test T255715 | [production] | 
            
  | 07:03 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool db1131', diff saved to https://phabricator.wikimedia.org/P11921 and previous config saved to /var/cache/conftool/dbconfig/20200716-070331-marostegui.json | [production] | 
            
  | 06:40 | <XioNoX> | remove peering with AS8403 in eqsin (peer left the IX) | [production] | 
            
  | 05:13 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool db1131', diff saved to https://phabricator.wikimedia.org/P11920 and previous config saved to /var/cache/conftool/dbconfig/20200716-051342-marostegui.json | [production] | 
            
  | 05:11 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Slowly repool db1131', diff saved to https://phabricator.wikimedia.org/P11919 and previous config saved to /var/cache/conftool/dbconfig/20200716-051109-marostegui.json | [production] | 
            
  
    | 2020-07-15
      
      § | 
    
  | 23:54 | <eileen> | tools revision changed from 7b6018a16e to 711d671600 | [production] | 
            
  | 23:50 | <eileen> | process-control config revision is 1fc4a9686d | [production] | 
            
  | 23:21 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) | [production] | 
            
  | 23:04 | <bd808> | tools.admin Removed valhallasw from maintainers (T255697) | [production] | 
            
  | 23:02 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) | [production] | 
            
  | 22:58 | <dzahn@cumin1001> | START - Cookbook sre.ganeti.makevm | [production] | 
            
  | 22:52 | <dzahn@cumin1001> | START - Cookbook sre.ganeti.makevm | [production] | 
            
  | 22:52 | <dzahn@cumin1001> | END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) | [production] | 
            
  | 22:52 | <dzahn@cumin1001> | START - Cookbook sre.ganeti.makevm | [production] | 
            
  | 22:30 | <akosiaris@deploy1001> | helmfile [EQIAD] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . | [production] | 
            
  | 22:30 | <akosiaris@deploy1001> | helmfile [EQIAD] Ran 'sync' command on namespace 'mobileapps' for release 'production' . | [production] | 
            
  | 22:29 | <akosiaris@deploy1001> | helmfile [CODFW] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . | [production] | 
            
  | 22:29 | <akosiaris@deploy1001> | helmfile [CODFW] Ran 'sync' command on namespace 'mobileapps' for release 'production' . | [production] | 
            
  | 22:27 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . | [production] | 
            
  | 22:21 | <akosiaris@deploy1001> | helmfile [EQIAD] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . | [production] | 
            
  | 22:21 | <akosiaris@deploy1001> | helmfile [EQIAD] Ran 'sync' command on namespace 'mobileapps' for release 'production' . | [production] | 
            
  | 22:10 | <akosiaris@deploy1001> | helmfile [STAGING] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . | [production] | 
            
  | 18:16 | <brennen> | restarting jenkins for upgrade | [production] | 
            
  | 18:00 | <mutante> | DNS - new language 'avk' has been added - This language is called Kotava and is "a proposed international auxiliary language (IAL) that focuses especially on the principle of cultural neutrality". Learn more at https://en.wikipedia.org/wiki/Kotava | [production] | 
            
  | 17:32 | <mutante> | puppetmaster - revoking cert for planet.discovery.wmnet, add planet.wikimedia.org, remove planet.svc records, remove specific and outdated hostnames (T257840) | [production] | 
            
  | 16:11 | <moritzm> | uploaded jenkins 2.235.2 to thirdparty/ci for stretch/buster T257614 | [production] | 
            
  | 15:29 | <jmm@cumin2001> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) | [production] | 
            
  | 15:24 | <jmm@cumin2001> | START - Cookbook sre.hosts.reboot-single | [production] | 
            
  | 15:24 | <jmm@cumin2001> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) | [production] | 
            
  | 15:20 | <jmm@cumin2001> | START - Cookbook sre.hosts.reboot-single | [production] | 
            
  | 15:20 | <moritzm> | rebooting webperf* hosts for kernel update | [production] | 
            
  | 14:58 | <addshore@deploy1001> | Synchronized php-1.35.0-wmf.41/extensions/Wikibase/repo: [[gerrit:612723]] Stop checking if WikibaseLib is loaded T258062 (already on mwmaint1002) (duration: 01m 08s) | [production] | 
            
  | 14:51 | <addshore> | pulled https://gerrit.wikimedia.org/r/612723 onto mwmaint 1002 ahead of syncing everywhere (and CI finishing) | [production] | 
            
  | 14:36 | <ema> | A:cp: upgrade purged to 0.17 T257573 | [production] | 
            
  | 14:30 | <ema> | upload purged 0.17 to buster-wikimedia T257573 | [production] | 
            
  | 14:28 | <jforrester@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Add exceptional wikitech VE/Parsoid config T241961 (duration: 01m 04s) | [production] | 
            
  | 14:26 | <jforrester@deploy1001> | Synchronized wmf-config/CommonSettings.php: Add exceptional wikitech VE/Parsoid config T241961 (duration: 01m 05s) | [production] | 
            
  | 14:25 | <gehel> | repooling wdqs1006 - catched up on lag | [production] |