| 2021-02-01
      
      ยง | 
    
  | 19:42 | <Urbanecm> | Morning B&C done | [production] | 
            
  | 19:41 | <urbanecm@deploy1001> | Synchronized php-1.36.0-wmf.28/extensions/GrowthExperiments/includes/Specials/SpecialHomepage.php: 1acaba4b3650dfb757d29af5395cc7660c839756: SpecialHomepage: Do not load start-startediting if SE arent enabled (T273243) (duration: 01m 05s) | [production] | 
            
  | 19:38 | <urbanecm@deploy1001> | Synchronized php-1.36.0-wmf.28/extensions/GrowthExperiments/includes/HomepageModules/Banner.php: d39746aa3ed07dfa9173a98d253c61771d5592a1: Banner module: Switch to using activated/unactivated for state (T273084) (duration: 01m 05s) | [production] | 
            
  | 19:23 | <mutante> | gerrit2001 - restarting gerrit (replica) | [production] | 
            
  | 19:14 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: 6360e7899b7dedc29941783b1cdf76df8db073d7: Enable DiscussionTools as a beta feature on 3 wikis per request (T258554; T265829; T273192) (duration: 01m 04s) | [production] | 
            
  | 19:11 | <urbanecm@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: a98f08f9582215e8f12f9e9c43f79a1f2fc21a2f: Enable DiscussionTools as a beta feature on wikis with language variants (T272639) (duration: 01m 07s) | [production] | 
            
  | 18:57 | <mutante> | restarting gerrit for change 660030 (no ticket) | [production] | 
            
  | 18:44 | <mutante> | new Wikimedia project language "mni" added - Meitei is a Sino-Tibetan language and the predominant language and lingua franca of the state of Manipur in northeastern India. | [production] | 
            
  | 18:03 | <mutante> | ping3001 - apt-get clean; apt-get autoremove; let it finish kernel upgrade; was out of disk | [production] | 
            
  | 17:59 | <mutante> | ping 2001 - apt-get clean; apt autoremove - was out of disk as well | [production] | 
            
  | 17:52 | <mutante> | ping1001 - apt-get clean gets back 447M - it was out of disk completely, now 84% usage | [production] | 
            
  | 17:34 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) | [production] | 
            
  | 17:29 | <pt1979@cumin2001> | END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) | [production] | 
            
  | 17:17 | <jbond@cumin2001> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host deneb.codfw.wmnet | [production] | 
            
  | 17:16 | <jbond@cumin1001> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install5001.wikimedia.org | [production] | 
            
  | 17:15 | <jbond@cumin2001> | START - Cookbook sre.hosts.reboot-single for host deneb.codfw.wmnet | [production] | 
            
  | 17:15 | <pt1979@cumin2001> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 17:14 | <jbond@cumin1001> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install4001.wikimedia.org | [production] | 
            
  | 17:14 | <mutante> | decom'ing francium.eqiad.wmnet, formerly HTML dumps server, replaced by htmldumper1001 | [production] | 
            
  | 17:13 | <jbond@cumin2001> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install2003.wikimedia.org | [production] | 
            
  | 17:12 | <dzahn@cumin1001> | START - Cookbook sre.hosts.decommission | [production] | 
            
  | 17:12 | <jbond@cumin2001> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install1003.wikimedia.org | [production] | 
            
  | 17:12 | <jbond@cumin1001> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install3001.wikimedia.org | [production] | 
            
  | 17:12 | <jbond@cumin1001> | START - Cookbook sre.hosts.reboot-single for host install5001.wikimedia.org | [production] | 
            
  | 17:10 | <jbond@cumin1001> | START - Cookbook sre.hosts.reboot-single for host install4001.wikimedia.org | [production] | 
            
  | 17:10 | <sukhe> | upload dnsdist_1.5.1-3wm1 to apt.wm.o (buster) - T252132 | [production] | 
            
  | 17:09 | <jbond@cumin1001> | START - Cookbook sre.hosts.reboot-single for host install3001.wikimedia.org | [production] | 
            
  | 17:09 | <jbond@cumin1001> | END (ERROR) - Cookbook sre.hosts.reboot-single (exit_code=97) for host install2003.wikimedia.org | [production] | 
            
  | 17:09 | <jbond@cumin1001> | START - Cookbook sre.hosts.reboot-single for host install2003.wikimedia.org | [production] | 
            
  | 17:08 | <jbond@cumin2001> | START - Cookbook sre.hosts.reboot-single for host install2003.wikimedia.org | [production] | 
            
  | 17:07 | <jbond@cumin2001> | START - Cookbook sre.hosts.reboot-single for host install1003.wikimedia.org | [production] | 
            
  | 17:06 | <jbond@cumin2001> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host apt1001.wikimedia.org | [production] | 
            
  | 17:03 | <jbond@cumin2001> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp1001.wikimedia.org | [production] | 
            
  | 17:01 | <jbond@cumin2001> | START - Cookbook sre.hosts.reboot-single for host idp1001.wikimedia.org | [production] | 
            
  | 17:01 | <jbond@cumin2001> | START - Cookbook sre.hosts.reboot-single for host apt1001.wikimedia.org | [production] | 
            
  | 16:53 | <jbond@cumin1001> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp-test2001.wikimedia.org | [production] | 
            
  | 16:52 | <jbond@cumin2001> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp2001.wikimedia.org | [production] | 
            
  | 16:50 | <jbond@cumin2001> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host apt2001.wikimedia.org | [production] | 
            
  | 16:46 | <jbond@cumin2001> | START - Cookbook sre.hosts.reboot-single for host idp2001.wikimedia.org | [production] | 
            
  | 16:46 | <jbond@cumin2001> | START - Cookbook sre.hosts.reboot-single for host apt2001.wikimedia.org | [production] | 
            
  | 16:44 | <jbond@cumin2001> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host pki1001.eqiad.wmnet | [production] | 
            
  | 16:44 | <jbond@cumin1001> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host pki2001.codfw.wmnet | [production] | 
            
  | 16:43 | <jbond@cumin2001> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp-test1001.wikimedia.org | [production] | 
            
  | 16:42 | <jbond42> | enable puppet fleet wide to post reboots | [production] | 
            
  | 16:35 | <jbond@cumin1001> | START - Cookbook sre.hosts.reboot-single for host idp-test2001.wikimedia.org | [production] | 
            
  | 16:35 | <jbond@cumin2001> | START - Cookbook sre.hosts.reboot-single for host idp-test1001.wikimedia.org | [production] | 
            
  | 16:34 | <jbond@cumin2001> | START - Cookbook sre.hosts.reboot-single for host pki1001.eqiad.wmnet | [production] | 
            
  | 16:34 | <jbond@cumin2001> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host puppetmaster2003.codfw.wmnet | [production] | 
            
  | 16:34 | <jbond@cumin1001> | START - Cookbook sre.hosts.reboot-single for host pki2001.codfw.wmnet | [production] | 
            
  | 16:33 | <jbond@cumin1001> | END (ERROR) - Cookbook sre.hosts.reboot-single (exit_code=97) for host puppetmaster2001.codfw.wmnet | [production] |