| 
      
        2019-12-23
      
      §
     | 
  
    
  | 18:54 | 
  <chaomodus> | 
  Deleting mgmt IP addresses from Netbox that are connected to offline devices. T228387 | 
  [production] | 
            
  | 15:57 | 
  <papaul> | 
  shut down ms-fe2007 for NIC replacement | 
  [production] | 
            
  | 15:10 | 
  <fdans@deploy1001> | 
  Finished deploy [analytics/refinery@531752b]: deploying refinery (duration: 08m 09s) | 
  [production] | 
            
  | 15:02 | 
  <fdans@deploy1001> | 
  Started deploy [analytics/refinery@531752b]: deploying refinery | 
  [production] | 
            
  | 15:00 | 
  <jynus@cumin1001> | 
  dbctl commit (dc=all): 'Reducing db1126 main s8 weight, seems flapping', diff saved to https://phabricator.wikimedia.org/P10012 and previous config saved to /var/cache/conftool/dbconfig/20191223-150052-jynus.json | 
  [production] | 
            
  | 13:42 | 
  <moritzm> | 
  installing cpio security updates on jessie | 
  [production] | 
            
  | 13:31 | 
  <moritzm> | 
  installing NSS security updates on jessie | 
  [production] | 
            
  | 13:23 | 
  <moritzm> | 
  installing libvorbis security updates | 
  [production] | 
            
  | 13:01 | 
  <moritzm> | 
  uploaded libvpx 1.7.0-3+wmf2 to component/vp9 | 
  [production] | 
            
  | 11:06 | 
  <jmm@cumin1001> | 
  END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) | 
  [production] | 
            
  | 11:05 | 
  <jmm@cumin1001> | 
  START - Cookbook sre.hosts.decommission | 
  [production] | 
            
  | 11:05 | 
  <arturo> | 
  import python-pyasn1 0.4.2-3~bpo9+1~wmf1 into stretch-wikimedia/component/python-ldap-bpo (T229227) | 
  [production] | 
            
  | 11:04 | 
  <moritzm> | 
  removing dubnium in ganeti T224557 | 
  [production] | 
            
  | 10:47 | 
  <arturo> | 
  import python-ldap 3.1.0-2~bpo9+1~wmf1 into stretch-wikimedia/component/python-ldap-bpo (T229227) | 
  [production] | 
            
  | 10:06 | 
  <moritzm> | 
  removing elastic1019 from puppetdb T239821 | 
  [production] | 
            
  | 09:17 | 
  <_joe_> | 
  running docker-report for base images, as a test, on boron | 
  [production] | 
            
  | 09:11 | 
  <ema@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: name=cp2023.codfw.wmnet,service=ats-be | 
  [production] | 
            
  | 09:10 | 
  <ema> | 
  cp2023: wipe ats-be cache and repool after normalize-path.lua experiment T241232 | 
  [production] | 
            
  | 08:58 | 
  <moritzm> | 
  restarting slapd on serpens/seaborgium to pick up SASL security update | 
  [production] | 
            
  | 08:50 | 
  <moritzm> | 
  restarting slapd on LDAP replicas to pick up SASL security update | 
  [production] | 
            
  | 08:31 | 
  <ema@puppetmaster1001> | 
  conftool action : set/pooled=no; selector: name=cp2023.codfw.wmnet,service=ats-be | 
  [production] | 
            
  | 08:31 | 
  <ema> | 
  cp2023: depool ats-be for Lua path normalization experiment T241232 | 
  [production] | 
            
  | 08:17 | 
  <moritzm> | 
  installing cyrus-sasl2 security updates | 
  [production] | 
            
  
    | 
      
        2019-12-21
      
      §
     | 
  
    
  | 23:40 | 
  <bd808> | 
  Testing Mastodon logging of SAL messages (T52109) | 
  [production] | 
            
  | 23:12 | 
  <volans> | 
  powercycle cp3055 - T240425 | 
  [production] | 
            
  | 22:45 | 
  <volans> | 
  powercycle cp3051 - T241306 | 
  [production] | 
            
  | 13:39 | 
  <Amir1> | 
  ladsgroup@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildPropertyTerms.php --wiki=testwikidatawiki --sleep 2 --batch-size=50 (T241209) | 
  [production] | 
            
  | 04:01 | 
  <mutante> | 
  LDAP - added ifried to wmf (T240988) for Turnilo / Superset access | 
  [production] | 
            
  | 01:44 | 
  <reedy@deploy1001> | 
  update-interwiki-cache aborted: Update interwiki cache (duration: 00m 07s) | 
  [production] | 
            
  | 01:39 | 
  <reedy@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: T188369 (duration: 00m 53s) | 
  [production] | 
            
  | 01:05 | 
  <volker-e@deploy1001> | 
  Finished deploy [design/style-guide@b61669a]: Deploy design/style-guide:  (duration: 00m 07s) | 
  [production] | 
            
  | 01:05 | 
  <volker-e@deploy1001> | 
  Started deploy [design/style-guide@b61669a]: Deploy design/style-guide: | 
  [production] | 
            
  
    | 
      
        2019-12-20
      
      §
     | 
  
    
  | 23:10 | 
  <Amir1> | 
  ladsgroup@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildItemTerms.php --wiki=testwikidatawiki --sleep 2 --batch-size=10 (T241209) | 
  [production] | 
            
  | 23:05 | 
  <ebernhardson@deploy1001> | 
  Finished deploy [search/mjolnir/deploy@8373b0d]: Correct upload metadata usage (duration: 06m 41s) | 
  [production] | 
            
  | 22:59 | 
  <ebernhardson@deploy1001> | 
  Started deploy [search/mjolnir/deploy@8373b0d]: Correct upload metadata usage | 
  [production] | 
            
  | 22:52 | 
  <ebernhardson@deploy1001> | 
  Finished deploy [search/mjolnir/deploy@d99bebf]: force utf-8 encoding when not detected (duration: 05m 22s) | 
  [production] | 
            
  | 22:47 | 
  <ebernhardson@deploy1001> | 
  Started deploy [search/mjolnir/deploy@d99bebf]: force utf-8 encoding when not detected | 
  [production] | 
            
  | 21:58 | 
  <ebernhardson@deploy1001> | 
  Finished deploy [search/mjolnir/deploy@0ad64e7]: properly decode unicode on ltr model upload (duration: 06m 04s) | 
  [production] | 
            
  | 21:52 | 
  <ebernhardson@deploy1001> | 
  Started deploy [search/mjolnir/deploy@0ad64e7]: properly decode unicode on ltr model upload | 
  [production] | 
            
  | 18:44 | 
  <mholloway-shell@deploy1001> | 
  Synchronized php-1.35.0-wmf.11/extensions/WikimediaEditorTasks: Fix: Get RevisionRecord directly from the Revision in onPageContentSaveComplete (T241014) (duration: 00m 54s) | 
  [production] | 
            
  | 17:48 | 
  <ejegg> | 
  updated fundraising internal dashboard from b75f9074de to 852f6871cf | 
  [production] | 
            
  | 17:29 | 
  <bd808> | 
  Getting cloudweb2001-dev caught up with the MW train via a manual `scap pull` (T241251) | 
  [production] | 
            
  | 17:19 | 
  <volans> | 
  re-generating sre-bot ro-token for Netbox, accidentally leaked to gerrit, already revoked within a minute from leak | 
  [production] |