| 2019-12-23
      
      § | 
    
  | 15:10 | <fdans@deploy1001> | Finished deploy [analytics/refinery@531752b]: deploying refinery (duration: 08m 09s) | [production] | 
            
  | 15:02 | <fdans@deploy1001> | Started deploy [analytics/refinery@531752b]: deploying refinery | [production] | 
            
  | 15:00 | <jynus@cumin1001> | dbctl commit (dc=all): 'Reducing db1126 main s8 weight, seems flapping', diff saved to https://phabricator.wikimedia.org/P10012 and previous config saved to /var/cache/conftool/dbconfig/20191223-150052-jynus.json | [production] | 
            
  | 13:42 | <moritzm> | installing cpio security updates on jessie | [production] | 
            
  | 13:31 | <moritzm> | installing NSS security updates on jessie | [production] | 
            
  | 13:23 | <moritzm> | installing libvorbis security updates | [production] | 
            
  | 13:01 | <moritzm> | uploaded libvpx 1.7.0-3+wmf2 to component/vp9 | [production] | 
            
  | 11:06 | <jmm@cumin1001> | END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) | [production] | 
            
  | 11:05 | <jmm@cumin1001> | START - Cookbook sre.hosts.decommission | [production] | 
            
  | 11:05 | <arturo> | import python-pyasn1 0.4.2-3~bpo9+1~wmf1 into stretch-wikimedia/component/python-ldap-bpo (T229227) | [production] | 
            
  | 11:04 | <moritzm> | removing dubnium in ganeti T224557 | [production] | 
            
  | 10:47 | <arturo> | import python-ldap 3.1.0-2~bpo9+1~wmf1 into stretch-wikimedia/component/python-ldap-bpo (T229227) | [production] | 
            
  | 10:06 | <moritzm> | removing elastic1019 from puppetdb T239821 | [production] | 
            
  | 09:17 | <_joe_> | running docker-report for base images, as a test, on boron | [production] | 
            
  | 09:11 | <ema@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=cp2023.codfw.wmnet,service=ats-be | [production] | 
            
  | 09:10 | <ema> | cp2023: wipe ats-be cache and repool after normalize-path.lua experiment T241232 | [production] | 
            
  | 08:58 | <moritzm> | restarting slapd on serpens/seaborgium to pick up SASL security update | [production] | 
            
  | 08:50 | <moritzm> | restarting slapd on LDAP replicas to pick up SASL security update | [production] | 
            
  | 08:31 | <ema@puppetmaster1001> | conftool action : set/pooled=no; selector: name=cp2023.codfw.wmnet,service=ats-be | [production] | 
            
  | 08:31 | <ema> | cp2023: depool ats-be for Lua path normalization experiment T241232 | [production] | 
            
  | 08:17 | <moritzm> | installing cyrus-sasl2 security updates | [production] | 
            
  
    | 2019-12-21
      
      § | 
    
  | 23:40 | <bd808> | Testing Mastodon logging of SAL messages (T52109) | [production] | 
            
  | 23:12 | <volans> | powercycle cp3055 - T240425 | [production] | 
            
  | 22:45 | <volans> | powercycle cp3051 - T241306 | [production] | 
            
  | 13:39 | <Amir1> | ladsgroup@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildPropertyTerms.php --wiki=testwikidatawiki --sleep 2 --batch-size=50 (T241209) | [production] | 
            
  | 04:01 | <mutante> | LDAP - added ifried to wmf (T240988) for Turnilo / Superset access | [production] | 
            
  | 01:44 | <reedy@deploy1001> | update-interwiki-cache aborted: Update interwiki cache (duration: 00m 07s) | [production] | 
            
  | 01:39 | <reedy@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: T188369 (duration: 00m 53s) | [production] | 
            
  | 01:05 | <volker-e@deploy1001> | Finished deploy [design/style-guide@b61669a]: Deploy design/style-guide:  (duration: 00m 07s) | [production] | 
            
  | 01:05 | <volker-e@deploy1001> | Started deploy [design/style-guide@b61669a]: Deploy design/style-guide: | [production] | 
            
  
    | 2019-12-20
      
      § | 
    
  | 23:10 | <Amir1> | ladsgroup@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildItemTerms.php --wiki=testwikidatawiki --sleep 2 --batch-size=10 (T241209) | [production] | 
            
  | 23:05 | <ebernhardson@deploy1001> | Finished deploy [search/mjolnir/deploy@8373b0d]: Correct upload metadata usage (duration: 06m 41s) | [production] | 
            
  | 22:59 | <ebernhardson@deploy1001> | Started deploy [search/mjolnir/deploy@8373b0d]: Correct upload metadata usage | [production] | 
            
  | 22:52 | <ebernhardson@deploy1001> | Finished deploy [search/mjolnir/deploy@d99bebf]: force utf-8 encoding when not detected (duration: 05m 22s) | [production] | 
            
  | 22:47 | <ebernhardson@deploy1001> | Started deploy [search/mjolnir/deploy@d99bebf]: force utf-8 encoding when not detected | [production] | 
            
  | 21:58 | <ebernhardson@deploy1001> | Finished deploy [search/mjolnir/deploy@0ad64e7]: properly decode unicode on ltr model upload (duration: 06m 04s) | [production] | 
            
  | 21:52 | <ebernhardson@deploy1001> | Started deploy [search/mjolnir/deploy@0ad64e7]: properly decode unicode on ltr model upload | [production] | 
            
  | 18:44 | <mholloway-shell@deploy1001> | Synchronized php-1.35.0-wmf.11/extensions/WikimediaEditorTasks: Fix: Get RevisionRecord directly from the Revision in onPageContentSaveComplete (T241014) (duration: 00m 54s) | [production] | 
            
  | 17:48 | <ejegg> | updated fundraising internal dashboard from b75f9074de to 852f6871cf | [production] | 
            
  | 17:29 | <bd808> | Getting cloudweb2001-dev caught up with the MW train via a manual `scap pull` (T241251) | [production] | 
            
  | 17:19 | <volans> | re-generating sre-bot ro-token for Netbox, accidentally leaked to gerrit, already revoked within a minute from leak | [production] | 
            
  | 16:28 | <cdanis> | ✔️ cdanis@cumin1001.eqiad.wmnet ~ 🕦☕ homer 'cr*' commit 'templatize BGP sessions with pmacct netflow collector cb096f509 0f56b2233 2e050ad33' | [production] | 
            
  | 16:27 | <krinkle@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Ia9190a4e5, T240691: Disable wgExtractsExtendOpenSearchXml (duration: 00m 55s) | [production] | 
            
  | 14:38 | <volans> | temporarily disable puppet on netbox[12]001 to deploy https://gerrit.wikimedia.org/r/c/operations/puppet/+/555715 - T233183 | [production] | 
            
  | 14:14 | <cdanis> | homer 'cr*esams*' commit 'I022c62120 enable netflow collection in esams' | [production] |