| 2021-05-20
      
      ยง | 
    
  | 18:24 | <hnowlan@deploy1002> | helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . | [production] | 
            
  | 17:49 | <cmjohnson@cumin1001> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 17:45 | <cmjohnson@cumin1001> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 17:35 | <cmjohnson@cumin1001> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 17:30 | <cmjohnson@cumin1001> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 17:30 | <cmjohnson@cumin1001> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 17:25 | <cmjohnson@cumin1001> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 17:16 | <cmjohnson@cumin1001> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 17:14 | <cmjohnson@cumin1001> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 17:12 | <cmjohnson@cumin1001> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 17:07 | <cmjohnson@cumin1001> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 16:27 | <godog> | upgrade grafana to 8 beta 2 on grafana2001 | [production] | 
            
  | 15:48 | <jiji@deploy1002> | helmfile [eqiad] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 15:46 | <jiji@deploy1002> | helmfile [eqiad] START helmfile.d/admin 'apply'. | [production] | 
            
  | 15:46 | <jiji@deploy1002> | helmfile [codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 15:44 | <jiji@deploy1002> | helmfile [codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 15:44 | <jiji@deploy1002> | helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 15:43 | <jiji@deploy1002> | helmfile [staging-eqiad] START helmfile.d/admin 'apply'. | [production] | 
            
  | 15:33 | <moritzm> | installing graphviz security updates on buster | [production] | 
            
  | 15:31 | <ryankemper> | [cloudelastic] `ryankemper@cloudelastic1003:~$ sudo systemctl restart *search*` to clear `Check systemd state` alert on `cloudelastic1003` | [production] | 
            
  | 15:30 | <_joe_> | test | [production] | 
            
  | 15:23 | <moritzm> | installing graphviz security updates on buster | [production] | 
            
  | 15:21 | <jiji@deploy1002> | helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 15:21 | <jiji@deploy1002> | helmfile [staging-codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 15:21 | <jiji@deploy1002> | helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 15:21 | <jiji@deploy1002> | helmfile [staging-codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 14:38 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1118', diff saved to https://phabricator.wikimedia.org/P16128 and previous config saved to /var/cache/conftool/dbconfig/20210520-143825-marostegui.json | [production] | 
            
  | 13:58 | <hashar@deploy1002> | Synchronized php: group1 wikis to 1.37.0-wmf.6 (duration: 01m 05s) | [production] | 
            
  | 13:57 | <hashar@deploy1002> | rebuilt and synchronized wikiversions files: group1 wikis to 1.37.0-wmf.6 | [production] | 
            
  | 13:52 | <hashar@deploy1002> | Synchronized php-1.37.0-wmf.6/includes/upload/UploadFromStash.php: UploadFromStash: convert default user from false to null - T283196 (duration: 01m 05s) | [production] | 
            
  | 13:50 | <hashar@deploy1002> | Synchronized php-1.37.0-wmf.6/includes/user/ActorStore.php: ActorStore: avoid throwing in case of invalid usernames T283167 (duration: 01m 05s) | [production] | 
            
  | 13:41 | <volans@deploy1002> | Finished deploy [debmonitor/deploy@444b931]: Release v0.3.0 (duration: 01m 20s) | [production] | 
            
  | 13:39 | <volans@deploy1002> | Started deploy [debmonitor/deploy@444b931]: Release v0.3.0 | [production] | 
            
  | 12:30 | <kormat> | Deploying wmfmariadbpy 0.7 T283228 | [production] | 
            
  | 11:35 | <marostegui@cumin1001> | dbctl commit (dc=all): 'db1112 (re)pooling @ 100%: Repool db1112', diff saved to https://phabricator.wikimedia.org/P16126 and previous config saved to /var/cache/conftool/dbconfig/20210520-113529-root.json | [production] | 
            
  | 11:20 | <marostegui@cumin1001> | dbctl commit (dc=all): 'db1112 (re)pooling @ 75%: Repool db1112', diff saved to https://phabricator.wikimedia.org/P16125 and previous config saved to /var/cache/conftool/dbconfig/20210520-112026-root.json | [production] | 
            
  | 11:05 | <marostegui@cumin1001> | dbctl commit (dc=all): 'db1112 (re)pooling @ 50%: Repool db1112', diff saved to https://phabricator.wikimedia.org/P16124 and previous config saved to /var/cache/conftool/dbconfig/20210520-110522-root.json | [production] | 
            
  | 10:50 | <marostegui@cumin1001> | dbctl commit (dc=all): 'db1112 (re)pooling @ 25%: Repool db1112', diff saved to https://phabricator.wikimedia.org/P16123 and previous config saved to /var/cache/conftool/dbconfig/20210520-105018-root.json | [production] | 
            
  | 10:15 | <marostegui> | Deploy schema change on s1 codfw, lag will appear in codfw T266486 T268392 T273360 | [production] | 
            
  | 10:10 | <jiji@deploy1002> | helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 10:10 | <jiji@deploy1002> | helmfile [staging-codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 09:35 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1112', diff saved to https://phabricator.wikimedia.org/P16122 and previous config saved to /var/cache/conftool/dbconfig/20210520-093510-marostegui.json | [production] | 
            
  | 09:32 | <marostegui@cumin1001> | dbctl commit (dc=all): 'db1179 (re)pooling @ 100%: Repool db1179', diff saved to https://phabricator.wikimedia.org/P16121 and previous config saved to /var/cache/conftool/dbconfig/20210520-093257-root.json | [production] | 
            
  | 09:17 | <marostegui@cumin1001> | dbctl commit (dc=all): 'db1179 (re)pooling @ 75%: Repool db1179', diff saved to https://phabricator.wikimedia.org/P16120 and previous config saved to /var/cache/conftool/dbconfig/20210520-091754-root.json | [production] | 
            
  | 09:02 | <marostegui@cumin1001> | dbctl commit (dc=all): 'db1179 (re)pooling @ 50%: Repool db1179', diff saved to https://phabricator.wikimedia.org/P16119 and previous config saved to /var/cache/conftool/dbconfig/20210520-090250-root.json | [production] | 
            
  | 08:56 | <godog> | move icinga-wm to libera.chat | [production] | 
            
  | 08:47 | <marostegui@cumin1001> | dbctl commit (dc=all): 'db1179 (re)pooling @ 25%: Repool db1179', diff saved to https://phabricator.wikimedia.org/P16118 and previous config saved to /var/cache/conftool/dbconfig/20210520-084746-root.json | [production] | 
            
  | 07:44 | <jiji@deploy1002> | helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 07:41 | <jiji@deploy1002> | helmfile [staging-codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 07:17 | <marostegui@cumin1001> | dbctl commit (dc=all): 'Depool db1179', diff saved to https://phabricator.wikimedia.org/P16117 and previous config saved to /var/cache/conftool/dbconfig/20210520-071723-marostegui.json | [production] |