151-200 of 10000 results (23ms)
2020-12-02 ยง
20:08 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
19:56 <mutante> sodium - systemctl restart update-tails-mirror.timer [production]
19:20 <mforns> restarted turnilo to clear deleted datasource [production]
19:17 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:643230|Add EventStream config for link recommendations (T261407)]] (duration: 01m 06s) [production]
18:22 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
18:20 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
18:20 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
18:20 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
18:00 <ladsgroup@deploy1001> Synchronized php-1.36.0-wmf.20/extensions/UrlShortener/includes/UrlShortenerUtils.php: [[gerrit:644879|Remove var_dump() left by mistake (duration: 01m 09s) [production]
17:58 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 24da542256f7c4cc955365ccd9739354f7162cc5: Add all subdomains of artsdatabanken.no to the wgCopyUploadsDomains allowlist for commonswiki (T267784) (duration: 01m 06s) [production]
17:53 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
17:53 <mutante> sodium - commenting "sync ubuntu mirror / sync tails mirror" cronjobs in the crontab of user 'mirror' after they were replaced by systemd timers by gerrit:636082 [production]
17:51 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
17:25 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes:weight=10; selector: dc=eqiad,cluster=maps,service=kartotherian,name=maps1010.eqiad.wmnet [production]
17:11 <effie> uploading scap 3.16.0-1 [production]
16:25 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
16:23 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
15:29 <moritzm> installing libproxy security updates on Buster [production]
15:27 <moritzm> restarting turnilo [production]
15:00 <hashar@deploy1001> rebuilt and synchronized wikiversions files: group0 wikis to 1.36.0-wmf.20 [production]
14:56 <hashar> Promoting group0 to 1.36.0-wmf.20 since I haven't done so yesterday :-\ # T263186 [production]
14:48 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Event Platform: Rename mw_session_tick stream to mediawiki.client.session_tick (duration: 01m 07s) [production]
14:19 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
14:17 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
14:12 <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux at mwmaint1002 (wiki=commonswiki; T246539) [production]
14:10 <Urbanecm> Start of mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log in a tmux at mwmaint1002 (wiki=ptwiki; T246539) [production]
14:07 <hashar@deploy1001> Synchronized php: group1 wikis to 1.36.0-wmf.20 (duration: 01m 18s) [production]
14:06 <hashar@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.36.0-wmf.20 [production]
13:11 <moritzm> installing brotli security updates [production]
13:07 <akosiaris@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'kube-system' for release 'eventrouter' . [production]
13:06 <akosiaris@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'kube-system' for release 'eventrouter' . [production]
13:06 <akosiaris@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'kube-system' for release 'eventrouter' . [production]
11:34 <XioNoX> add Lumen transit to cr3-ulsfo - T268691 [production]
11:16 <jayme> updated docker-report to 0.0.9-1 on chartmuseum* and deneb [production]
11:11 <jayme> imported docker-report 0.0.9-1 to buster-wikimedia [production]
10:23 <marostegui@cumin1001> dbctl commit (dc=all): 'db1106 (re)pooling @ 100%: After cloning clouddb hosts', diff saved to https://phabricator.wikimedia.org/P13516 and previous config saved to /var/cache/conftool/dbconfig/20201202-102348-root.json [production]
10:08 <marostegui@cumin1001> dbctl commit (dc=all): 'db1106 (re)pooling @ 75%: After cloning clouddb hosts', diff saved to https://phabricator.wikimedia.org/P13515 and previous config saved to /var/cache/conftool/dbconfig/20201202-100845-root.json [production]
09:53 <marostegui@cumin1001> dbctl commit (dc=all): 'db1106 (re)pooling @ 50%: After cloning clouddb hosts', diff saved to https://phabricator.wikimedia.org/P13513 and previous config saved to /var/cache/conftool/dbconfig/20201202-095341-root.json [production]
09:38 <marostegui@cumin1001> dbctl commit (dc=all): 'db1106 (re)pooling @ 25%: After cloning clouddb hosts', diff saved to https://phabricator.wikimedia.org/P13512 and previous config saved to /var/cache/conftool/dbconfig/20201202-093838-root.json [production]
08:55 <godog> swift eqiad-prod: add weight to ms-be106[0-3] - T268435 [production]
06:54 <marostegui> Remove es1017 from tendril and zarcillo T268825 [production]
06:32 <marostegui@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
06:22 <marostegui@cumin1001> START - Cookbook sre.hosts.decommission [production]
06:22 <marostegui@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) [production]
06:16 <marostegui@cumin1001> START - Cookbook sre.hosts.decommission [production]
05:46 <ryankemper@cumin1001> END (PASS) - Cookbook sre.wdqs.data-reload (exit_code=0) [production]
05:44 <ryankemper@cumin2001> END (PASS) - Cookbook sre.wdqs.data-reload (exit_code=0) [production]
05:44 <ryankemper@cumin2001> END (PASS) - Cookbook sre.wdqs.data-reload (exit_code=0) [production]
05:13 <ryankemper@cumin1001> END (PASS) - Cookbook sre.wdqs.data-reload (exit_code=0) [production]
04:34 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]