1401-1450 of 10000 results (44ms)
2021-05-20 §
05:13 <marostegui@cumin1001> START - Cookbook sre.hosts.decommission for hosts labsdb1011.eqiad.wmnet [production]
05:00 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1143', diff saved to https://phabricator.wikimedia.org/P16109 and previous config saved to /var/cache/conftool/dbconfig/20210520-050025-marostegui.json [production]
04:59 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1166', diff saved to https://phabricator.wikimedia.org/P16108 and previous config saved to /var/cache/conftool/dbconfig/20210520-045919-marostegui.json [production]
04:58 <marostegui@cumin1001> dbctl commit (dc=all): 'db1141 (re)pooling @ 25%: Repool db1141', diff saved to https://phabricator.wikimedia.org/P16107 and previous config saved to /var/cache/conftool/dbconfig/20210520-045852-root.json [production]
01:01 <mutante> signing puppet certs for doh2001 and doh2002.wikimedia.org (T283192) [production]
00:14 <ejegg> updated fundraising CiviCRM from b3fb3c9cb0 to 35f5afb1b4 [production]
00:13 <ejegg> updated payments-wiki from 9f51ace546 to 6fac77f60e [production]
2021-05-19 §
22:44 <Urbanecm> [urbanecm@mwmaint1002 ~/uploads]$ sleep 3600 && mwscript importImages.php --wiki=commonswiki --comment-ext=txt --sleep=7200 --user=Lusccasdeutsch . # T278856 # 3 video files [production]
22:29 <dzahn@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host doh2002.wikimedia.org [production]
22:27 <Urbanecm> Start server-side upload for 1 video file (T283186) [production]
22:25 <razzi@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
22:22 <Urbanecm> Start server-side upload for 3 video file (T283102, T283054) [production]
22:22 <razzi@cumin1001> START - Cookbook sre.dns.netbox [production]
22:21 <razzi@cumin1001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
22:18 <razzi@cumin1001> START - Cookbook sre.dns.netbox [production]
22:12 <urbanecm@deploy1002> Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 02m 14s) [production]
22:11 <dzahn@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host doh2001.wikimedia.org [production]
22:09 <urbanecm@deploy1002> update-interwiki-cache aborted: Update interwiki cache (duration: 00m 11s) [production]
22:07 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm for new host doh2002.wikimedia.org [production]
22:04 <dzahn@cumin1001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) for new host doh2002.wikimedia.org [production]
22:00 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm for new host doh2002.wikimedia.org [production]
21:58 <dzahn@cumin1001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) for new host doh2002.wikimedia.org [production]
21:56 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm for new host doh2002.wikimedia.org [production]
21:56 <dzahn@cumin1001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) for new host doh2002.wikimedia.org [production]
21:52 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm for new host doh2002.wikimedia.org [production]
21:51 <razzi@cumin1001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
21:50 <dzahn@cumin1001> START - Cookbook sre.ganeti.makevm for new host doh2001.wikimedia.org [production]
21:44 <razzi@cumin1001> START - Cookbook sre.dns.netbox [production]
20:08 <razzi@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db1125.eqiad.wmnet [production]
19:40 <razzi@cumin1001> START - Cookbook sre.hosts.decommission for hosts db1125.eqiad.wmnet [production]
18:30 <herron@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:23 <herron@cumin1001> START - Cookbook sre.dns.netbox [production]
18:23 <herron@cumin1001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
18:20 <hashar@deploy1002> rebuilt and synchronized wikiversions files: Revert group1 wikis to 1.37.0-wmf.6 T281147 [production]
18:17 <herron@cumin1001> START - Cookbook sre.dns.netbox [production]
16:13 <volans> uploaded debmonitor-client_0.3.0 to apt.wikimedia.org stretch-wikimedia,buster-wikimedia,bullseye-wikimedia [production]
15:48 <marostegui@cumin1001> dbctl commit (dc=all): 'db1157 (re)pooling @ 100%: Repool db1157', diff saved to https://phabricator.wikimedia.org/P16103 and previous config saved to /var/cache/conftool/dbconfig/20210519-154808-root.json [production]
15:33 <marostegui@cumin1001> dbctl commit (dc=all): 'db1157 (re)pooling @ 75%: Repool db1157', diff saved to https://phabricator.wikimedia.org/P16102 and previous config saved to /var/cache/conftool/dbconfig/20210519-153304-root.json [production]
15:18 <marostegui@cumin1001> dbctl commit (dc=all): 'db1157 (re)pooling @ 50%: Repool db1157', diff saved to https://phabricator.wikimedia.org/P16101 and previous config saved to /var/cache/conftool/dbconfig/20210519-151800-root.json [production]
15:02 <marostegui@cumin1001> dbctl commit (dc=all): 'db1157 (re)pooling @ 25%: Repool db1157', diff saved to https://phabricator.wikimedia.org/P16100 and previous config saved to /var/cache/conftool/dbconfig/20210519-150257-root.json [production]
13:33 <kormat> uploaded wmfmariadb 0.7 packages to apt [production]
13:29 <hashar@deploy1002> Synchronized php: group1 wikis to 1.37.0-wmf.6 (duration: 01m 05s) [production]
13:28 <hashar@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.37.0-wmf.6 [production]
13:19 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1157', diff saved to https://phabricator.wikimedia.org/P16099 and previous config saved to /var/cache/conftool/dbconfig/20210519-131920-marostegui.json [production]
13:10 <marostegui@cumin1001> dbctl commit (dc=all): 'db1175 (re)pooling @ 100%: Repool db1175', diff saved to https://phabricator.wikimedia.org/P16098 and previous config saved to /var/cache/conftool/dbconfig/20210519-131012-root.json [production]
12:55 <marostegui@cumin1001> dbctl commit (dc=all): 'db1175 (re)pooling @ 75%: Repool db1175', diff saved to https://phabricator.wikimedia.org/P16097 and previous config saved to /var/cache/conftool/dbconfig/20210519-125508-root.json [production]
12:40 <marostegui@cumin1001> dbctl commit (dc=all): 'db1175 (re)pooling @ 50%: Repool db1175', diff saved to https://phabricator.wikimedia.org/P16096 and previous config saved to /var/cache/conftool/dbconfig/20210519-124004-root.json [production]
12:25 <marostegui@cumin1001> dbctl commit (dc=all): 'db1175 (re)pooling @ 25%: Repool db1175', diff saved to https://phabricator.wikimedia.org/P16095 and previous config saved to /var/cache/conftool/dbconfig/20210519-122501-root.json [production]
11:45 <matthiasmullie> "EU backports done" [production]
11:42 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1175', diff saved to https://phabricator.wikimedia.org/P16093 and previous config saved to /var/cache/conftool/dbconfig/20210519-114203-marostegui.json [production]