2020-01-02
§
|
10:40 |
<dcausse> |
created missing elastic indices: T241487 |
[deployment-prep] |
10:37 |
<arturo> |
increase MEM quota T241716 |
[etytree] |
09:58 |
<filippo@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
09:58 |
<filippo@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
08:58 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db2076 T241647', diff saved to https://phabricator.wikimedia.org/P10021 and previous config saved to /var/cache/conftool/dbconfig/20200102-085806-marostegui.json |
[production] |
08:35 |
<marostegui> |
Upgrade db2090 |
[production] |
08:26 |
<marostegui> |
Upgrade db2075 |
[production] |
08:10 |
<marostegui> |
Deploy schema change on officewiki.flow_wiki_ref on s3 master (db1123) T241387 |
[production] |
07:49 |
<marostegui> |
Deploy schema change on techconductwiki.flow_wiki_ref (empty table) on s3 master (db1123) T241387 |
[production] |
07:26 |
<marostegui> |
Upgrade db2079 |
[production] |
07:18 |
<marostegui> |
Deploy schema change on labswiki.flow_wiki_ref (empty table) T241387 |
[production] |
06:46 |
<marostegui> |
Deploy schema change on db2131 - T241387 |
[production] |
06:44 |
<marostegui> |
Repool labsdb1009 |
[production] |
06:30 |
<marostegui> |
Upgrade labsdb1009 |
[production] |
06:29 |
<marostegui> |
Remove revision partitions from db2087:3316 T239453 |
[production] |
06:26 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db2087:3316 - T239453', diff saved to https://phabricator.wikimedia.org/P10020 and previous config saved to /var/cache/conftool/dbconfig/20200102-062650-marostegui.json |
[production] |
06:22 |
<marostegui> |
Depool labsdb1009 |
[production] |
02:06 |
<andrewbogott> |
moving cyberbot-db-01 to cloudvirt1024 |
[cyberbot] |
01:55 |
<Krenair> |
Resetting repo in public_html from ef1ea17a4d1d2bc0adbcce6032a768f91b53ec40 to 8d755d36a9e5e023c690c47be7bf10bd5422f00 to attempt to drop broken automatic local commits to constants/capitalization.php - it looks like the automatic system is being removed in the upstream repo anyway |
[tools.citations] |
00:49 |
<Krenair> |
Started webservice that was not running per request from Josve05a and discussion at https://en.wikipedia.org/wiki/User_talk:Citation_bot#Bot_down |
[tools.citations] |
00:22 |
<ejegg> |
re-enabled fundraising cron jobs |
[production] |
2020-01-01
§
|
21:13 |
<ejegg> |
stopped fundraising cron jobs to calculate EOY summaries |
[production] |
20:58 |
<bd808> |
Deleting project per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#SHUTDOWN_social-tools |
[social-tools] |
20:55 |
<bd808> |
Deleting instances per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#SHUTDOWN_social-tools (T236539) |
[social-tools] |
20:50 |
<bd808> |
Deleting jessie instances per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#In_use_community-labs-monitoring (T236543) |
[community-labs-monitoring] |
20:28 |
<bd808> |
Deleted project per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#SHUTDOWN_hat-imagescalers |
[hat-imagescalers] |
20:25 |
<bd808> |
Deleted shutdown instance (T236566) |
[hat-imagescalers] |
20:23 |
<bd808> |
Deleted project per https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#SHUTDOWN_etcd |
[etcd] |
20:17 |
<bd808> |
Deleteing shutdown instances (T236573) |
[etcd] |
15:34 |
<Zppix> |
add RhinosF1 as a maintainer |
[tools.zppixbot] |
06:47 |
<zhuyifei1999_> |
Deployed 3076232 on quarry-web-01 T147711 |
[quarry] |
06:06 |
<zhuyifei1999_> |
Deployed d7ddab8 on quarry-web-01 T147711 |
[quarry] |
05:58 |
<zhuyifei1999_> |
Deployed cd69638 on quarry-web-01 T147711 |
[quarry] |
04:57 |
<andrewbogott> |
depooling labweb1002 so I can hotfix labweb1001 for T240734 |
[production] |
2019-12-31
§
|
16:57 |
<arturo> |
import more openstack packages into reprepro (T241347) thirdparty/openstack-pike-stretch |
[production] |
16:25 |
<elukey> |
re-run webrequest_load 2019/12/30-15 due to (hopefully) temp hive/kerb issues |
[analytics] |
15:25 |
<valhallasw`cloud> |
Tried to restart wb2-phab, but now getting an asyncio AttributeError: 'NoneType' object has no attribute 'call_exception_handler' |
[tools.wikibugs] |
15:22 |
<valhallasw`cloud> |
temporarily deployed https://gerrit.wikimedia.org/r/#/c/labs/tools/wikibugs2/+/561294/ while waiting for review |
[tools.wikibugs] |
12:35 |
<andrewbogott> |
deleting project as per T212657 |
[qna] |
11:48 |
<marostegui> |
Upgrade db2119 and db2106 |
[production] |
11:46 |
<andrewbogott> |
I couldn't! |
[admin] |
11:39 |
<andrewbogott> |
restarting cloudservices2002-dev to see if I can reproduce an issue I saw earlier |
[admin] |
11:35 |
<marostegui> |
Upgrade db2073 |
[production] |
10:49 |
<marostegui> |
Upgrade db1108 with elukey |
[production] |
10:34 |
<marostegui> |
Upgrade db2111 and db2123 |
[production] |
10:23 |
<elukey> |
execute 'clear bfd session address fe80::5e5e:ab00:d3d:85ce' on cr3-knams - T240659 |
[production] |
08:25 |
<marostegui> |
Upgrade db2128 |
[production] |
08:24 |
<marostegui> |
Upgrade db1107 from 10.4.10 to 10.4.11 |
[production] |
07:46 |
<marostegui> |
Upgrade db2126 db2125 db2108 db2107 |
[production] |
07:11 |
<marostegui> |
Restart wikibugs - T241109 |
[production] |