|
2023-03-28
§
|
| 07:01 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1179 (re)pooling @ 50%: Repooling', diff saved to https://phabricator.wikimedia.org/P45963 and previous config saved to /var/cache/conftool/dbconfig/20230328-070112-root.json |
[production] |
| 06:46 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1179 (re)pooling @ 25%: Repooling', diff saved to https://phabricator.wikimedia.org/P45962 and previous config saved to /var/cache/conftool/dbconfig/20230328-064607-root.json |
[production] |
| 06:31 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1179 (re)pooling @ 10%: Repooling', diff saved to https://phabricator.wikimedia.org/P45961 and previous config saved to /var/cache/conftool/dbconfig/20230328-063103-root.json |
[production] |
| 06:15 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1179 (re)pooling @ 5%: Repooling', diff saved to https://phabricator.wikimedia.org/P45960 and previous config saved to /var/cache/conftool/dbconfig/20230328-061558-root.json |
[production] |
| 06:14 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1104 T329481', diff saved to https://phabricator.wikimedia.org/P45959 and previous config saved to /var/cache/conftool/dbconfig/20230328-061441-root.json |
[production] |
| 06:00 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1179 (re)pooling @ 4%: Repooling', diff saved to https://phabricator.wikimedia.org/P45958 and previous config saved to /var/cache/conftool/dbconfig/20230328-060053-root.json |
[production] |
| 05:55 |
<oblivian@deploy2002> |
helmfile [codfw] DONE helmfile.d/services/mw-debug: apply |
[production] |
| 05:55 |
<oblivian@deploy2002> |
helmfile [codfw] START helmfile.d/services/mw-debug: apply |
[production] |
| 05:53 |
<oblivian@deploy2002> |
helmfile [eqiad] DONE helmfile.d/services/mw-debug: apply |
[production] |
| 05:53 |
<oblivian@deploy2002> |
helmfile [eqiad] START helmfile.d/services/mw-debug: apply |
[production] |
| 05:47 |
<AndyRussG> |
update payments-wiki f5e262d1 -> a6c6c2b1 |
[production] |
| 05:45 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1179 (re)pooling @ 3%: Repooling', diff saved to https://phabricator.wikimedia.org/P45957 and previous config saved to /var/cache/conftool/dbconfig/20230328-054548-root.json |
[production] |
| 05:30 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1179 (re)pooling @ 2%: Repooling', diff saved to https://phabricator.wikimedia.org/P45956 and previous config saved to /var/cache/conftool/dbconfig/20230328-053043-root.json |
[production] |
| 05:15 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1179 (re)pooling @ 1%: Repooling', diff saved to https://phabricator.wikimedia.org/P45955 and previous config saved to /var/cache/conftool/dbconfig/20230328-051539-root.json |
[production] |
| 01:59 |
<krinkle@deploy2002> |
Synchronized wmf-config/mc.php: I44edcd46da45b827d (duration: 06m 33s) |
[production] |
|
2023-03-27
§
|
| 23:47 |
<mutante> |
people1003 - taking down apache to provoke monitoring alert (inactive instances) and confirm IRC alerting change works |
[production] |
| 23:31 |
<zabe> |
deployed patch for T330968 |
[production] |
| 23:08 |
<zabe@deploy2002> |
Finished scap: Backport for [[gerrit:903205|Rename "Support and Safety" to "Trust and Safety" (T330514)]] (duration: 21m 27s) |
[production] |
| 23:00 |
<zabe@deploy2002> |
zabe: Backport for [[gerrit:903205|Rename "Support and Safety" to "Trust and Safety" (T330514)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet |
[production] |
| 22:48 |
<mutante> |
stat1005 - kill 18179; run puppet ; stat1007 - kill 3346; run puppet ; stat1006 - kill 23887 run puppet |
[production] |
| 22:47 |
<zabe@deploy2002> |
Started scap: Backport for [[gerrit:903205|Rename "Support and Safety" to "Trust and Safety" (T330514)]] |
[production] |
| 22:43 |
<mutante> |
stat1004 - kill 29291; run puppet |
[production] |
| 22:43 |
<mutante> |
apt2001 - kill 3105; run puppet |
[production] |
| 22:16 |
<zabe> |
zabe@mwmaint2002:~$ mwscript extensions/Translate/scripts/moveTranslatableBundle.php --wiki metawiki "Meta:WMF Support and Safety" "Meta:WMF Trust and Safety" "Zabe" --reason "per [[:phab:T330514|T330514]]" # T330514 |
[production] |
| 21:58 |
<maryum> |
Deploy security fix for T326952 |
[production] |
| 21:58 |
<urandom> |
power cycling restbase1033 — T333243 |
[production] |
| 21:45 |
<ryankemper> |
T330165 Depooled relevant search platform hosts: `sudo -E cumin 'elastic[1055-1056,1074-1079,1085-1086]*,cloudelastic100[2,6]*,wcqs1002*,wdqs[1007,1012]*' 'sudo depool'` |
[production] |
| 21:24 |
<Amir1> |
start of watchlist clean up in arwiki (T328501) |
[production] |
| 21:23 |
<kindrobot> |
finish UTC late backports |
[production] |
| 21:22 |
<kindrobot@deploy2002> |
Finished scap: Backport for [[gerrit:903326|Disable VisualEditor from talk namespace]], [[gerrit:903323|[sysop_itwiki] Add the logo also for vector 2022 (T330279)]] (duration: 08m 26s) |
[production] |
| 21:15 |
<kindrobot@deploy2002> |
kindrobot and superpes: Backport for [[gerrit:903326|Disable VisualEditor from talk namespace]], [[gerrit:903323|[sysop_itwiki] Add the logo also for vector 2022 (T330279)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet |
[production] |
| 21:15 |
<htriedman@deploy2002> |
Finished deploy [airflow-dags/platform_eng@5f0eb44]: (no justification provided) (duration: 00m 13s) |
[production] |
| 21:14 |
<htriedman@deploy2002> |
Started deploy [airflow-dags/platform_eng@5f0eb44]: (no justification provided) |
[production] |
| 21:14 |
<kindrobot@deploy2002> |
Started scap: Backport for [[gerrit:903326|Disable VisualEditor from talk namespace]], [[gerrit:903323|[sysop_itwiki] Add the logo also for vector 2022 (T330279)]] |
[production] |
| 21:11 |
<tzatziki> |
moving Universal Code of Conduct/Enforcement guidelines -> Universal Code of Conduct/Enforcement guidelines/Version 1 on metawiki with `extensions/Translate/scripts/moveTranslatableBundle.php ` |
[production] |
| 20:45 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts cloudvirt1022.eqiad.wmnet |
[production] |
| 20:45 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 20:45 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudvirt1022.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1001" |
[production] |
| 20:43 |
<andrew@cumin1001> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudvirt1022.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1001" |
[production] |
| 20:41 |
<andrew@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 20:36 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.decommission for hosts cloudvirt1022.eqiad.wmnet |
[production] |
| 20:35 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts cloudvirt1021.eqiad.wmnet |
[production] |
| 20:35 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 20:35 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudvirt1021.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1001" |
[production] |
| 20:33 |
<andrew@cumin1001> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudvirt1021.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1001" |
[production] |
| 20:31 |
<andrew@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 20:25 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.decommission for hosts cloudvirt1021.eqiad.wmnet |
[production] |
| 20:25 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts cloudvirt1017.eqiad.wmnet |
[production] |
| 20:25 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 20:25 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudvirt1017.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1001" |
[production] |