|
2020-03-02
ยง
|
| 21:31 |
<Urbanecm> |
Shut SULWatcher down for maintenance |
[tools.stewardbots] |
| 21:31 |
<Urbanecm> |
tools.stewardbots@tools-sgebastion-08:~$ rm -rf conf # T246702 |
[tools.stewardbots] |
| 21:29 |
<Urbanecm> |
tools.stewardbots@tools-sgebastion-08:~$ rm -rf data # empty folder |
[tools.stewardbots] |
| 21:18 |
<Urbanecm> |
Move several files to ~/00_backup; exact list at task (T246702) |
[tools.stewardbots] |
| 21:14 |
<Krenair> |
restarted php7.2-fpm on deployment-mediawiki-07 |
[releng] |
| 21:12 |
<Urbanecm> |
tools.stewardbots@tools-sgebastion-08:~$ rm -rf ~/StewardBot/ ~/SULWatcher/ (T246702) |
[tools.stewardbots] |
| 21:10 |
<XioNoX> |
re-number AMS-IX peer 64271 |
[production] |
| 21:06 |
<Urbanecm> |
Move ~/public_html to ~/stewardbots and symlink ~/public_html to ~/stewardbots (T246702) |
[tools.stewardbots] |
| 20:47 |
<Urbanecm> |
Undo, now pushed to gerrit ready to review |
[tools.stewardbots] |
| 20:32 |
<Urbanecm> |
Adding uncommited live hacks to /hat-web-tool/delete.php to make it work |
[tools.stewardbots] |
| 20:22 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings-labs.php: Enable Mediawiki client side error logging on group0 wikis - T246030 (duration: 00m 57s) |
[production] |
| 20:12 |
<krinkle@deploy1001> |
Synchronized multiversion/MWConfigCacheGenerator.php: I1ef0589 (duration: 00m 58s) |
[production] |
| 20:01 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings-labs.php: Enable Mediawiki client side error logging in beta - T246030 (duration: 00m 56s) |
[production] |
| 19:58 |
<joal> |
Remove faulty _REFINED file at /wmf/data/event/mediawiki_revision_score/datacenter=eqiad/year=2020/month=3/day=2/hour=10/_REFINED |
[analytics] |
| 19:38 |
<Urbanecm> |
tools.stewardbots@tools-sgebastion-08:~$ rm ~/tuttiidb.sql # empty file |
[tools.stewardbots] |
| 19:37 |
<Urbanecm> |
tools.stewardbots@tools-sgebastion-08:~$ rm backup_tutti_i_db.sql # empty file |
[tools.stewardbots] |
| 19:35 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: EventStreamConfig - allow eventgate-analytics-external to produce error events - T233629 (duration: 00m 56s) |
[production] |
| 19:33 |
<Urbanecm> |
Make ~/StewardBot/restart_stewardbot.sh use the correct values (add public_html to the path) |
[tools.stewardbots] |
| 19:30 |
<Urbanecm> |
tools.stewardbots@tools-sgebastion-07:~$ rm ~/core |
[tools.stewardbots] |
| 19:26 |
<Urbanecm> |
tools.stewardbots@tools-sgebastion-07:~$ mv git git.bak |
[tools.stewardbots] |
| 19:26 |
<Urbanecm> |
Use Py3 venv in ~/bigbrother.sh |
[tools.stewardbots] |
| 19:24 |
<Urbanecm> |
Start sulwatchers from public_html rather than from non-gity folder |
[tools.stewardbots] |
| 19:20 |
<Urbanecm> |
Kill sulwatcher temporarily to test something |
[tools.stewardbots] |
| 19:17 |
<ppchelko@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Enable REST run jobs endpoint on jobrunners T244770 (duration: 00m 56s) |
[production] |
| 19:15 |
<ppchelko@deploy1001> |
Synchronized wmf-config/CommonSettings-labs.php: Enable REST run jobs endpoint on jobrunners T244770 (duration: 00m 56s) |
[production] |
| 19:04 |
<otto@deploy1001> |
Synchronized wmf-config/ProductionServices.php: Use new LVS port for EventBus for eventgate-main on all wikis - T245203 (duration: 00m 56s) |
[production] |
| 19:03 |
<otto@deploy1001> |
Synchronized wmf-config/LabsServices.php: Use new LVS port for EventBus for eventgate-main on all wikis - T245203 (duration: 00m 56s) |
[production] |
| 19:01 |
<otto@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Use new LVS port for EventBus for eventgate-main on all wikis - T245203 (duration: 00m 57s) |
[production] |
| 18:58 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Use new LVS port for EventBus for eventgate-main on all wikis - T245203 (duration: 00m 56s) |
[production] |
| 18:53 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Use new LVS port for EventBus for eventgate-main on group1 wikis - T245203 (duration: 00m 57s) |
[production] |
| 18:45 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Use new LVS port for EventBus for eventgate-main on group0 wikis - T245203 (duration: 00m 57s) |
[production] |
| 18:43 |
<otto@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Use new LVS port for EventBus for eventgate-main on group0 wikis - T245203 (duration: 00m 56s) |
[production] |
| 18:41 |
<XioNoX> |
remove BGP to lvs2004/5/6 on cr1/2-codfw |
[production] |
| 18:41 |
<ebernhardson@deploy1001> |
Finished deploy [search/mjolnir/deploy@8195b6f]: Bump python to 3.7, python-kafka to 1.4.7 (duration: 04m 04s) |
[production] |
| 18:41 |
<otto@deploy1001> |
Synchronized wmf-config/ProductionServices.php: Use new LVS port for EventBus for eventgate-main on group0 wikis - T245203 (duration: 00m 57s) |
[production] |
| 18:39 |
<otto@deploy1001> |
Synchronized wmf-config/LabsServices.php: Use new LVS port for EventBus for eventgate-main on group0 wikis - T245203 (duration: 00m 58s) |
[production] |
| 18:38 |
<ottomata> |
using new eventgate-main LVS ports for eventbus on group0 wikis - T245203 |
[production] |
| 18:37 |
<ebernhardson@deploy1001> |
Started deploy [search/mjolnir/deploy@8195b6f]: Bump python to 3.7, python-kafka to 1.4.7 |
[production] |
| 18:35 |
<XioNoX> |
add BGP to lvs2008 on cr1/2-codfw |
[production] |
| 18:22 |
<brennen> |
Updating dev-images docker-pkg files on contint1001 for T246202 |
[releng] |
| 18:02 |
<pt1979@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 17:59 |
<pt1979@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 17:50 |
<vgutierrez> |
starting pybal on lvs2009 - T246686 |
[production] |
| 17:41 |
<mutante> |
notebook1003 df: /mnt/hdfs: Input/output error | systemctl restart nagios-nrpe-server (T224682) |
[production] |
| 17:40 |
<mutante> |
notebook1003 systemctl restart nagios-nrpe-server |
[production] |
| 17:06 |
<wm-bot> |
<root> Hard restart of webservice. Running Pod and requiested version in service.manifest did not match. |
[tools.zppixbot] |
| 17:04 |
<vgutierrez> |
Stopping pybal on lvs2009 to let lvs2010 get its traffic - T246686 |
[production] |
| 16:54 |
<arturo> |
[codfw1dev] deleted python3-os-ken debian package in cloudnet2003-dev which was installed by hand and had depedency issues |
[admin] |
| 16:37 |
<rxy> |
Add Urbanecm as maintainer |
[tools.stewardbots] |
| 16:20 |
<pt1979@cumin2001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |