|
2020-03-03
§
|
| 07:39 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.druid.roll-restart-workers (exit_code=0) |
[production] |
| 07:19 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 07:17 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 07:09 |
<elukey@cumin1001> |
START - Cookbook sre.druid.roll-restart-workers |
[production] |
| 07:09 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 07:07 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.druid.roll-restart-workers (exit_code=0) |
[production] |
| 07:07 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 06:51 |
<vgutierrez> |
reimage lvs3006 with buster - T245984 |
[production] |
| 06:49 |
<marostegui> |
Stop MySQL on db1096:3315,3316 for reimage - T246604 |
[production] |
| 06:43 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1096:3315, db1096:3316 for reimage T246604', diff saved to https://phabricator.wikimedia.org/P10587 and previous config saved to /var/cache/conftool/dbconfig/20200303-064316-marostegui.json |
[production] |
| 06:41 |
<elukey> |
roll restart druid daemons for openjdk upgrades |
[analytics] |
| 06:41 |
<elukey@cumin1001> |
START - Cookbook sre.druid.roll-restart-workers |
[production] |
| 06:39 |
<elukey> |
sto timers on an-coord1001 to facilitate daemon restarts (hive/oozie) |
[analytics] |
| 06:33 |
<vgutierrez> |
Switch from globalsign to LE as unified cert vendor on eqiad - T230687 |
[production] |
| 06:25 |
<vgutierrez> |
Switch from globalsign to LE as unified cert vendor on codfw - T230687 |
[production] |
| 02:57 |
<mutante> |
manually running "Ancientpages" cron on s3 (T243599) |
[production] |
| 02:39 |
<mutante> |
manually running updateSpecialPages.php maintenance cron on s8 for AncientPages to confirm it was fixed by gerrit:574726 a few days ago (T243599) |
[production] |
| 00:53 |
<jforrester@deploy1001> |
Synchronized wmf-config/CommonSettings.php: T240055 Update special scandium configuration to load from /srv/parsoid-testing (duration: 00m 58s) |
[production] |
| 00:36 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Touch and secondary sync of IS for cache-busting (duration: 00m 56s) |
[production] |
| 00:35 |
<jforrester@deploy1001> |
Synchronized dblists/mobilemainpagelegacy.dblist: T32405 Drop legacy main page special casing on select projects (duration: 00m 56s) |
[production] |
| 00:31 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Touch and secondary sync of IS for cache-busting (duration: 00m 56s) |
[production] |
| 00:28 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T242030 Enable lead paragraph in user namespace on nlwiki (duration: 00m 56s) |
[production] |
| 00:15 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=wtp1025.eqiad.wmnet |
[production] |
| 00:14 |
<jforrester@deploy1001> |
Synchronized wmf-config/CommonSettings.php: T240055: Point the Parsoid cluster at the train version of Parsoid, not a special check-out (duration: 00m 56s) |
[production] |
| 00:13 |
<jforrester@deploy1001> |
sync aborted: wmf-config/CommonSettings.php T240055: Point the Parsoid cluster at the train version of Parsoid, not a special check-out (duration: 00m 03s) |
[production] |
| 00:13 |
<jforrester@deploy1001> |
Started scap: wmf-config/CommonSettings.php T240055: Point the Parsoid cluster at the train version of Parsoid, not a special check-out |
[production] |
| 00:05 |
<mutante> |
wtp1025 - scap pull |
[production] |
|
2020-03-02
§
|
| 23:58 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=wtp1025.eqiad.wmnet |
[production] |
| 23:43 |
<krinkle@deploy1001> |
Synchronized docroot/noc/: Idc26716abef5bff (duration: 00m 56s) |
[production] |
| 23:42 |
<krinkle@deploy1001> |
Synchronized multiversion/: Idc26716abef5bff (duration: 00m 57s) |
[production] |
| 23:41 |
<krinkle@deploy1001> |
Synchronized src/: Idc26716abef5bff (duration: 00m 56s) |
[production] |
| 23:36 |
<krinkle@deploy1001> |
Synchronized wmf-config/CommonSettings.php: I1bdc5e359476 (duration: 00m 56s) |
[production] |
| 23:28 |
<wm-bot> |
<lucaswerkmeister> deployed eeac67f247 (<input> improvement) |
[tools.pagepile-visual-filter] |
| 22:26 |
<jeh> |
starting first pass of elasticsearch data migration to new cluster T236606 |
[tools] |
| 21:31 |
<Urbanecm> |
Shut SULWatcher down for maintenance |
[tools.stewardbots] |
| 21:31 |
<Urbanecm> |
tools.stewardbots@tools-sgebastion-08:~$ rm -rf conf # T246702 |
[tools.stewardbots] |
| 21:29 |
<Urbanecm> |
tools.stewardbots@tools-sgebastion-08:~$ rm -rf data # empty folder |
[tools.stewardbots] |
| 21:18 |
<Urbanecm> |
Move several files to ~/00_backup; exact list at task (T246702) |
[tools.stewardbots] |
| 21:14 |
<Krenair> |
restarted php7.2-fpm on deployment-mediawiki-07 |
[releng] |
| 21:12 |
<Urbanecm> |
tools.stewardbots@tools-sgebastion-08:~$ rm -rf ~/StewardBot/ ~/SULWatcher/ (T246702) |
[tools.stewardbots] |
| 21:10 |
<XioNoX> |
re-number AMS-IX peer 64271 |
[production] |
| 21:06 |
<Urbanecm> |
Move ~/public_html to ~/stewardbots and symlink ~/public_html to ~/stewardbots (T246702) |
[tools.stewardbots] |
| 20:47 |
<Urbanecm> |
Undo, now pushed to gerrit ready to review |
[tools.stewardbots] |
| 20:32 |
<Urbanecm> |
Adding uncommited live hacks to /hat-web-tool/delete.php to make it work |
[tools.stewardbots] |
| 20:22 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings-labs.php: Enable Mediawiki client side error logging on group0 wikis - T246030 (duration: 00m 57s) |
[production] |
| 20:12 |
<krinkle@deploy1001> |
Synchronized multiversion/MWConfigCacheGenerator.php: I1ef0589 (duration: 00m 58s) |
[production] |
| 20:01 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings-labs.php: Enable Mediawiki client side error logging in beta - T246030 (duration: 00m 56s) |
[production] |
| 19:58 |
<joal> |
Remove faulty _REFINED file at /wmf/data/event/mediawiki_revision_score/datacenter=eqiad/year=2020/month=3/day=2/hour=10/_REFINED |
[analytics] |
| 19:38 |
<Urbanecm> |
tools.stewardbots@tools-sgebastion-08:~$ rm ~/tuttiidb.sql # empty file |
[tools.stewardbots] |
| 19:37 |
<Urbanecm> |
tools.stewardbots@tools-sgebastion-08:~$ rm backup_tutti_i_db.sql # empty file |
[tools.stewardbots] |