|
2019-06-26
§
|
| 07:50 |
<godog> |
bounce rsyslog on lithium - T199406 |
[production] |
| 07:30 |
<godog> |
powercycle ms-be2032 - T226600 |
[production] |
| 07:23 |
<joal> |
manually rerun webrequest-druid-hourly-wf-2019-6-26-5 (second failure, druid reboot this time) |
[analytics] |
| 07:19 |
<ema> |
depool cp5003 and reimage as upload_ats T226477 |
[production] |
| 07:09 |
<elukey> |
reboot of druid100[1-3] hosts for kernel + openjdk upgrades |
[production] |
| 07:04 |
<joal> |
Manually rerun pageview-hourly-wf-2019-6-26-5, aqs-hourly-wf-2019-6-26-5 and webrequest-druid-hourly-wf-2019-6-26-5 |
[analytics] |
| 06:22 |
<elukey> |
stop camus and other timers on an-coord1001 (prep step for reboot) |
[analytics] |
| 05:59 |
<elukey> |
systemctl mask + reset-failed kafka on kafka10[12-23] - T226517 |
[production] |
| 05:57 |
<marostegui> |
wikimedia_editor_tasks_entity_description_exists from s8:testwikidatawiki T226326 |
[production] |
| 05:46 |
<marostegui> |
wikimedia_editor_tasks_entity_description_exists from s3:testwikidatawiki T226326 |
[production] |
| 05:29 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Add db1133 into m5 depooled T222682 (duration: 00m 55s) |
[production] |
| 05:28 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Add db1133 into m5 depooled T222682 (duration: 00m 55s) |
[production] |
| 05:12 |
<legoktm> |
fixed up apache config, and enabled systemd timer to mirror every 5 minutes |
[packagist-mirror] |
| 01:29 |
<James_F> |
Moving labs/tools/stewardbots's composer test to php72+ T226585 |
[releng] |
|
2019-06-25
§
|
| 22:50 |
<jforrester@deploy1001> |
Synchronized php-1.34.0-wmf.11/extensions/Echo/modules/nojs/: T226503 Fix badge icons in Monobook (duration: 00m 56s) |
[production] |
| 22:48 |
<jforrester@deploy1001> |
Synchronized php-1.34.0-wmf.10/extensions/Echo/modules/nojs/: T226503 Fix badge icons in Monobook (duration: 00m 57s) |
[production] |
| 22:00 |
<hauskatze> |
Ran `replication start operations/debs/coredns --wait` |
[releng] |
| 21:30 |
<jgleeson> |
updating civicrm from 5c02e62d6e to 98fd34417d |
[production] |
| 21:30 |
<jhuneidi@deploy1001> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.34.0-wmf.11 |
[production] |
| 21:23 |
<thcipriani> |
gerrit back on 2.15.13 |
[production] |
| 21:19 |
<thcipriani@deploy1001> |
Finished deploy [gerrit/gerrit@7b379a6]: revert Gerrit to 2.15.13 on cobalt (restart incoming) (duration: 00m 11s) |
[production] |
| 21:19 |
<thcipriani@deploy1001> |
Started deploy [gerrit/gerrit@7b379a6]: revert Gerrit to 2.15.13 on cobalt (restart incoming) |
[production] |
| 21:07 |
<thcipriani@deploy1001> |
Finished deploy [gerrit/gerrit@7b379a6]: revert Gerrit to 2.15.13 on gerrit2001 (duration: 00m 10s) |
[production] |
| 21:07 |
<thcipriani@deploy1001> |
Started deploy [gerrit/gerrit@7b379a6]: revert Gerrit to 2.15.13 on gerrit2001 |
[production] |
| 21:07 |
<hauskatze> |
gerrit: Created new repo: operations/debs/coredns - requested by fsero on mediawiki |
[releng] |
| 21:03 |
<hashar> |
contint1001: running puppet to clear a puppet alarm (due to Gerrit restart) |
[production] |
| 20:44 |
<moritzm> |
rebooting ununpentium for kernel security update |
[production] |
| 20:44 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 20:44 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 20:35 |
<thcipriani> |
gerrit back |
[production] |
| 20:33 |
<thcipriani> |
restarting gerrit due to T224448 |
[production] |
| 20:28 |
<moritzm> |
rebooting vega for kernel security update |
[production] |
| 20:27 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 20:27 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 20:24 |
<jhuneidi@deploy1001> |
Finished scap: testwikis wikis to 1.34.0-wmf.11 (duration: 41m 35s) |
[production] |
| 20:10 |
<moritzm> |
rebooting webperf hosts for kernel security update |
[production] |
| 20:09 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 20:09 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 20:00 |
<moritzm> |
rebooting torrelay1001 for kernel security update |
[production] |
| 20:00 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 20:00 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 19:43 |
<jhuneidi@deploy1001> |
Started scap: testwikis wikis to 1.34.0-wmf.11 |
[production] |
| 19:16 |
<twentyafterfour@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.34.0-wmf.10 refs T220735 |
[production] |
| 19:11 |
<Krinkle> |
Update Jenkins collapsible section patterns to account for "quibble.cmd" => "quibble.commands" changing in the output |
[releng] |
| 19:08 |
<twentyafterfour> |
deploying MediaWiki 1.34.0-wmf.10 to all wikis |
[production] |
| 19:07 |
<twentyafterfour> |
looks like we are unblocked for wmf.10, deploying that first |
[production] |
| 18:45 |
<longma> |
cutting the branch f or 1.34.0-wmf.11 T220736 |
[production] |
| 17:51 |
<jiji@deploy1001> |
Finished deploy [cpjobqueue/deploy@eb8f692]: Migrating RecentChangesUpdate to PHP7 - T219148 (duration: 01m 37s) |
[production] |
| 17:49 |
<jiji@deploy1001> |
Started deploy [cpjobqueue/deploy@eb8f692]: Migrating RecentChangesUpdate to PHP7 - T219148 |
[production] |
| 17:24 |
<smalyshev@deploy1001> |
Finished deploy [wdqs/wdqs@ca96238]: undo: modify agents for T226471 (duration: 16m 14s) |
[production] |