|
2025-09-24
§
|
| 15:40 |
<jasmine@deploy1003> |
Unlocked for deployment [ALL REPOSITORIES]: Datacenter Switchover - T399891 (duration: 64m 41s) |
[production] |
| 15:29 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.switchdc.mediawiki.09-run-puppet-on-db-masters (exit_code=0) for datacenter switchover from eqiad to codfw |
[production] |
| 15:17 |
<jasmine@cumin1003> |
START - Cookbook sre.switchdc.mediawiki.09-run-puppet-on-db-masters for datacenter switchover from eqiad to codfw |
[production] |
| 15:11 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.switchdc.mediawiki.09-restore-ttl (exit_code=0) for datacenter switchover from eqiad to codfw |
[production] |
| 15:11 |
<jasmine@cumin1003> |
START - Cookbook sre.switchdc.mediawiki.09-restore-ttl for datacenter switchover from eqiad to codfw |
[production] |
| 15:09 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.switchdc.mediawiki.08-start-maintenance (exit_code=0) for datacenter switchover from eqiad to codfw |
[production] |
| 15:07 |
<jasmine@cumin1003> |
START - Cookbook sre.switchdc.mediawiki.08-start-maintenance for datacenter switchover from eqiad to codfw |
[production] |
| 15:06 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.switchdc.mediawiki.08-restart-mw-jobrunner (exit_code=0) for datacenter switchover from eqiad to codfw |
[production] |
| 15:06 |
<jasmine@cumin1003> |
START - Cookbook sre.switchdc.mediawiki.08-restart-mw-jobrunner for datacenter switchover from eqiad to codfw |
[production] |
| 15:05 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.switchdc.mediawiki.07-set-readwrite (exit_code=0) for datacenter switchover from eqiad to codfw |
[production] |
| 15:04 |
<jasmine@cumin1003> |
START - Cookbook sre.switchdc.mediawiki.07-set-readwrite for datacenter switchover from eqiad to codfw |
[production] |
| 15:04 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.switchdc.mediawiki.06-set-db-readwrite (exit_code=0) for datacenter switchover from eqiad to codfw |
[production] |
| 15:04 |
<jasmine@cumin1003> |
START - Cookbook sre.switchdc.mediawiki.06-set-db-readwrite for datacenter switchover from eqiad to codfw |
[production] |
| 15:04 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.switchdc.mediawiki.04-switch-mediawiki (exit_code=0) for datacenter switchover from eqiad to codfw |
[production] |
| 15:04 |
<jasmine@cumin1003> |
START - Cookbook sre.switchdc.mediawiki.04-switch-mediawiki for datacenter switchover from eqiad to codfw |
[production] |
| 15:03 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.switchdc.mediawiki.03-set-db-readonly (exit_code=0) for datacenter switchover from eqiad to codfw |
[production] |
| 15:03 |
<jasmine@cumin1003> |
START - Cookbook sre.switchdc.mediawiki.03-set-db-readonly for datacenter switchover from eqiad to codfw |
[production] |
| 15:03 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.switchdc.mediawiki.02-set-readonly (exit_code=0) for datacenter switchover from eqiad to codfw |
[production] |
| 15:02 |
<jasmine@cumin1003> |
START - Cookbook sre.switchdc.mediawiki.02-set-readonly for datacenter switchover from eqiad to codfw |
[production] |
| 15:01 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.switchdc.mediawiki.01-stop-maintenance (exit_code=0) for datacenter switchover from eqiad to codfw |
[production] |
| 14:59 |
<jasmine@cumin1003> |
START - Cookbook sre.switchdc.mediawiki.01-stop-maintenance for datacenter switchover from eqiad to codfw |
[production] |
| 14:58 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.switchdc.mediawiki.00-reduce-ttl (exit_code=0) for datacenter switchover from eqiad to codfw |
[production] |
| 14:52 |
<jasmine@cumin1003> |
START - Cookbook sre.switchdc.mediawiki.00-reduce-ttl for datacenter switchover from eqiad to codfw |
[production] |
| 14:51 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.switchdc.mediawiki.00-downtime-db-readonly-checks (exit_code=0) for datacenter switchover from eqiad to codfw |
[production] |
| 14:51 |
<jasmine@cumin1003> |
START - Cookbook sre.switchdc.mediawiki.00-downtime-db-readonly-checks for datacenter switchover from eqiad to codfw |
[production] |
| 14:35 |
<jasmine@deploy1003> |
Locking from deployment [ALL REPOSITORIES]: Datacenter Switchover - T399891 |
[production] |
|
2025-09-23
§
|
| 16:31 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.discovery.datacenter (exit_code=0) depool all services in eqiad: Moving services to codfw, Southward DC Switchover Day 1 - T399891 |
[production] |
| 16:03 |
<jasmine@cumin1003> |
START - Cookbook sre.discovery.datacenter depool all services in eqiad: Moving services to codfw, Southward DC Switchover Day 1 - T399891 |
[production] |
| 16:03 |
<jasmine@cumin1003> |
END (ERROR) - Cookbook sre.discovery.datacenter (exit_code=93) depool all services in eqiad: Moving services to codfw, Southward DC Switchover Day 1 - T399891 |
[production] |
| 15:52 |
<jasmine@cumin1003> |
START - Cookbook sre.discovery.datacenter depool all services in eqiad: Moving services to codfw, Southward DC Switchover Day 1 - T399891 |
[production] |
| 15:30 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: depool site eqiad [reason: Moving traffic to codfw, Southward DC Switchover Day 1, T399891] |
[production] |
| 15:30 |
<jasmine@cumin1003> |
START - Cookbook sre.dns.admin DNS admin: depool site eqiad [reason: Moving traffic to codfw, Southward DC Switchover Day 1, T399891] |
[production] |
| 15:22 |
<swfrench-wmf> |
upsizing mw-web in advance of services switchover - T399891 |
[production] |
|
2025-09-18
§
|
| 16:36 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.switchdc.mediawiki.09-run-puppet-on-db-masters (exit_code=0) for datacenter switchover from codfw to eqiad |
[production] |
| 16:32 |
<jasmine@deploy1003> |
Unlocked for deployment [ALL REPOSITORIES]: Datacenter Switchover - T399891 (duration: 16m 26s) |
[production] |
| 16:24 |
<jasmine@cumin1003> |
START - Cookbook sre.switchdc.mediawiki.09-run-puppet-on-db-masters for datacenter switchover from codfw to eqiad |
[production] |
| 16:24 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.switchdc.mediawiki.09-restore-ttl (exit_code=0) for datacenter switchover from codfw to eqiad |
[production] |
| 16:23 |
<jasmine@cumin1003> |
START - Cookbook sre.switchdc.mediawiki.09-restore-ttl for datacenter switchover from codfw to eqiad |
[production] |
| 16:23 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.switchdc.mediawiki.08-start-maintenance (exit_code=0) for datacenter switchover from codfw to eqiad |
[production] |
| 16:23 |
<jasmine@cumin1003> |
START - Cookbook sre.switchdc.mediawiki.08-start-maintenance for datacenter switchover from codfw to eqiad |
[production] |
| 16:22 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.switchdc.mediawiki.08-restart-mw-jobrunner (exit_code=0) for datacenter switchover from codfw to eqiad |
[production] |
| 16:22 |
<jasmine@cumin1003> |
START - Cookbook sre.switchdc.mediawiki.08-restart-mw-jobrunner for datacenter switchover from codfw to eqiad |
[production] |
| 16:21 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.switchdc.mediawiki.07-set-readwrite (exit_code=0) for datacenter switchover from codfw to eqiad |
[production] |
| 16:21 |
<jasmine@cumin1003> |
START - Cookbook sre.switchdc.mediawiki.07-set-readwrite for datacenter switchover from codfw to eqiad |
[production] |
| 16:21 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.switchdc.mediawiki.06-set-db-readwrite (exit_code=0) for datacenter switchover from codfw to eqiad |
[production] |
| 16:21 |
<jasmine@cumin1003> |
START - Cookbook sre.switchdc.mediawiki.06-set-db-readwrite for datacenter switchover from codfw to eqiad |
[production] |
| 16:20 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.switchdc.mediawiki.04-switch-mediawiki (exit_code=0) for datacenter switchover from codfw to eqiad |
[production] |
| 16:20 |
<jasmine@cumin1003> |
START - Cookbook sre.switchdc.mediawiki.04-switch-mediawiki for datacenter switchover from codfw to eqiad |
[production] |
| 16:20 |
<jasmine@cumin1003> |
END (PASS) - Cookbook sre.switchdc.mediawiki.03-set-db-readonly (exit_code=0) for datacenter switchover from codfw to eqiad |
[production] |
| 16:19 |
<jasmine@cumin1003> |
START - Cookbook sre.switchdc.mediawiki.03-set-db-readonly for datacenter switchover from codfw to eqiad |
[production] |