|
2023-05-03
§
|
| 05:40 |
<marostegui> |
Disconnect codfw -> eqiad replication on pc3 T335267 |
[production] |
| 05:40 |
<marostegui> |
Disconnect codfw -> eqiad replication on pc2 T335267 |
[production] |
| 05:40 |
<marostegui> |
Disconnect codfw -> eqiad replication on pc1 T335267 |
[production] |
| 05:39 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on pc[2011,2014].codfw.wmnet,pc[1011,1014].eqiad.wmnet with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 05:39 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 0:15:00 on pc[2011,2014].codfw.wmnet,pc[1011,1014].eqiad.wmnet with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 01:24 |
<eileen> |
civicrm upgraded from 09d2eefd to c6149ad2 |
[production] |
| 00:58 |
<ejegg> |
civicrm upgraded from 8426761b to 09d2eefd |
[production] |
| 00:47 |
<sukhe> |
restart haproxy on cp2031: T334448 |
[production] |
| 00:42 |
<eileen> |
civicrm upgraded from 8076995a to 8426761b |
[production] |
|
2023-05-02
§
|
| 23:28 |
<eileen> |
config revision changed from 18acbe1a to 69f60bb9 |
[production] |
| 22:56 |
<eileen> |
config revision changed from 2eef4039 to 18acbe1a |
[production] |
| 22:53 |
<eileen> |
civicrm upgraded from a3d84de3 to 8076995a |
[production] |
| 20:36 |
<urbanecm@deploy1002> |
Finished scap: Backport for [[gerrit:908367|[Growth] Finish Personalized praise variable rename (T334630)]] (duration: 06m 55s) |
[production] |
| 20:30 |
<akosiaris@deploy1002> |
helmfile [staging] DONE helmfile.d/services/machinetranslation: apply |
[production] |
| 20:30 |
<akosiaris@deploy1002> |
helmfile [staging] START helmfile.d/services/machinetranslation: apply |
[production] |
| 20:29 |
<urbanecm@deploy1002> |
Started scap: Backport for [[gerrit:908367|[Growth] Finish Personalized praise variable rename (T334630)]] |
[production] |
| 20:25 |
<ebernhardson@deploy1002> |
Finished deploy [search/mjolnir/deploy@daf8c32]: bump mjolnir to v2.3.0 (duration: 00m 28s) |
[production] |
| 20:24 |
<ebernhardson@deploy1002> |
Started deploy [search/mjolnir/deploy@daf8c32]: bump mjolnir to v2.3.0 |
[production] |
| 20:20 |
<urbanecm@deploy1002> |
Finished scap: Backport for [[gerrit:911799|Switch on creating Babel categories in Russian Wiktionary (T335136)]] (duration: 15m 47s) |
[production] |
| 20:06 |
<urbanecm@deploy1002> |
urbanecm and iniquity: Backport for [[gerrit:911799|Switch on creating Babel categories in Russian Wiktionary (T335136)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet |
[production] |
| 20:04 |
<urbanecm@deploy1002> |
Started scap: Backport for [[gerrit:911799|Switch on creating Babel categories in Russian Wiktionary (T335136)]] |
[production] |
| 19:40 |
<bking@cumin1001> |
END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Unbanning all hosts in search_codfw |
[production] |
| 19:40 |
<bking@cumin1001> |
START - Cookbook sre.elasticsearch.ban Unbanning all hosts in search_codfw |
[production] |
| 19:28 |
<otto@deploy1002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply |
[production] |
| 19:28 |
<otto@deploy1002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply |
[production] |
| 19:18 |
<bking@deploy1002> |
Finished deploy [wdqs/wdqs@0e051d8]: (no justification provided) (duration: 00m 05s) |
[production] |
| 19:18 |
<bking@deploy1002> |
Started deploy [wdqs/wdqs@0e051d8]: (no justification provided) |
[production] |
| 19:13 |
<bking@deploy1002> |
Finished deploy [wdqs/wdqs@0e051d8]: (no justification provided) (duration: 00m 16s) |
[production] |
| 19:12 |
<bking@deploy1002> |
Started deploy [wdqs/wdqs@0e051d8]: (no justification provided) |
[production] |
| 19:12 |
<bking@deploy1002> |
Finished deploy [wdqs/wdqs@0e051d8]: (no justification provided) (duration: 07m 13s) |
[production] |
| 19:05 |
<bking@deploy1002> |
Started deploy [wdqs/wdqs@0e051d8]: (no justification provided) |
[production] |
| 19:04 |
<bking@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on wdqs2022.codfw.wmnet with reason: attempting WDQS stack on bullseye |
[production] |
| 19:04 |
<bking@cumin1001> |
START - Cookbook sre.hosts.downtime for 14 days, 0:00:00 on wdqs2022.codfw.wmnet with reason: attempting WDQS stack on bullseye |
[production] |
| 18:56 |
<bking@deploy1002> |
Finished deploy [wdqs/wdqs@0e051d8]: (no justification provided) (duration: 00m 03s) |
[production] |
| 18:56 |
<bking@deploy1002> |
Started deploy [wdqs/wdqs@0e051d8]: (no justification provided) |
[production] |
| 18:56 |
<bking@deploy1002> |
Finished deploy [wdqs/wdqs@0e051d8]: (no justification provided) (duration: 00m 19s) |
[production] |
| 18:55 |
<bking@deploy1002> |
Started deploy [wdqs/wdqs@0e051d8]: (no justification provided) |
[production] |
| 18:50 |
<bking@cumin1001> |
conftool action : set/pooled=inactive; selector: name=wdqs2022.codfw.wmnet |
[production] |
| 18:38 |
<ejegg> |
civicrm upgraded from e7904ea6 to a3d84de3 |
[production] |
| 18:19 |
<milimetric@deploy1002> |
Finished deploy [analytics/refinery@c42021f] (thin): Regular analytics weekly train THIN [analytics/refinery@c42021f] (duration: 00m 07s) |
[production] |
| 18:19 |
<milimetric@deploy1002> |
Started deploy [analytics/refinery@c42021f] (thin): Regular analytics weekly train THIN [analytics/refinery@c42021f] |
[production] |
| 18:11 |
<brennen@deploy1002> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.41.0-wmf.7 refs T330213 |
[production] |
| 18:03 |
<brennen> |
train 1.41.0-wmf.7 (T330213): (correction: group0 today) |
[production] |
| 18:01 |
<brennen> |
train 1.41.0-wmf.7 (T330213): no current blockers, rolling to group1 with `scap train` |
[production] |
| 17:45 |
<milimetric@deploy1002> |
Finished deploy [analytics/refinery@c42021f]: Regular analytics weekly train [analytics/refinery@c42021f] (duration: 06m 26s) |
[production] |
| 17:39 |
<milimetric@deploy1002> |
Started deploy [analytics/refinery@c42021f]: Regular analytics weekly train [analytics/refinery@c42021f] |
[production] |
| 17:36 |
<sukhe> |
cr*-eqiad: delete backup routes for ns0: delete routing-options static route 208.80.153.231/32: T330670 |
[production] |
| 17:34 |
<sukhe> |
[correction] cr*-codfw: delete backup routes for ns0: delete routing-options static route 208.80.154.238/32: T330670 |
[production] |
| 17:32 |
<sukhe> |
cr*-codfw: delete backup routes for ns1: delete routing-options static route 208.80.154.238/32: T330670 |
[production] |
| 17:28 |
<sukhe> |
ns1 set routing-options static route 208.80.153.231/32 next-hop [ 208.80.153.77 208.80.153.111 208.80.153.10 ]: T330670 |
[production] |