|
2023-05-03
§
|
| 06:01 |
<marostegui> |
Disconnect codfw -> eqiad replication on s3 T335267 |
[production] |
| 06:01 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 0:15:00 on 24 hosts with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 05:59 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on 26 hosts with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 05:59 |
<marostegui> |
Disconnect codfw -> eqiad replication on s5 T335267 |
[production] |
| 05:59 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 0:15:00 on 26 hosts with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 05:58 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on 27 hosts with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 05:57 |
<marostegui> |
Disconnect codfw -> eqiad replication on s2 T335267 |
[production] |
| 05:57 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 0:15:00 on 27 hosts with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 05:54 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on 27 hosts with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 05:54 |
<marostegui> |
Disconnect codfw -> eqiad replication on s6 T335267 |
[production] |
| 05:54 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 0:15:00 on 27 hosts with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 05:51 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on 6 hosts with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 05:51 |
<marostegui> |
Disconnect codfw -> eqiad replication on es5 T335267 |
[production] |
| 05:51 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 0:15:00 on 6 hosts with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 05:48 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on 6 hosts with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 05:48 |
<marostegui> |
Disconnect codfw -> eqiad replication on es4 T335267 |
[production] |
| 05:48 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 0:15:00 on 6 hosts with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 05:44 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on 10 hosts with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 05:44 |
<marostegui> |
Disconnect codfw -> eqiad replication on x1 T335267 |
[production] |
| 05:44 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 0:15:00 on 10 hosts with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 05:41 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on pc2013.codfw.wmnet,pc1013.eqiad.wmnet with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 05:41 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 0:15:00 on pc2013.codfw.wmnet,pc1013.eqiad.wmnet with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 05:41 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on pc2012.codfw.wmnet,pc1012.eqiad.wmnet with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 05:40 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 0:15:00 on pc2012.codfw.wmnet,pc1012.eqiad.wmnet with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 05:40 |
<marostegui> |
Disconnect codfw -> eqiad replication on pc3 T335267 |
[production] |
| 05:40 |
<marostegui> |
Disconnect codfw -> eqiad replication on pc2 T335267 |
[production] |
| 05:40 |
<marostegui> |
Disconnect codfw -> eqiad replication on pc1 T335267 |
[production] |
| 05:39 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on pc[2011,2014].codfw.wmnet,pc[1011,1014].eqiad.wmnet with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 05:39 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 0:15:00 on pc[2011,2014].codfw.wmnet,pc[1011,1014].eqiad.wmnet with reason: Disconnecting codfw > eqiad T335267 |
[production] |
| 01:24 |
<eileen> |
civicrm upgraded from 09d2eefd to c6149ad2 |
[production] |
| 00:58 |
<ejegg> |
civicrm upgraded from 8426761b to 09d2eefd |
[production] |
| 00:47 |
<sukhe> |
restart haproxy on cp2031: T334448 |
[production] |
| 00:42 |
<eileen> |
civicrm upgraded from 8076995a to 8426761b |
[production] |
|
2023-05-02
§
|
| 23:28 |
<eileen> |
config revision changed from 18acbe1a to 69f60bb9 |
[production] |
| 22:56 |
<eileen> |
config revision changed from 2eef4039 to 18acbe1a |
[production] |
| 22:53 |
<eileen> |
civicrm upgraded from a3d84de3 to 8076995a |
[production] |
| 20:36 |
<urbanecm@deploy1002> |
Finished scap: Backport for [[gerrit:908367|[Growth] Finish Personalized praise variable rename (T334630)]] (duration: 06m 55s) |
[production] |
| 20:30 |
<akosiaris@deploy1002> |
helmfile [staging] DONE helmfile.d/services/machinetranslation: apply |
[production] |
| 20:30 |
<akosiaris@deploy1002> |
helmfile [staging] START helmfile.d/services/machinetranslation: apply |
[production] |
| 20:29 |
<urbanecm@deploy1002> |
Started scap: Backport for [[gerrit:908367|[Growth] Finish Personalized praise variable rename (T334630)]] |
[production] |
| 20:25 |
<ebernhardson@deploy1002> |
Finished deploy [search/mjolnir/deploy@daf8c32]: bump mjolnir to v2.3.0 (duration: 00m 28s) |
[production] |
| 20:24 |
<ebernhardson@deploy1002> |
Started deploy [search/mjolnir/deploy@daf8c32]: bump mjolnir to v2.3.0 |
[production] |
| 20:20 |
<urbanecm@deploy1002> |
Finished scap: Backport for [[gerrit:911799|Switch on creating Babel categories in Russian Wiktionary (T335136)]] (duration: 15m 47s) |
[production] |
| 20:06 |
<urbanecm@deploy1002> |
urbanecm and iniquity: Backport for [[gerrit:911799|Switch on creating Babel categories in Russian Wiktionary (T335136)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet |
[production] |
| 20:04 |
<urbanecm@deploy1002> |
Started scap: Backport for [[gerrit:911799|Switch on creating Babel categories in Russian Wiktionary (T335136)]] |
[production] |
| 19:40 |
<bking@cumin1001> |
END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Unbanning all hosts in search_codfw |
[production] |
| 19:40 |
<bking@cumin1001> |
START - Cookbook sre.elasticsearch.ban Unbanning all hosts in search_codfw |
[production] |
| 19:28 |
<otto@deploy1002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply |
[production] |
| 19:28 |
<otto@deploy1002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply |
[production] |
| 19:18 |
<bking@deploy1002> |
Finished deploy [wdqs/wdqs@0e051d8]: (no justification provided) (duration: 00m 05s) |
[production] |