2024-03-08
Β§
|
23:17 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
23:17 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
21:31 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
21:31 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
21:28 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
21:28 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
21:25 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
21:25 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
21:23 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
21:23 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
21:21 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
21:21 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
21:16 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
21:16 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
21:08 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
21:08 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
21:05 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
21:05 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
21:03 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
21:03 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
21:01 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
21:01 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
20:57 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
20:57 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
20:46 |
<mutante> |
planet1003/2003: apt-get remove prometheus-apache-exporter - T359596 |
[production] |
20:28 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
20:28 |
<logmsgbot> |
@deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply |
[production] |
18:51 |
<taavi> |
arm cumin_master keyholder key on cumin1002 after ganeti1033 froze and rebooted |
[production] |
18:38 |
<cdanis> |
β cdanis@ganeti1027.eqiad.wmnet ~ πβ sudo gnt-node migrate -f ganeti1033.eqiad.wmnet |
[production] |
18:20 |
<cdanis> |
βcdanis@ganeti1027.eqiad.wmnet ~ πβ sudo gnt-node failover -f ganeti1033.eqiad.wmnet |
[production] |
18:17 |
<cdanis> |
forcibly rebooting ganeti1033 |
[production] |
18:13 |
<cdanis> |
β cdanis@ganeti1027.eqiad.wmnet ~ πβ sudo gnt-node migrate -f ganeti1033.eqiad.wmnet |
[production] |
18:04 |
<Dreamy_Jazz> |
Stopped scan on group 2 wiki (test complete) |
[production] |
17:55 |
<Dreamy_Jazz> |
Running `foreachwikiindblist group2.dblist extensions/MediaModeration/maintenance/scanFilesInScanTable.php --use-jobqueue --sleep 1 --verbose 2>&1 | tee ~/scan-files-in-scan-table-group2-sleep-1-no-render-now.txt` on a tmux session |
[production] |
15:32 |
<fabfur@cumin1002> |
conftool action : set/pooled=yes; selector: name=cp4037.ulsfo.wmnet |
[production] |
15:32 |
<fabfur> |
repooling cp4037 for this weekend, all log-format changes are reverted (T351117) |
[production] |
15:28 |
<fabfur@cumin2002> |
END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp4037.ulsfo.wmnet |
[production] |
15:28 |
<fabfur@cumin2002> |
START - Cookbook sre.hosts.remove-downtime for cp4037.ulsfo.wmnet |
[production] |
14:33 |
<isaranto@deploy2002> |
helmfile [ml-staging-codfw] 'sync' command on namespace 'ores-legacy' for release 'main' . |
[production] |
14:20 |
<eevans@deploy2002> |
Finished deploy [cassandra/logstash-logback-encoder@910b77d]: Deploying to updated target list β T354560 (duration: 00m 35s) |
[production] |
14:20 |
<eevans@deploy2002> |
Started deploy [cassandra/logstash-logback-encoder@910b77d]: Deploying to updated target list β T354560 |
[production] |
14:17 |
<eevans@deploy2002> |
Finished deploy [cassandra/logstash-logback-encoder@c200e79]: Deploying to updated target list β T354560 (duration: 00m 36s) |
[production] |