|
2019-08-15
§
|
| 12:13 |
<James_F> |
Zuul: Make GrowthExperiments depend on Echo for non-Phan too. |
[releng] |
| 12:04 |
<Urbanecm> |
EU SWAT is going a few minutes out of its window |
[production] |
| 12:01 |
<gehel@cumin1001> |
END (PASS) - Cookbook sre.elasticsearch.force-shard-allocation (exit_code=0) |
[production] |
| 12:01 |
<gehel@cumin1001> |
START - Cookbook sre.elasticsearch.force-shard-allocation |
[production] |
| 12:00 |
<gehel@cumin1001> |
END (PASS) - Cookbook sre.elasticsearch.force-shard-allocation (exit_code=0) |
[production] |
| 12:00 |
<gehel@cumin1001> |
START - Cookbook sre.elasticsearch.force-shard-allocation |
[production] |
| 11:37 |
<Urbanecm> |
Run mwscript namespaceDupes.php --wiki=zhwikisource --add-prefix="FIXME" --fix (T230294) |
[production] |
| 11:36 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: fe9b6ed: Add Portal namespace on zhwikisource (T230294) (duration: 00m 47s) |
[production] |
| 11:29 |
<urbanecm@deploy1001> |
Synchronized wmf-config/throttle.php: SWAT: 377cc53: Add new throttle rule for cawiki editathon (T230313) (duration: 00m 47s) |
[production] |
| 11:26 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Remove napwikisource from wgProofreadPageNamespaceIds (T230541) (duration: 00m 47s) |
[production] |
| 11:12 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 0d8c516: Fix addition of Hubblesite.org and Spacetelescope.org to commons wgCopyUploadsDomains (T230083) (duration: 00m 48s) |
[production] |
| 11:05 |
<arturo> |
applied the `role::labs::lvm::srv` puppet role to the `ign` virtual machine for using the extra storage |
[ign2commons] |
| 10:56 |
<arturo> |
created `ign` virtual machine again |
[ign2commons] |
| 10:50 |
<James_F> |
Zuul: Make GrowthExperiments depend on Echo |
[releng] |
| 10:50 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T230533: Add more import sources for napwikisource (duration: 00m 52s) |
[production] |
| 10:32 |
<arturo> |
delete failed `ign` virtual machine |
[ign2commons] |
| 09:22 |
<arturo> |
restart maintain-kubeusers service in tools-k8s-master-01 because some tools were missing their namespaces |
[tools] |
| 09:05 |
<James_F> |
Zuul: Kartotherian pipeline enablement T223275 |
[releng] |
| 08:54 |
<gehel@cumin1001> |
END (PASS) - Cookbook sre.elasticsearch.force-shard-allocation (exit_code=0) |
[production] |
| 08:54 |
<gehel@cumin1001> |
START - Cookbook sre.elasticsearch.force-shard-allocation |
[production] |
| 08:52 |
<gehel@cumin1001> |
END (PASS) - Cookbook sre.elasticsearch.force-shard-allocation (exit_code=0) |
[production] |
| 08:52 |
<gehel@cumin1001> |
START - Cookbook sre.elasticsearch.force-shard-allocation |
[production] |
| 07:35 |
<ema> |
cp5002: ats-backend-restart to enable compress plugin |
[production] |
| 06:38 |
<ema> |
wdqs1009: restart wdqs-updater.service |
[production] |
| 02:37 |
<Cam11598> |
7:36:41 PM <ChanServ> Flags +AV were set on DannyS712 in #cvn-simplewikis. |
[cvn] |
| 00:15 |
<robh> |
scs-ulsfo offline due to networking issues, rob returning tomorrow with fix T230077 |
[production] |
| 00:03 |
<twentyafterfour> |
starting phabricator upgrade to 2019-08-14/1 refs T215697 |
[production] |
|
2019-08-14
§
|
| 23:13 |
<ebernhardson> |
leave cloudelastic writes paused, and dropping from backlog queue, to allow primary clusters to catch up |
[production] |
| 22:41 |
<eileen> |
civicrm revision changed from 569e52e23d to 3caf54a0d2, config revision is 1c76e94ac3 |
[production] |
| 22:38 |
<ebernhardson> |
freeze writes to cloudelastic for real this time |
[production] |
| 22:03 |
<ejegg> |
updated fundraising python tools from 827ce3750e to 5c080bac63 |
[production] |
| 22:01 |
<robh> |
starting scs-ulsfo replacement. There will be icinga errors and they are intentionally being allowed so we know when things dont recover properly T230077 |
[production] |
| 21:37 |
<XioNoX> |
advertise core v6 range (2620:0:860::/46) from eqord - T167841 |
[production] |
| 21:30 |
<@> |
helmfile [STAGING] Ran 'apply' command on namespace 'sessionstore' for release 'staging' . |
[production] |
| 21:26 |
<ebernhardson> |
thaw writes to cloudelastic |
[production] |
| 21:24 |
<ejegg> |
updated payments-wiki from 9533f70fab to 44eae2d65f |
[production] |
| 21:18 |
<@> |
helmfile [STAGING] Ran 'apply' command on namespace 'sessionstore' for release 'staging' . |
[production] |
| 21:13 |
<ebernhardson> |
apply freeze to cloudelastic writes, to determine if backlog processing can catchup while deferring cloudelastic writes |
[production] |
| 20:49 |
<@> |
helmfile [STAGING] Ran 'apply' command on namespace 'sessionstore' for release 'staging' . |
[production] |
| 20:46 |
<@> |
helmfile [STAGING] Ran 'apply' command on namespace 'sessionstore' for release 'staging' . |
[production] |
| 20:44 |
<@> |
helmfile [STAGING] Ran 'apply' command on namespace 'sessionstore' for release 'staging' . |
[production] |
| 20:44 |
<@> |
helmfile [STAGING] Ran 'apply' command on namespace 'sessionstore' for release 'staging' . |
[production] |
| 18:40 |
<hauskatze> |
github: Created https://github.com/wikimedia/operations-debs-prometheus-ipsec-exporter && forced replication to mirror changes # T230443 |
[releng] |
| 18:29 |
<hauskatze> |
Created new gerrit project: `operations/debs/prometheus-ipsec-exporter.git` # T230443 |
[releng] |
| 18:01 |
<gehel@cumin1001> |
END (PASS) - Cookbook sre.elasticsearch.rolling-reboot (exit_code=0) |
[production] |
| 17:58 |
<fdans> |
backfilling mediarequests from 2019-5-16 to 2019-8-14 |
[analytics] |
| 17:29 |
<gehel@cumin1001> |
START - Cookbook sre.elasticsearch.rolling-reboot |
[production] |
| 16:32 |
<gehel@cumin1001> |
END (PASS) - Cookbook sre.elasticsearch.force-shard-allocation (exit_code=0) |
[production] |
| 16:32 |
<gehel@cumin1001> |
START - Cookbook sre.elasticsearch.force-shard-allocation |
[production] |
| 16:31 |
<gehel@cumin1001> |
END (ERROR) - Cookbook sre.elasticsearch.rolling-reboot (exit_code=97) |
[production] |