1551-1600 of 10000 results (64ms)
2019-06-13 §
16:02 <gehel> restart blazegraph on wdqs public cluster completed [production]
15:58 <gehel> restart blazegraph on wdqs public cluster [production]
15:36 <gehel> restarting blazegraph on wdqs-internal / eqiad (just in case) [production]
08:09 <jynus> reloading proxies for wikireplicas to rebalance load [production]
07:00 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1077 after recovering from a crash (duration: 00m 50s) [production]
00:45 <paravoid> setting the CPU governor to performance for ms-be1036 (a while ago) [production]
2019-06-12 §
18:15 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.8/thumb.php: T225197 / 06b631fae5 (duration: 00m 47s) [production]
18:13 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.8/extensions/ArticlePlaceholder/includes/: T207235 / a42aa1599a131c55304 (duration: 00m 49s) [production]
16:06 <gehel@cumin1001> END (PASS) - Cookbook sre.elasticsearch.rolling-restart (exit_code=0) [production]
15:49 <gehel@cumin1001> START - Cookbook sre.elasticsearch.rolling-restart [production]
15:37 <legoktm> re-enabled bawolff's gerrit account [production]
15:14 <gehel@cumin1001> END (ERROR) - Cookbook sre.elasticsearch.rolling-restart (exit_code=97) [production]
14:38 <marostegui> Start replication on all threads on labsdb1010 - T222978 [production]
14:35 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1077 after recovering from a crash (duration: 00m 47s) [production]
13:19 <gehel@cumin1001> START - Cookbook sre.elasticsearch.rolling-restart [production]
11:55 <godog> swift eqiad-prod: put back ms-be1033 - T223518 [production]
10:52 <godog> force-upgrade mtail to 3.0.0~rc24.1-1 on wezen - T225604 [production]
10:36 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1077 after recovering from a crash (duration: 00m 47s) [production]
10:18 <akosiaris@deploy1001> scap-helm zotero finished [production]
10:18 <akosiaris@deploy1001> scap-helm zotero cluster codfw completed [production]
10:17 <akosiaris@deploy1001> scap-helm zotero cluster eqiad completed [production]
10:17 <akosiaris@deploy1001> scap-helm zotero upgrade --dry-run --debug production stable/zotero [namespace: zotero, clusters: eqiad,codfw] [production]
10:01 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Slowly repool db1077 after a crash (duration: 00m 48s) [production]
09:51 <gehel@cumin2001> END (PASS) - Cookbook sre.elasticsearch.rolling-restart (exit_code=0) [production]
08:59 <hashar> Gracefully stopping Zuul (kill -SIGUSR1) to prepare for the restart of the CI Jenkins T225322 [production]
08:41 <onimisionipe> pool map2003. reimage and setup is complete - T224395 [production]
08:31 <gehel@cumin2001> START - Cookbook sre.elasticsearch.rolling-restart [production]
06:49 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Slowly repool db1077 after a crash (duration: 00m 49s) [production]
2019-06-11 §
19:24 <tzatziki> Removing four (4) files for legal compliance [production]
15:41 <gehel> shutting down elastic1029 for investigation - T214283 [production]
12:54 <godog> swift eqiad-prod: put back ms-be1033 - T223518 [production]
11:52 <gehel@cumin2001> END (PASS) - Cookbook sre.postgresql.postgres-init (exit_code=0) [production]
10:54 <godog> wipe fs on ms-be1033 data partitions - T223518 [production]
09:56 <gehel@cumin2001> START - Cookbook sre.postgresql.postgres-init [production]
09:20 <godog> free up space wrongly allocated onto / with sdc1 umounted on ms-be2018 [production]
08:26 <gehel> repooling maps200[124] [production]
2019-06-10 §
19:39 <thcipriani> restarting jenkins [production]
19:11 <akosiaris> refresh all zotero pods in all clusters [production]
19:11 <akosiaris@deploy1001> scap-helm zotero finished [production]
19:11 <akosiaris@deploy1001> scap-helm zotero cluster staging completed [production]
19:11 <akosiaris@deploy1001> scap-helm zotero upgrade -f zotero-values-staging.yaml staging stable/zotero [namespace: zotero, clusters: staging] [production]
19:11 <akosiaris@deploy1001> scap-helm zotero finished [production]
19:10 <akosiaris@deploy1001> scap-helm zotero cluster eqiad completed [production]
19:10 <akosiaris@deploy1001> scap-helm zotero upgrade -f zotero-values-eqiad.yaml production stable/zotero [namespace: zotero, clusters: eqiad] [production]
19:10 <akosiaris@deploy1001> scap-helm zotero finished [production]
19:10 <akosiaris@deploy1001> scap-helm zotero cluster codfw completed [production]
19:10 <akosiaris@deploy1001> scap-helm zotero upgrade -f zotero-values-codfw.yaml production stable/zotero [namespace: zotero, clusters: codfw] [production]
17:55 <ottomata> rolling restart of AQS service using scap deploy for new mediawiki_history_snaphost [production]
17:55 <otto@deploy1001> Started restart [analytics/aqs/deploy@fc1d232]: (no justification provided) [production]
16:24 <marostegui> Power reset db1077 from the idrac T225391 [production]