7401-7450 of 10000 results (68ms)
2019-03-15 §
10:02 <akosiaris> remove prometheus-statsd-exporter from zotero pods [production]
10:02 <akosiaris@deploy1001> scap-helm citoid finished [production]
10:02 <akosiaris@deploy1001> scap-helm citoid cluster staging completed [production]
10:02 <akosiaris@deploy1001> scap-helm citoid upgrade -f citoid-staging-values.yaml staging stable/citoid [namespace: citoid, clusters: staging] [production]
10:01 <akosiaris@deploy1001> scap-helm citoid upgrade -f citoid-values-staging.yaml staging stable/citoid [namespace: citoid, clusters: staging] [production]
10:00 <akosiaris@deploy1001> scap-helm zotero finished [production]
10:00 <akosiaris@deploy1001> scap-helm zotero cluster staging completed [production]
10:00 <akosiaris@deploy1001> scap-helm zotero upgrade --install -f zotero-values-staging.yaml staging stable/zotero [namespace: zotero, clusters: staging] [production]
09:58 <akosiaris@deploy1001> scap-helm zotero upgrade -f zotero-values-staging.yaml staging stable/zotero [namespace: zotero, clusters: staging] [production]
09:53 <akosiaris@deploy1001> scap-helm zotero finished [production]
09:53 <akosiaris@deploy1001> scap-helm zotero cluster eqiad completed [production]
09:53 <akosiaris@deploy1001> scap-helm zotero upgrade -f zotero-values-eqiad.yaml production stable/zotero [namespace: zotero, clusters: eqiad] [production]
09:53 <akosiaris@deploy1001> scap-helm zotero finished [production]
09:53 <akosiaris@deploy1001> scap-helm zotero cluster codfw completed [production]
09:52 <akosiaris@deploy1001> scap-helm zotero upgrade -f zotero-values-codfw.yaml production stable/zotero [namespace: zotero, clusters: codfw] [production]
09:42 <godog> bounce grafana-server on grafana1001 [production]
09:32 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1103 (duration: 00m 50s) [production]
09:28 <godog> correction, prometheus2004 [production]
09:27 <godog> temporarily disable read queries to prometheus@k8s on prometheus2003 [production]
09:19 <jiji@cumin1001> conftool action : set/weight=12; selector: dc=eqiad,service=cxserver,cluster=scb,name=kubernetes.* [production]
09:18 <jiji@cumin1001> conftool action : set/weight=15; selector: dc=codfw,service=cxserver,cluster=scb,name=kubernetes.* [production]
09:17 <jijiki> Ramp up cxserver k8s traffic to 50% - T213195 [production]
08:57 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1103 (duration: 00m 50s) [production]
08:52 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1084 (duration: 00m 47s) [production]
08:22 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1084 (duration: 00m 49s) [production]
07:28 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Fully repool db1091 (duration: 00m 49s) [production]
07:17 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1091 (duration: 00m 48s) [production]
07:05 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1091 (duration: 00m 48s) [production]
07:01 <kart_> Finished manual run of unpublished ContentTranslation draft purge script (T217818) [production]
06:55 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1091 (duration: 00m 48s) [production]
06:44 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Slowly repool db1091 (duration: 00m 48s) [production]
06:04 <marostegui> Upgrade db1091 [production]
06:04 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1091 (duration: 00m 50s) [production]
04:01 <kart_> Started manual run of unpublished ContentTranslation draft purge script (T217818) [production]
02:25 <gtirloni> activated TLS termination using Let's Encrypt on paws-proxy-02 [paws]
02:25 <gtirloni> removed webproxies and created new A records pointing directly to paws-proxy-02 [paws]
01:25 <ejegg> re-enabled ingenico audit parser [production]
01:25 <ejegg> updated fundraising CiviCRM from 41efa14fb0 to a2316be94f [production]
2019-03-14 §
23:52 <bd808> Disabled job queues and rescheduled continuous jobs away from tools-exec-14{21,22,23,24,25,26,27,28,29,30,31,32} (T217152) [tools]
23:48 <Krinkle> Abort job quibble-vendor-mysql-hhvm-docker/39874/ for mwext-CentralAuth (stuck after 59 minutes) [releng]
23:28 <bd808> Deleted tools-bastion-05 (T217152) [tools]
23:20 <bd808> Deleted living-style-guide and lsg-01 (T204502) [design]
23:18 <bd808> Deleted dumps-stats and bugzilla (T204503) [dumps]
23:15 <bd808> Deleted vrt (T204508) [getstarted]
23:13 <bd808> Deleted drmf, math-ru, mathoid2 (T204509) [math]
23:11 <bd808> Deleted osm-serv and osmit-due (T204527) [osmit]
23:09 <bd808> Deleted queryr-db-01 and queryr-api-01 (T204683) [queryrapi]
23:06 <bd808> Deleted telnet2.telnet.eqiad.wmflabs (T204694) [telnet]
23:05 <bd808> Deleted danny-b.wildcat.eqiad.wmflabs (T204703) [wildcat]
22:54 <ejegg> temporarily disabled Ingenico WX audit parsing [production]