8501-8550 of 10000 results (109ms)
2019-06-06 §
05:18 <marostegui> Remove db2042 from tendril and zarcillo T225090 [production]
05:18 <marostegui> Remove db2042 from tendril and zarcillo [production]
05:14 <marostegui> Stop MySQL on db2042 to copy its content to dbprov2001 as a temporary backup - T225090 [production]
05:11 <marostegui> Disable notifications db2042 - T225090 [production]
05:09 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Slowly repool db1091 after getting its BBU replaced T225060 (duration: 00m 56s) [production]
2019-06-05 §
22:50 <Krenair> Added cloudcontrol1004 IP to match cloudcontrol1003 rule in 'proxy' security group rules for port 5668 T225168 [project-proxy]
22:44 <Krenair> Updating 'proxy' security group rules for port 5668 to remove decommissioned IP - 208.80.154.147 californium T189921 [project-proxy]
22:36 <Krenair> Updating 'proxy' security group rules for port 5668 to remove decommissioned IPs - 208.80.154.136 silver, 208.80.155.117 labs-ns0, 208.80.152.32 virt0 (!), 208.80.153.48 labtestservices2001, 208.80.154.92 labcontrol1001 [project-proxy]
22:15 <chaomodus> restarting gerrit on cobalt due to it being down (seems like Java out of heap space) [production]
22:14 <Krenair> Per jeh's investigation, added cloudservices1004 IP to match cloudservices1003 rule in 'proxy' security group rules for port 5668 [project-proxy]
20:59 <mforns> finished deployment of analytics/refinery up to 0660e70153dec892ae20bee7119a72cc17e8ec87 [analytics]
20:43 <mforns@deploy1001> Finished deploy [analytics/refinery@0660e70]: deploying analytics/refinery up to 0660e70153dec892ae20bee7119a72cc17e8ec87 (duration: 19m 30s) [production]
20:39 <reedy@deploy1001> Synchronized wmf-config/flaggedrevs.php: Turn off some FR config T225138 (duration: 00m 54s) [production]
20:25 <akosiaris@deploy1001> scap-helm blubberoid finished [production]
20:25 <akosiaris@deploy1001> scap-helm blubberoid cluster codfw completed [production]
20:25 <akosiaris@deploy1001> scap-helm blubberoid cluster eqiad completed [production]
20:25 <akosiaris@deploy1001> scap-helm blubberoid upgrade -f blubberoid-values.yaml production stable/blubberoid [namespace: blubberoid, clusters: eqiad,codfw] [production]
20:23 <mforns@deploy1001> Started deploy [analytics/refinery@0660e70]: deploying analytics/refinery up to 0660e70153dec892ae20bee7119a72cc17e8ec87 [production]
20:20 <mforns> starting deployment of analytics/refinery up to 0660e70153dec892ae20bee7119a72cc17e8ec87 [analytics]
20:02 <bd808> Restarted bot to pick up config change adding #wikimedia-codehealth [tools.stashbot]
19:57 <hashar> contint1001: docker container prune -f && docker image prune -f # reclaimed 166 MB and 3.4 GB [production]
19:50 <wikibugs> Updated channels.yaml to: 445187388f45f0a9dd7d038cdfe41a5990e373a8 Add #wikimedia-codehealth channel [tools.wikibugs]
19:48 <marostegui> Check data consistency on db1091 against db1135 - T225060 [production]
19:45 <reedy@deploy1001> Synchronized wmf-config/flaggedrevs.php: T225115 (duration: 00m 54s) [production]
19:34 <andrewbogott> moving deployment-imagescaler03 to cloudvirt1029 [releng]
19:34 <andrewbogott> moving deployment-imagescaler03 to cloudvirt1029 [deployment-prep]
18:33 <andrewbogott> repooled tools-sgeexec-0921 and tools-sgeexec-0929 [tools]
18:24 <andrewbogott> moving maps-puppetmaster to cloudvirt1029 [maps]
18:20 <mforns> finished deployment of analytics/refinery/source v0.0.91 [analytics]
18:16 <andrewbogott> depooling and moving tools-sgeexec-0921 and tools-sgeexec-0929 [tools]
18:00 <mforns> starting deployment of analytics/refinery/source v0.0.91 [analytics]
17:36 <marostegui> Start replication db1091 - T225060 [production]
17:35 <James_F> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/514547 [releng]
17:32 <marostegui> Start MySQL with replication stopped on db1091 - T225060 [production]
16:29 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Revert user-blocks-change to use eventbus and old schema - T211248 (duration: 00m 54s) [production]
16:22 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: use eventgate-main for 2 events on all wikis - T211248 (duration: 00m 55s) [production]
16:11 <reedy@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Add wgEventServiceStreamConfig and switch 2 topics in group0 T222822 (duration: 00m 56s) [production]
16:11 <XioNoX> remove BGP to AS38082 on cr4-ulsfo (left the IXP) [production]
16:01 <James_F> Reloading Zuul to deploy 172a4e7886b285adb48a85dce7287dce5c3778e2 [releng]
15:46 <reedy@deploy1001> Scap failed!: Call to mwscript eval.php returned: None [production]
15:44 <reedy@deploy1001> Finished scap: Rebuild .8 i18n for FlaggedRevs (duration: 41m 14s) [production]
15:36 <moritzm> installing exim4 security updates [production]
15:03 <wm-bot> <jeanfred> Deploy latest from Git master: 5317bb7, aabd6ec (T224862) [tools.wikiloves]
15:03 <reedy@deploy1001> Started scap: Rebuild .8 i18n for FlaggedRevs [production]
14:24 <marostegui> Poweroff db1091 for BBU replacement - T225060 [production]
13:57 <elukey> restart mcrouter on MediaWiki app/api canaries to pick up new config change (timeouts before marking a memcached shard as TKO from 3 to 10) - T203786 [production]
13:56 <jijiki> enabling puppet and pooling on mw* canaries [production]
13:17 <jynus> start es2,es3 backup on codfw [production]
13:17 <zfilipin@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.34.0-wmf.8 [production]
13:03 <hashar> restarting Jenkins [production]