4701-4750 of 10000 results (53ms)
2018-10-16 ยง
22:04 <ppchelko@deploy1001> Finished deploy [restbase/deploy@d9e3a09]: Downgrade major-greater to minor-greater if no-cache is required, take 4 (duration: 03m 53s) [production]
22:00 <ppchelko@deploy1001> Started deploy [restbase/deploy@d9e3a09]: Downgrade major-greater to minor-greater if no-cache is required, take 4 [production]
22:00 <ppchelko@deploy1001> Finished deploy [restbase/deploy@d9e3a09]: Downgrade major-greater to minor-greater if no-cache is required, take 3 (duration: 04m 15s) [production]
21:58 <twentyafterfour@deploy1001> rebuilt and synchronized wikiversions files: group0 wikis to 1.32.0-wmf.24 refs T191072 [production]
21:55 <ppchelko@deploy1001> Started deploy [restbase/deploy@d9e3a09]: Downgrade major-greater to minor-greater if no-cache is required, take 3 [production]
21:55 <ppchelko@deploy1001> Finished deploy [restbase/deploy@d9e3a09]: Downgrade major-greater to minor-greater if no-cache is required, take 2 (duration: 09m 11s) [production]
21:46 <ppchelko@deploy1001> Started deploy [restbase/deploy@d9e3a09]: Downgrade major-greater to minor-greater if no-cache is required, take 2 [production]
21:45 <ppchelko@deploy1001> Finished deploy [restbase/deploy@d9e3a09]: Downgrade major-greater to minor-greater if no-cache is required (duration: 03m 53s) [production]
21:42 <ppchelko@deploy1001> Started deploy [restbase/deploy@d9e3a09]: Downgrade major-greater to minor-greater if no-cache is required [production]
21:18 <twentyafterfour@deploy1001> rebuilt and synchronized wikiversions files: group0 wikis to 1.32.0-wmf.26 refs T191072 [production]
20:55 <twentyafterfour@deploy1001> Finished scap: Syncing 1.32.0-wmf.26 refs T191072 (duration: 26m 32s) [production]
20:28 <twentyafterfour@deploy1001> Started scap: Syncing 1.32.0-wmf.26 refs T191072 [production]
20:14 <shdubsh> restarted pdfrender on scb1003 [production]
18:44 <ppchelko@deploy1001> Started restart [proton/deploy@a657059]: Try restarting again for metrics [production]
18:43 <ppchelko@deploy1001> Started restart [proton/deploy@a657059]: Try restarting again for metrics [production]
18:42 <ppchelko@deploy1001> Finished deploy [proton/deploy@a657059]: Try restarting for metrics (duration: 00m 20s) [production]
18:42 <ppchelko@deploy1001> Started deploy [proton/deploy@a657059]: Try restarting for metrics [production]
17:01 <_joe_> restarted pdfrender on scb1004 [production]
16:33 <akosiaris> depool restbase-async from eqiad in order to test traffic going to parsoid codfw [production]
16:15 <_joe_> disabled puppet on all appservers, merging wikidata apache change, re-enabling puppet on mwdebug1001 for testing [production]
14:51 <mobrovac@deploy1001> Finished deploy [proton/deploy@a657059]: Rollback to puppeteer v1.5.0 - T186748 (duration: 00m 49s) [production]
14:51 <mobrovac@deploy1001> Started deploy [proton/deploy@a657059]: Rollback to puppeteer v1.5.0 - T186748 [production]
14:28 <godog> roll-restart elasticsearch on logstash100[456] to change elasticsearch data dir - T206454 [production]
14:06 <godog> depool in turn logstash1008 and logstash1009 to change elasticsearch data dir - T206454 [production]
13:55 <godog> depool logstash1007 to change elasticsearch data dir - T206454 [production]
13:54 <XioNoX> router back and healthy, enable external BGP sessions on cr2-eqdfw - T203261 [production]
13:51 <moritzm> rebooting acamar for update to stretch-proposed-updates kernel [production]
13:44 <XioNoX> reboot cr2-eqdfw for upgrade - T203261 [production]
13:43 <XioNoX> disable external BGP sessions on cr2-eqdfw - T203261 [production]
13:43 <anomie@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Setting comment table migration stage to write-new/read-both on group 0 (T166733) (duration: 00m 50s) [production]
13:33 <XioNoX> start install process on cr2-eqdfw (non impacting before reboot) - T203261 [production]
13:11 <akosiaris> pool codfw for apertium|citoid|cxserver|eventbus|eventstreams|graphoid|mathoid|mobileapps|ores|parsoid|pdfrender|proton|recommendation-api|restbase|restbase-async|wdqs|wdqs-internal|zotero [production]
13:11 <akosiaris@puppetmaster1001> conftool action : set/pooled=true; selector: name=codfw,dnsdisc=^apertium|citoid|cxserver|eventbus|eventstreams|graphoid|mathoid|mobileapps|ores|parsoid|pdfrender|proton|recommendation-api|restbase|restbase-async|wdqs|wdqs-internal|zotero$ [production]
13:08 <elukey> restart memcached on mc1035 with -R 200 (will wipe the object cache shard as consequence) - T203786 [production]
12:57 <akosiaris> pool mathoid eqiad [production]
12:52 <gtirloni> T186571 removed legofan4000 user from project-tools group (leftover from T165624 legofan4000->macfan4000 rename) [production]
12:44 <akosiaris@deploy1001> scap-helm mathoid finished [production]
12:43 <akosiaris@deploy1001> scap-helm mathoid cluster eqiad completed [production]
12:43 <akosiaris@deploy1001> scap-helm mathoid upgrade production stable/mathoid --reset-values -f mathoid.yaml [namespace: mathoid, clusters: eqiad] [production]
12:35 <akosiaris> depool eqiad mathoid for helm chart upgrade [production]
12:32 <akosiaris> pool codfw mathoid [production]
12:14 <akosiaris@deploy1001> scap-helm mathoid finished [production]
12:14 <akosiaris@deploy1001> scap-helm mathoid cluster codfw completed [production]
12:14 <akosiaris@deploy1001> scap-helm mathoid upgrade production stable/mathoid --reset-values -f mathoid.yaml [namespace: mathoid, clusters: codfw] [production]
12:08 <Amir1> EU SWAT is done [production]
12:08 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:467669|Enable reading from new backend of change_tag in s7 (T194164)]] (duration: 00m 50s) [production]
12:03 <akosiaris@deploy1001> scap-helm mathoid finished [production]
12:03 <akosiaris@deploy1001> scap-helm mathoid cluster codfw completed [production]
12:03 <ladsgroup@deploy1001> Synchronized php-1.32.0-wmf.24/includes/changetags/ChangeTags.php: SWAT: [[gerrit:467670|Avoid fatals when the filter tags is empty (T194164)]] (duration: 00m 50s) [production]
12:03 <akosiaris@deploy1001> scap-helm mathoid upgrade production stable/mathoid --set main_app.limits.memory=1G [namespace: mathoid, clusters: codfw] [production]