501-550 of 10000 results (55ms)
2019-07-25 ยง
17:53 <mbsantos@deploy1001> Started deploy [mobileapps/deploy@11d9d4a]: Update service-mobileapp-node to 200a323 (T228938 T228287) [production]
17:51 <elukey> powercycle stat1007 [production]
17:44 <volans> sudo cumin -s30 -b1 -m async 'A:wdqs-all and not A:wdqs-internal and not P{wdqs1009.eqiad.wmnet}' 'run-puppet-agent -e "volans - T228122 - deploying gerrit/524954"' 'systemctl restart wdqs-blazegraph' [production]
17:33 <volans> running sudo cumin -s30 -b1 -m async 'A:wdqs-internal' 'run-puppet-agent -e "volans - T228122 - deploying gerrit/524954"' 'systemctl restart wdqs-blazegraph' [production]
17:18 <volans> disabled puppet on A:wdqs-all, deploying gerrit/524954 - T228122 [production]
17:17 <elukey@cumin1001> END (PASS) - Cookbook sre.hadoop.rolling-restart-workers (exit_code=0) [production]
17:01 <elukey@cumin1001> START - Cookbook sre.hadoop.rolling-restart-workers [production]
16:54 <bblack> lvs5001 - restart pybal for resolv.conf change - T228190 [production]
16:53 <jforrester@deploy1001> Synchronized php-1.34.0-wmf.15/extensions/WikibaseMediaInfo/resources/statements/: T228807 Fix formatValue abort handling (duration: 00m 48s) [production]
16:52 <jijiki> Rolling restart of hhvm across the fleet [production]
16:50 <bblack> lvs5002 - restart pybal for resolv.conf change - T228190 [production]
16:44 <bblack> lvs5003 - restart pybal for resolv.conf change - T228190 [production]
16:19 <jijiki> Disable puppet on mw* servers for 525156 [production]
15:52 <jeh> rebooting cloudstore1008.wikimedia.org for updates T224228 [production]
15:41 <jeh> rebooting cloudstore1009.wikimedia.org for updates T224228 [production]
15:41 <nuria@deploy1001> Finished deploy [analytics/refinery@f310917]: deploying refinery - migrations to hive2 actions (duration: 13m 40s) [production]
15:35 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
15:35 <robh@cumin1001> START - Cookbook sre.hosts.decommission [production]
15:35 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
15:35 <robh@cumin1001> START - Cookbook sre.hosts.decommission [production]
15:32 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Remove redundant wgResourceLoaderStorageEnabled override (duration: 00m 50s) [production]
15:27 <nuria@deploy1001> Started deploy [analytics/refinery@f310917]: deploying refinery - migrations to hive2 actions [production]
15:14 <moritzm> installing patch security updates for jessie [production]
15:09 <jeh> rebooting labstore1004.eqiad.wmnet for updates T224228 [production]
14:42 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@87b25f2]: Convert oozie actions from hive to hive2 (duration: 00m 19s) [production]
14:42 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@87b25f2]: Convert oozie actions from hive to hive2 [production]
14:22 <root@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
14:22 <root@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'coredns' . [production]
14:22 <root@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . [production]
14:06 <root@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
14:06 <root@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'coredns' . [production]
14:06 <root@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . [production]
14:02 <moritzm> installing Java security updates on Druid servers [production]
13:52 <moritzm> installing Java security updates on AQS, Hadoop and Kafka/Jumbo servers [production]
13:49 <root@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
13:49 <root@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'coredns' . [production]
13:49 <root@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . [production]
13:42 <root@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
13:42 <root@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'coredns' . [production]
13:42 <root@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . [production]
13:39 <root@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
13:39 <root@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'coredns' . [production]
13:39 <root@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . [production]
13:39 <root@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . [production]
13:38 <root@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . [production]
13:35 <robh> cloudvirt1015 offline for ram swap via T220853 [production]
13:20 <root@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'rbac-deploy-clusterrole' . [production]
13:19 <fsero> recreating clusterrole deploy from helmfile in staging [production]
13:09 <marostegui> Drop abuse_filter_log.afl_log_id in s5 eqiad - T226851 [production]
13:04 <liw@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.34.0-wmf.15 [production]