3001-3050 of 10000 results (41ms)
2020-08-05 ยง
18:26 <Lucas_WMDE> Morning backport window done [production]
18:25 <lucaswerkmeister-wmde@deploy1001> Synchronized php-1.36.0-wmf.3/extensions/ContentTranslation/: Backport: [[gerrit:618566|Pass jQuery objects into jqueryMsg]] (duration: 01m 11s) [production]
18:14 <mutante> test !log [production]
18:10 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:618343|Re-enable growth study quick survey (T257015)]] (duration: 01m 12s) [production]
17:30 <shdubsh> test prometheus-icinga-exporter upgrade on icinga2001 [production]
16:50 <elukey> powercycle stat1005 after GPU issue [production]
15:56 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: EventStreamConfig - Add eventgate-logging-external streams and destination_event_service settings - T251935 (duration: 01m 05s) [production]
15:50 <hnowlan@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . [production]
15:43 <hnowlan@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . [production]
15:11 <pt1979@cumin2001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:08 <godog> bounce logstash on logstash100[789] - udp loss reported [production]
15:05 <pt1979@cumin2001> START - Cookbook sre.dns.netbox [production]
14:48 <elukey> reboot stat1008 for unexpected maintenance (GPU stuck) [production]
14:33 <otto@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'eventgate-main' for release 'canary' . [production]
14:32 <otto@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . [production]
14:27 <otto@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventgate-main' for release 'canary' . [production]
14:27 <otto@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . [production]
14:25 <moritzm> installing nmap bugfix updates from buster point release [production]
14:24 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . [production]
14:24 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-main' for release 'canary' . [production]
14:20 <sukhe@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:20 <sukhe@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:14 <moritzm> installing pillow security updates [production]
14:03 <moritzm> installing node-minimist security updates [production]
13:51 <moritzm> installing Linux update to 4.9.132 from buster point update (no reboots, just the package updates) [production]
13:32 <jayme> updated helmfile to 0.125.2-0 and helm-diff to 3.1.2-1 on contint* and deploy* [production]
13:28 <volans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:24 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
13:04 <elukey> restart yarn resource managers on an-master100[12] to pick up new Yarn settings - https://gerrit.wikimedia.org/r/c/operations/puppet/+/618529 [production]
13:00 <moritzm> installing libjpeg-turbo security updates on stretch [production]
12:52 <XioNoX> netmon1002:/srv/deployment/librenms/librenms$ sudo -u librenms ./lnms migrate [production]
12:49 <jayme> imported helm-diff_3.1.2-1 to buster-wikimedia, jessie-wikimedia and stretch-wikimedia [production]
12:46 <moritzm> installing imagemagick security updates on buster [production]
12:33 <moritzm> installing net-snmp security updates on icinga hosts [production]
11:36 <awight> EU Bacon reclosed [production]
11:36 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:614891|Switch test wikis to new version of vector by default (3/3) (T254227)]] (duration: 01m 07s) [production]
11:29 <awight> EU Bacon reopened [production]
11:28 <awight> EU Bacon complete [production]
11:26 <awight@deploy1001> Synchronized wmf-config: Config: [[gerrit:618481|FileImporter: full default deployment (T232542)]] (duration: 01m 04s) [production]
11:23 <jayme> imported helm-diff_3.1.2-0 to jessie-wikimedia and stretch-wikimedia [production]
11:22 <jayme> imported helm-diff_3.1.2-0 to buster-wikimedia [production]
11:19 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:618303|Add import sources for lijwikisource (T259633)]] (duration: 01m 07s) [production]
11:13 <awight@deploy1001> sync-file aborted: Config: [[gerrit:618303|Add import sources for lijwikisource (T259633)]] (duration: 00m 13s) [production]
11:10 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:595542|Enable Data Bridge on Test Wikidata clients (T232584)]] (duration: 01m 20s) [production]
10:39 <XioNoX> reboot cr3-ulsfo - T259621 [production]
10:28 <XioNoX> drain traffic away cr3-ulsfo - T259621 [production]
10:21 <moritzm> installing libssh security updates [production]
10:18 <XioNoX> reboot cr4-ulsfo - T259621 [production]
09:58 <XioNoX> drain traffic away cr4-ulsfo [production]
09:53 <XioNoX> depool ulsfo - T259621 [production]