1851-1900 of 10000 results (20ms)
2021-09-10 §
09:07 <mutante> planet - deleted all state files for all languages, running fresh update via systemctl start for all languages after proxy changes (T285251) [production]
08:37 <jynus> upgrade and restart db2139 [production]
08:14 <elukey@deploy1002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]
08:14 <elukey@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
08:14 <elukey@deploy1002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]
08:13 <elukey@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
08:12 <elukey@deploy1002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]
08:12 <elukey@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
07:58 <jayme> updating rsyslog to 8.1901.0-1~bpo9+wmf2 on kubernetes-workers - T289766 [production]
07:57 <moritzm> installing ntfs-3g security updates [production]
07:46 <jayme@deploy1002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]
07:45 <jayme@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
07:31 <elukey@deploy1002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]
07:31 <elukey@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
07:25 <jayme> updating rsyslog to 8.1901.0-1~bpo9+wmf2 on kubernetes-staging - T289766 [production]
07:19 <jayme> importes rsyslog 8.1901.0-1~bpo9+wmf2 to stretch-wikimedia - T289766 [production]
06:56 <effie> disable puppet on deploy1002 and mw2254 [production]
06:29 <jayme@deploy1002> helmfile [codfw] DONE helmfile.d/admin 'sync'. [production]
06:27 <jayme@deploy1002> helmfile [codfw] START helmfile.d/admin 'sync'. [production]
06:26 <jayme@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'sync'. [production]
06:26 <jayme@deploy1002> helmfile [eqiad] START helmfile.d/admin 'sync'. [production]
06:02 <elukey@puppetmaster1001> conftool action : set/pooled=inactive; selector: name=mw2280.codfw.wmnet [production]
05:59 <jiji@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
05:56 <elukey> powercycle mw2280 - no tty available in mgmt, no ssh, host frozen [production]
05:55 <elukey@puppetmaster1001> conftool action : set/pooled=no; selector: name=mw2280.codfw.wmnet [production]
05:54 <jiji@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
05:45 <jiji@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
05:42 <jiji@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
05:12 <marostegui> Repool clouddb1017:3311 [production]
05:12 <marostegui> Repool clouddb1013:3311 [production]
04:49 <marostegui> Depool clouddb1013:3311 [production]
04:49 <marostegui> Depool clouddb1017:3311 [production]
02:52 <eileen> civicrm revision changed from 83f514f693 to 1f071f6c6c, config revision is 23eda8ba3a [production]
00:35 <tgr> Deployed patch for T290692 [production]
2021-09-09 §
23:07 <brennen> no takers on patches, ending backport & config training window. [production]
21:31 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
21:27 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
21:20 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
21:17 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
21:02 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:58 <pt1979@cumin2002> START - Cookbook sre.dns.netbox [production]
19:40 <jiji@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
19:37 <jiji@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
19:06 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
19:04 <jiji@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:37 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:34 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
18:33 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: bc4f20437868b39ae2cc4eac8735ecb8bcd93157: Growth: Push 44 wikis out of dark mode (T289680) (duration: 00m 57s) [production]
18:24 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 6af38d951f0ef9af369e2172c175628dc6e9a281: Deploy Growth features in dark modes to ~200 wikis (T290582; 3/3) (duration: 00m 57s) [production]
18:22 <urbanecm@deploy1002> Synchronized wmf-config/config/: 6af38d951f0ef9af369e2172c175628dc6e9a281: Deploy Growth features in dark modes to ~200 wikis (T290582; 2/3) (duration: 01m 01s) [production]