1-50 of 10000 results (29ms)
2022-01-18 ยง
21:42 <jhuneidi@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.38.0-wmf.18 refs T293959 [production]
21:29 <jhuneidi@deploy1002> Finished scap: testwikis to 1.38.0-wmf.18 refs T293959 (duration: 38m 31s) [production]
21:26 <jhathaway> rebooting mx1001, to test new kernel [production]
20:50 <jhuneidi@deploy1002> Started scap: testwikis to 1.38.0-wmf.18 refs T293959 [production]
20:50 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
20:49 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
20:49 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
20:48 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
20:43 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
20:42 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
20:42 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
20:41 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
20:25 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
20:24 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
20:24 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
20:23 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
18:27 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
18:26 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
18:26 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
18:25 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
18:20 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
18:20 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 0ff5874469b717cba38ed7cff0669754517a3553: pwnwiki: Deploy Growth features to newcomers (T298115) (duration: 02m 14s) [production]
18:18 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
18:18 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn [production]
18:17 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn [production]
17:57 <dcausse> restarting blazegraph on wdqs1007 (jvm stuck for 13hours) [production]
17:37 <hashar> restarted zuul on contint2001 [production]
17:16 <moritzm> installing gmp security updates [production]
16:53 <klausman@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ml-serve2001.codfw.wmnet [production]
16:53 <hnowlan@cumin1001> START - Cookbook sre.hosts.reimage for host restbase2010.codfw.wmnet with OS buster [production]
16:52 <hashar> contint2001: restarted ferm service [production]
16:49 <hnowlan@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host restbase2010.codfw.wmnet with OS buster [production]
16:48 <hnowlan@cumin1001> START - Cookbook sre.hosts.reimage for host restbase2010.codfw.wmnet with OS buster [production]
16:47 <hnowlan@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host restbase2010.codfw.wmnet with OS buster [production]
16:45 <klausman@cumin2001> START - Cookbook sre.hosts.reboot-single for host ml-serve2001.codfw.wmnet [production]
16:21 <hnowlan@cumin1001> START - Cookbook sre.hosts.reimage for host restbase2010.codfw.wmnet with OS buster [production]
16:14 <hnowlan@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host restbase2010.codfw.wmnet with OS buster [production]
16:13 <hnowlan@cumin1001> START - Cookbook sre.hosts.reimage for host restbase2010.codfw.wmnet with OS buster [production]
16:11 <hnowlan@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host restbase2010.codfw.wmnet with OS buster [production]
16:10 <elukey@deploy1002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]
16:09 <elukey@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
16:07 <hnowlan@cumin1001> START - Cookbook sre.hosts.reimage for host restbase2010.codfw.wmnet with OS buster [production]
16:03 <moritzm> installing xen security updates on buster (client-side libraries) [production]
15:59 <hashar> Shutting down CI for maintenance on contint2001 # T283582 [production]
15:54 <godog> update kartotherian certs on maps hosts and roll-reload nginx - T297604 [production]
15:54 <moritzm> installing libssh2 security updates on stretch [production]
15:50 <aqu@deploy1002> Finished deploy [airflow-dags/analytics-test@3ad07a0]: (no justification provided) (duration: 00m 09s) [production]
15:50 <aqu@deploy1002> Started deploy [airflow-dags/analytics-test@3ad07a0]: (no justification provided) [production]
15:47 <andrewbogott> resizing the wikitech-static host for T298052 [production]
15:45 <aqu@deploy1002> Finished deploy [airflow-dags/analytics-test@3ad07a0]: (no justification provided) (duration: 00m 02s) [production]