|
2020-04-24
§
|
| 22:22 |
<wm-bot> |
<jeanfred> Deploy latest from Git master: 6963040, 35a3ea7, 22e27b5, 9dd44ff, 0e45815, 6f36ffd (T248788) |
[tools.integraality] |
| 21:25 |
<cdanis@cumin1001> |
conftool action : set/pooled=true; selector: dnsdisc=wdqs,name=eqiad |
[production] |
| 19:41 |
<Amir1> |
applying T114117 on labswiki (wikitech) |
[production] |
| 19:02 |
<wm-bot> |
<jeanfred> Deploy latest from Git master: 9fea19b, f38047e |
[tools.integraality] |
| 18:58 |
<shdubsh> |
restart elasticsearch on logstash2021 |
[production] |
| 18:50 |
<shdubsh> |
restart elasticsearch on logstash2020 |
[production] |
| 15:12 |
<cdanis@cumin1001> |
conftool action : set/pooled=false; selector: dnsdisc=wdqs,name=eqiad |
[production] |
| 15:08 |
<addshore> |
depool and restart wdqs1006 to catch up with lag after deadlock T242453 |
[production] |
| 11:13 |
<Amir1> |
apply T250071 on s10 (labswiki) |
[production] |
|
2020-04-22
§
|
| 23:01 |
<rxy> |
Flags +AV were set on Kostas20142 in #cvn-unifications. |
[cvn] |
| 23:01 |
<rxy> |
Flags +AV were set on Kostas20142 in #cvn-meta. |
[cvn] |
| 17:59 |
<wm-bot> |
<zppix1> restart to pickup new API key |
[tools.zppixbot-test] |
| 17:59 |
<wm-bot> |
<zppix1> restart to pickup new API key |
[tools.zppixbot] |
| 10:51 |
<RhinosF1> |
Test Bot to 210s timeout refs T250861 - rolling timeout to 300s |
[tools.zppixbot-test] |
| 08:55 |
<Urbanecm> |
Move User:Wikipedia:Introduction (historical) --> Wikipedia:Introduction (historical) at enwiki using moveBatch.php, on-wiki interface was time-outing |
[production] |
| 06:46 |
<elukey> |
kill dataquality hourly bundle again, traffic_by_country keeps failing |
[analytics] |
| 06:11 |
<elukey> |
start data quality bundle hourly with --user=analytics |
[analytics] |
| 05:50 |
<elukey@deploy1001> |
Finished deploy [analytics/refinery@30facc4]: Test of new scap settings (duration: 04m 42s) |
[production] |
| 05:45 |
<elukey@deploy1001> |
Started deploy [analytics/refinery@30facc4]: Test of new scap settings |
[production] |
| 05:45 |
<elukey> |
add a separate refinery scap target for the Hadoop test cluster and redeploy to check new settings |
[analytics] |
| 05:25 |
<elukey@deploy1001> |
deploy aborted: log (duration: 00m 02s) |
[production] |
| 05:24 |
<elukey@deploy1001> |
Started deploy [analytics/refinery@30facc4]: log |
[production] |
| 01:55 |
<milimetric@deploy1001> |
Finished deploy [analytics/refinery@30facc4]: Analytics: another follow-up on the train, jar version bump (take 2, analytics1030 keeps failing) (duration: 00m 42s) |
[production] |
| 01:54 |
<milimetric@deploy1001> |
Started deploy [analytics/refinery@30facc4]: Analytics: another follow-up on the train, jar version bump (take 2, analytics1030 keeps failing) |
[production] |
| 01:54 |
<milimetric@deploy1001> |
Finished deploy [analytics/refinery@30facc4]: Analytics: another follow-up on the train, jar version bump (duration: 02m 54s) |
[production] |
| 01:51 |
<milimetric@deploy1001> |
Started deploy [analytics/refinery@30facc4]: Analytics: another follow-up on the train, jar version bump |
[production] |
| 01:51 |
<milimetric@deploy1001> |
deploy aborted: Analytics: another follow-up on the train, jar version bump (duration: 04m 08s) |
[production] |
| 01:46 |
<milimetric@deploy1001> |
Started deploy [analytics/refinery@30facc4]: Analytics: another follow-up on the train, jar version bump |
[production] |
| 01:43 |
<reedy@deploy1001> |
Synchronized wmf-config/CommonSettings.php: T209749 (duration: 01m 01s) |
[production] |
|
2020-04-21
§
|
| 23:41 |
<maryum> |
deploy complete for wdqs v0.3.23 |
[production] |
| 23:36 |
<mstyles@deploy1001> |
Finished deploy [wdqs/wdqs@4e0d55f]: v0.3.23 (duration: 11m 35s) |
[production] |
| 23:25 |
<mstyles@deploy1001> |
Started deploy [wdqs/wdqs@4e0d55f]: v0.3.23 |
[production] |
| 23:19 |
<maryum> |
begin deploy of WDQS v 0.3.23 on deploy1001 |
[production] |
| 23:17 |
<milimetric> |
restarted webrequest bundle, babysitting that first before going on |
[analytics] |
| 23:06 |
<bstorm_> |
repooled tools-k8s-worker-38/52, tools-sgewebgrid-lighttpd-0918/9 and tools-sgeexec-0901 T250869 |
[tools] |
| 23:00 |
<milimetric> |
forgot a small jar version update, finished deploying now |
[analytics] |
| 22:41 |
<eileen> |
process-control config revision is 6294adfbaa |
[production] |
| 22:24 |
<milimetric@deploy1001> |
Finished deploy [analytics/refinery@64c5ec4]: Analytics: tiny follow-up on weekly train [analytics/refinery@64c5ec4] (duration: 37m 05s) |
[production] |
| 22:12 |
<andrewbogott> |
moving cloudvirt1004 out of the 'standard' aggregate and into the 'maintenance' aggregate |
[admin] |
| 22:09 |
<bstorm_> |
depooling tools-sgewebgrid-lighttpd-0918/9 and tools-sgeexec-0901 T250869 |
[tools] |
| 22:02 |
<bstorm_> |
draining tools-k8s-worker-38 and tools-k8s-worker-52 as they are on the crashed host T250869 |
[tools] |
| 21:56 |
<andrewbogott> |
rebooting cloudvirt1004, total raid controller failure |
[production] |
| 21:50 |
<urandom> |
bootstrapping restbase2014-c — T250050 |
[production] |
| 21:46 |
<milimetric@deploy1001> |
Started deploy [analytics/refinery@64c5ec4]: Analytics: tiny follow-up on weekly train [analytics/refinery@64c5ec4] |
[production] |
| 21:38 |
<milimetric> |
deployed twice because analytics1030 failed with "OSError {}" but seems ok after the second deploy |
[analytics] |