|
2020-04-22
§
|
| 23:01 |
<rxy> |
Flags +AV were set on Kostas20142 in #cvn-unifications. |
[cvn] |
| 23:01 |
<rxy> |
Flags +AV were set on Kostas20142 in #cvn-meta. |
[cvn] |
| 17:59 |
<wm-bot> |
<zppix1> restart to pickup new API key |
[tools.zppixbot-test] |
| 17:59 |
<wm-bot> |
<zppix1> restart to pickup new API key |
[tools.zppixbot] |
| 10:51 |
<RhinosF1> |
Test Bot to 210s timeout refs T250861 - rolling timeout to 300s |
[tools.zppixbot-test] |
| 08:55 |
<Urbanecm> |
Move User:Wikipedia:Introduction (historical) --> Wikipedia:Introduction (historical) at enwiki using moveBatch.php, on-wiki interface was time-outing |
[production] |
| 06:46 |
<elukey> |
kill dataquality hourly bundle again, traffic_by_country keeps failing |
[analytics] |
| 06:11 |
<elukey> |
start data quality bundle hourly with --user=analytics |
[analytics] |
| 05:50 |
<elukey@deploy1001> |
Finished deploy [analytics/refinery@30facc4]: Test of new scap settings (duration: 04m 42s) |
[production] |
| 05:45 |
<elukey@deploy1001> |
Started deploy [analytics/refinery@30facc4]: Test of new scap settings |
[production] |
| 05:45 |
<elukey> |
add a separate refinery scap target for the Hadoop test cluster and redeploy to check new settings |
[analytics] |
| 05:25 |
<elukey@deploy1001> |
deploy aborted: log (duration: 00m 02s) |
[production] |
| 05:24 |
<elukey@deploy1001> |
Started deploy [analytics/refinery@30facc4]: log |
[production] |
| 01:55 |
<milimetric@deploy1001> |
Finished deploy [analytics/refinery@30facc4]: Analytics: another follow-up on the train, jar version bump (take 2, analytics1030 keeps failing) (duration: 00m 42s) |
[production] |
| 01:54 |
<milimetric@deploy1001> |
Started deploy [analytics/refinery@30facc4]: Analytics: another follow-up on the train, jar version bump (take 2, analytics1030 keeps failing) |
[production] |
| 01:54 |
<milimetric@deploy1001> |
Finished deploy [analytics/refinery@30facc4]: Analytics: another follow-up on the train, jar version bump (duration: 02m 54s) |
[production] |
| 01:51 |
<milimetric@deploy1001> |
Started deploy [analytics/refinery@30facc4]: Analytics: another follow-up on the train, jar version bump |
[production] |
| 01:51 |
<milimetric@deploy1001> |
deploy aborted: Analytics: another follow-up on the train, jar version bump (duration: 04m 08s) |
[production] |
| 01:46 |
<milimetric@deploy1001> |
Started deploy [analytics/refinery@30facc4]: Analytics: another follow-up on the train, jar version bump |
[production] |
| 01:43 |
<reedy@deploy1001> |
Synchronized wmf-config/CommonSettings.php: T209749 (duration: 01m 01s) |
[production] |
|
2020-04-21
§
|
| 23:41 |
<maryum> |
deploy complete for wdqs v0.3.23 |
[production] |
| 23:36 |
<mstyles@deploy1001> |
Finished deploy [wdqs/wdqs@4e0d55f]: v0.3.23 (duration: 11m 35s) |
[production] |
| 23:25 |
<mstyles@deploy1001> |
Started deploy [wdqs/wdqs@4e0d55f]: v0.3.23 |
[production] |
| 23:19 |
<maryum> |
begin deploy of WDQS v 0.3.23 on deploy1001 |
[production] |
| 23:17 |
<milimetric> |
restarted webrequest bundle, babysitting that first before going on |
[analytics] |
| 23:06 |
<bstorm_> |
repooled tools-k8s-worker-38/52, tools-sgewebgrid-lighttpd-0918/9 and tools-sgeexec-0901 T250869 |
[tools] |
| 23:00 |
<milimetric> |
forgot a small jar version update, finished deploying now |
[analytics] |
| 22:41 |
<eileen> |
process-control config revision is 6294adfbaa |
[production] |
| 22:24 |
<milimetric@deploy1001> |
Finished deploy [analytics/refinery@64c5ec4]: Analytics: tiny follow-up on weekly train [analytics/refinery@64c5ec4] (duration: 37m 05s) |
[production] |
| 22:12 |
<andrewbogott> |
moving cloudvirt1004 out of the 'standard' aggregate and into the 'maintenance' aggregate |
[admin] |
| 22:09 |
<bstorm_> |
depooling tools-sgewebgrid-lighttpd-0918/9 and tools-sgeexec-0901 T250869 |
[tools] |
| 22:02 |
<bstorm_> |
draining tools-k8s-worker-38 and tools-k8s-worker-52 as they are on the crashed host T250869 |
[tools] |
| 21:56 |
<andrewbogott> |
rebooting cloudvirt1004, total raid controller failure |
[production] |
| 21:50 |
<urandom> |
bootstrapping restbase2014-c — T250050 |
[production] |
| 21:46 |
<milimetric@deploy1001> |
Started deploy [analytics/refinery@64c5ec4]: Analytics: tiny follow-up on weekly train [analytics/refinery@64c5ec4] |
[production] |
| 21:38 |
<milimetric> |
deployed twice because analytics1030 failed with "OSError {}" but seems ok after the second deploy |
[analytics] |
| 21:38 |
<milimetric@deploy1001> |
Finished deploy [analytics/refinery@35781db]: Regular Analytics weekly train deploy [analytics/refinery@35781db] try 2 (analytics1030 failed with OSError the first time) (duration: 00m 13s) |
[production] |
| 21:37 |
<milimetric@deploy1001> |
Started deploy [analytics/refinery@35781db]: Regular Analytics weekly train deploy [analytics/refinery@35781db] try 2 (analytics1030 failed with OSError the first time) |
[production] |
| 21:21 |
<milimetric@deploy1001> |
Finished deploy [analytics/refinery@35781db]: Regular Analytics weekly train deploy [analytics/refinery@35781db] (duration: 16m 19s) |
[production] |
| 21:07 |
<wm-bot> |
<lucaswerkmeister> deployed 6634452b4c (increase uWSGI buffer) |
[tools.lexeme-forms] |
| 21:05 |
<milimetric@deploy1001> |
Started deploy [analytics/refinery@35781db]: Regular Analytics weekly train deploy [analytics/refinery@35781db] |
[production] |
| 21:05 |
<milimetric@deploy1001> |
Finished deploy [analytics/refinery@35781db] (thin): Regular Analytics weekly train deploy THIN [analytics/refinery@35781db] (duration: 00m 08s) |
[production] |
| 21:05 |
<milimetric@deploy1001> |
Started deploy [analytics/refinery@35781db] (thin): Regular Analytics weekly train deploy THIN [analytics/refinery@35781db] |
[production] |
| 19:09 |
<rzl> |
mcrouter certs renewed on puppetmaster1001 (again); puppet re-enabled on mcrouter hosts and will update certs naturally over the next 30m T248093 |
[production] |
| 19:02 |
<urandom> |
bootstrapping restbase2014-b — T250050 |
[production] |