|
2020-06-09
ยง
|
| 22:55 |
<bstorm_> |
Reset the passwords for T254931 |
[clouddb-services] |
| 21:44 |
<RhinosF1> |
keeping logging_channel off with debug logs and hoping the bot timesout to get some decent non log spammed logs to try and fix bug 2/3 in T254348 |
[tools.zppixbot-test] |
| 21:24 |
<bd808> |
Credentials missing from es7 cluster for tool access. Fallout from T254491 |
[tools.bash] |
| 21:17 |
<RhinosF1> |
- messing stuff up to test T254348 |
[tools.zppixbot-test] |
| 20:00 |
<jhuneidi@deploy1001> |
Pruned MediaWiki: 1.35.0-wmf.32 (duration: 05m 11s) |
[production] |
| 19:51 |
<jhuneidi@deploy1001> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.35.0-wmf.36 |
[production] |
| 19:42 |
<jhuneidi@deploy1001> |
Finished scap: testwikis wikis to 1.35.0-wmf.36 (duration: 57m 47s) |
[production] |
| 19:29 |
<cmjohnson@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 19:26 |
<cmjohnson@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 19:26 |
<cmjohnson@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 19:23 |
<cmjohnson@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 19:10 |
<cmjohnson@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 19:07 |
<cmjohnson@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 19:07 |
<cmjohnson@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 19:05 |
<cmjohnson@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 18:45 |
<jhuneidi@deploy1001> |
Started scap: testwikis wikis to 1.35.0-wmf.36 |
[production] |
| 18:41 |
<jforrester@deploy1001> |
Synchronized php-1.35.0-wmf.36/extensions/TimedMediaHandler/includes/TimedMediaHandler.php: T254824 Avoid undefined index error (duration: 00m 57s) |
[production] |
| 18:36 |
<volans> |
migrated mgmt DNS records in eqsin to the Netbox-generated records - T233183 |
[production] |
| 18:19 |
<wm-bot> |
<bd808> Updated to use python3.7, enabled --canonical, new OAuth grant |
[tools.my-first-flask-oauth-tool] |
| 18:13 |
<jforrester@deploy1001> |
Synchronized php-1.35.0-wmf.36/extensions/CheckUser/: T234921 T254912 Use UserGroupManagerFactory with correct domain to fetch groups (duration: 02m 26s) |
[production] |
| 18:12 |
<volans> |
uploaded cumin_4.0.0rc1-1_amd64.deb to apt.wikimedia.org buster-wikimedia |
[production] |
| 17:16 |
<Krinkle> |
Messing with deploy01 in Beta to debug T230245 |
[releng] |
| 16:43 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 16:40 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 16:06 |
<longma> |
cutting the branch for 1.35.0-wmf.36 T254173 |
[production] |
| 15:56 |
<Reedy> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/604058 |
[releng] |
| 15:26 |
<aborrero@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 15:26 |
<aborrero@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 15:25 |
<arturo> |
icinga downtime everything cloud* lab* for 2h more (T253780) |
[admin] |
| 15:25 |
<aborrero@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 15:25 |
<aborrero@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 15:06 |
<volans> |
forcing a debmonitor GC to verify the fix of T254865 |
[production] |
| 14:59 |
<mutante> |
gerrit2001 - delete gerrit logfiles older than 30 days, crons are now enabled to keep doing it in the future |
[production] |
| 14:55 |
<volans@deploy1001> |
Finished deploy [debmonitor/deploy@44aa1ee]: Release v0.2.5 (duration: 00m 43s) |
[production] |
| 14:54 |
<volans@deploy1001> |
Started deploy [debmonitor/deploy@44aa1ee]: Release v0.2.5 |
[production] |
| 14:49 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db2131 after reimage', diff saved to https://phabricator.wikimedia.org/P11436 and previous config saved to /var/cache/conftool/dbconfig/20200609-144929-marostegui.json |
[production] |
| 14:45 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:42 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:40 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:40 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:34 |
<moritzm> |
rebooting auth1002 |
[production] |
| 14:33 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:32 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:32 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:30 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:17 |
<arturo> |
restarted webservice to check health of the k8s system, DNS servers being upgraded |
[tools.bd808-test] |
| 14:14 |
<Reedy> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/604018 |
[releng] |
| 14:12 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:09 |
<andrewbogott> |
stopping puppet, all designate services and all pdns services on cloudservices1004 for T253780 |
[admin] |
| 14:09 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |