|
2016-10-25
ยง
|
| 19:23 |
<hasharAway> |
Python PyPi mirror has some issue. Impacts all CI jobs relying on tox https://status.python.org/ |
[production] |
| 19:22 |
<twentyafterfour> |
phabricator is back from reboot and it appears that all is well |
[production] |
| 19:19 |
<twentyafterfour> |
twentyafterfour@iridium: The system is going down for reboot NOW! |
[production] |
| 19:11 |
<twentyafterfour> |
rebooting iridium (phabricator) in ~ 3 minutes |
[production] |
| 19:11 |
<demon@mira> |
rebuilt wikiversions.php and synchronized wikiversions files: group0 to wmf.23 |
[production] |
| 19:03 |
<ebernhardson@mira> |
Synchronized php-1.28.0-wmf.22/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: (no message) (duration: 00m 47s) |
[production] |
| 16:08 |
<gehel> |
restarting ferm on elastic2020 |
[production] |
| 16:04 |
<gehel> |
delete dangling indices on elasticsearch codfw: jawiki_general_first, jawiki_content_first, zhwiki_general_first and zhwiki_content_first |
[production] |
| 15:21 |
<ori> |
Synchronized wmf-config/throttle.php: I049bd463: Use correct IP for Vanderbilt 2016-10-25 edit-a-thon throttle exception (T149063) (duration: 01m 20s) |
[production] |
| 14:32 |
<gehel> |
reboot of wdqs cluster eqiad for kernel upgrade |
[production] |
| 14:24 |
<moritzm> |
rebooting maerlant for kernel update |
[production] |
| 14:20 |
<gehel> |
reboot of wdqs cluster codfw for kernel upgrade |
[production] |
| 14:14 |
<elukey> |
removed logstash filter for Apache (https://logstash.wikimedia.org/app/kibana#/dashboard/apache2log) - T144005 |
[production] |
| 14:01 |
<_joe_> |
refreshing puppet facts |
[production] |
| 13:34 |
<moritzm> |
rebooting rcstream servers for kernel update |
[production] |
| 13:11 |
<moritzm> |
rebooting etcd1006 for kernel update |
[production] |
| 13:07 |
<hashar> |
European SWAT complete |
[production] |
| 13:06 |
<hashar@mira> |
Synchronized wmf-config/throttle.php: Nashville Architecture edit-a-thon (Vanderbilt library) throttle rule - T149063 (duration: 02m 07s) |
[production] |
| 13:03 |
<moritzm> |
rebooting etcd1005 for kernel update |
[production] |
| 12:57 |
<moritzm> |
rebooting etcd1004 for kernel update |
[production] |
| 12:54 |
<moritzm> |
repooled maerlant (was depooled for some reason, possibly forgotten to repool after maintenance) |
[production] |
| 12:50 |
<moritzm> |
rebooting etcd1003 for kernel update |
[production] |
| 12:42 |
<moritzm> |
rebooting etcd1002 for kernel update |
[production] |
| 12:30 |
<moritzm> |
rebooting etcd1001 for kernel update |
[production] |
| 12:24 |
<elukey> |
rebooting druid100[123] for kernel upgrades |
[production] |
| 11:56 |
<moritzm> |
rebooting hydrogen for kernel update |
[production] |
| 11:53 |
<dcausse> |
elastic@eqiad reindexing top10 wikis with BM25 from terbium T147508 (logs in ~dcausse/bm25_reindex/cirrus_log) |
[production] |
| 11:53 |
<moritzm> |
rolling reboot of mc2* for kernel update |
[production] |
| 11:31 |
<moritzm> |
rebooting copper for kernel update |
[production] |
| 11:16 |
<moritzm> |
bounced ntp on hassium (stuck in XFAC state) |
[production] |
| 11:14 |
<marostegui@mira> |
Synchronized wmf-config/db-eqiad.php: Repool db1059 - T146261 (duration: 01m 22s) |
[production] |
| 10:37 |
<moritzm> |
rebooting acamar for kernel update |
[production] |
| 10:11 |
<elukey> |
reimaging mc103[1-6] to Jessie |
[production] |
| 10:09 |
<marostegui@mira> |
Synchronized wmf-config/db-eqiad.php: Depool db1059 to clone another host from it - T146261 (duration: 01m 36s) |
[production] |
| 09:58 |
<moritzm> |
rearmed keyholder on tin |
[production] |
| 09:50 |
<moritzm> |
rebooting tin for kernel update |
[production] |
| 09:45 |
<moritzm> |
rebooting achernar for kernel update |
[production] |
| 09:43 |
<marostegui> |
Deploying ALTER table s4 commonswiki.templatelinks - T149079 (db2058 only) |
[production] |
| 09:22 |
<moritzm> |
rebooting hassium for kernel update |
[production] |
| 09:09 |
<moritzm> |
rebooting hassaleh for kernel update |
[production] |
| 08:48 |
<marostegui> |
Stopping replication db2058 s4 - using it to clone another host - T146261 |
[production] |
| 08:13 |
<akosiaris> |
reimaging tegmen |
[production] |
| 08:05 |
<dcausse> |
elastic@codfw reindexing jawiki, thwiki and zhwiki T147498 (logs in terbium:~dcausse/bm25_reindex/cirrus_log) |
[production] |
| 08:05 |
<moritzm> |
rebooting chromium for kernel update |
[production] |
| 07:40 |
<moritzm> |
rebooting netmon1001 for kernel update |
[production] |
| 07:06 |
<moritzm> |
rebooting tungsten for kernel update |
[production] |
| 07:05 |
<gehel> |
rebooting elasticsearch relforge cluster for kernel update |
[production] |
| 06:56 |
<moritzm> |
rebooting wezen for kernel update |
[production] |
| 06:52 |
<gehel> |
rebooting elastic1035 for kernel update |
[production] |
| 06:51 |
<moritzm> |
rebooting osmium for kernel update |
[production] |