|
2017-04-08
§
|
| 20:56 |
<bblack> |
removed varnishkafka logs and daemon.log.1 on cp1052 to free disk space and clear alert |
[production] |
| 17:43 |
<chasemp> |
service nova-compute restart labvirt1002 |
[production] |
| 17:36 |
<chasemp> |
nova reset-state on 15 nodepool stuck in deletion nodes, and force-delete |
[production] |
| 17:29 |
<chasemp> |
delete manual on labcontrol all instances in delete state on nodepool |
[production] |
| 17:25 |
<chasemp> |
openstack server delete 970a86ce-2549-4cf3-be91-1f8558ab1b32 (admin-monitoring stuck in build) |
[production] |
| 17:21 |
<chasemp> |
restart rabbitmq on labcontrol1001 |
[production] |
| 17:20 |
<chasemp> |
restart nova-api on labnet |
[production] |
| 16:00 |
<bblack> |
banning obj.http.Content-Type ~ text/html on cache_upload |
[production] |
| 15:46 |
<bblack> |
banning obj.http.X-Orig-Content-Type !~ . on cache_upload in ulsfo |
[production] |
| 14:56 |
<bblack> |
banning obj.http.X-Orig-Content-Type !~ . on cache_upload in esams |
[production] |
| 13:54 |
<bblack> |
banning obj.http.X-Orig-Content-Type !~ . on cache_upload in codfw |
[production] |
| 13:27 |
<bblack> |
banning obj.http.X-Orig-Content-Type !~ . on cache_upload in eqiad |
[production] |
| 11:55 |
<bblack> |
banning obj.http.Content-Type ~ text/html on cache_upload |
[production] |
| 10:55 |
<jynus> |
setting labsdb1001 and labsdb1003 in read only mode |
[production] |
| 09:55 |
<reedy@tin> |
Finished scap: Rebuild EP l10n cache for namespace aliases T162481 (duration: 79m 11s) |
[production] |
| 08:36 |
<reedy@tin> |
Started scap: Rebuild EP l10n cache for namespace aliases T162481 |
[production] |
| 08:34 |
<reedy@tin> |
Synchronized wmf-config/CommonSettings.php: T162481 (duration: 00m 39s) |
[production] |
| 08:33 |
<reedy@tin> |
Synchronized wmf-config/extension-list: T162481 (duration: 00m 40s) |
[production] |
| 02:56 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Sat Apr 8 02:56:37 UTC 2017 (duration 5m 33s) |
[production] |
| 02:51 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.19) (duration: 08m 03s) |
[production] |
| 02:24 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.18) (duration: 08m 13s) |
[production] |
|
2017-04-07
§
|
| 23:16 |
<mutante> |
gerrit2001 - deleting netmon1001 backup (/srv/netmon1001), stop rsyncd, remove rsyncd config (T125020) |
[production] |
| 23:06 |
<ejegg> |
updated DjangoBannerStats from 220f80ece976aecbfbfbe1cb476d79910eb48ff4 to 9e6b11712851919e4318930e19bdf9c941d8ae38 |
[production] |
| 22:18 |
<reedy@tin> |
Synchronized php-1.29.0-wmf.19/extensions/EducationProgram/EducationProgram.php: Load wgExtensionMessagesFiles in PHP entry point for mergeMessageLists T162481 (duration: 00m 49s) |
[production] |
| 20:07 |
<demon@tin> |
Synchronized README: no-op, testing master sync speed now (duration: 00m 38s) |
[production] |
| 20:05 |
<demon@tin> |
Synchronized README: no-op, co-master sync (duration: 00m 39s) |
[production] |
| 19:41 |
<demon@tin> |
Finished scap: no-op, final history sync (duration: 23m 05s) |
[production] |
| 19:18 |
<demon@tin> |
Started scap: no-op, final history sync |
[production] |
| 18:40 |
<demon@tin> |
Synchronized php-1.29.0-wmf.19/includes/specials/: no-op, cleaning up history (duration: 01m 00s) |
[production] |
| 18:16 |
<demon@tin> |
Synchronized php-1.29.0-wmf.19/includes/api/: No-op, cleaning up git history (duration: 00m 54s) |
[production] |
| 17:17 |
<demon@tin> |
Finished scap: no-op, cleaning up wmf.19 history (duration: 25m 07s) |
[production] |
| 16:51 |
<demon@tin> |
Started scap: no-op, cleaning up wmf.19 history |
[production] |
| 16:29 |
<demon@tin> |
Synchronized php-1.29.0-wmf.19/extensions/SyntaxHighlight_GeSHi/: no-op, cleaning up history (duration: 00m 44s) |
[production] |
| 15:32 |
<gehel> |
reimaging elstic2020 - T149006 |
[production] |
| 14:58 |
<marostegui> |
Deploy schema change dbstore1001 (s7 wikis) - T160390 |
[production] |
| 14:40 |
<marostegui> |
Deploy schema change db1033 (already depooled) (s7) - T160390 |
[production] |
| 14:13 |
<elukey> |
restart hadoop-hdfs-namenode on an1002 (Hadoop Master standby) to pick up new jvm settings |
[production] |
| 14:07 |
<elukey> |
restart hadoop-mapreduce-historyserver on an1001 to pick up the new jvm settings |
[production] |
| 14:02 |
<switchdc> |
(oblivian@sarin) Executing task switchdc.stages.t00_reduce_ttl(eqiad, codfw): Reduce the TTL of all the MediaWiki discovery records |
[production] |
| 14:01 |
<_joe_> |
running tests of the switchdc automation in dry-run mode |
[production] |
| 14:01 |
<switchdc> |
(oblivian@sarin) Executing task switchdc.stages.t00_disable_puppet(eqiad, codfw): Stop puppet execution on maintenance, jobqueues |
[production] |
| 12:52 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: [[gerrit:346966|Enable alternate RevisionSlider slider on beta]] BETA ONLY (duration: 00m 51s) |
[production] |
| 12:48 |
<bblack> |
banning cache_upload obj.http.Content-type ~ text/html |
[production] |
| 12:46 |
<bblack> |
banning cache_upload obj.http.Content-type == text/html |
[production] |
| 12:45 |
<bblack> |
banning cache_upload obj.http.Content-type ~ text |
[production] |
| 10:53 |
<elukey> |
increase Redis connection timeout manually (.3s -> .5s) on mw1306 as performance test - T125735 |
[production] |
| 09:22 |
<marostegui> |
Deploy schema change db1062 (already depooled) (s7) - T160390 |
[production] |
| 08:15 |
<moritzm> |
upgrade mw1262-mw1265 to HHVM 3.18.2 |
[production] |
| 07:58 |
<elukey> |
added "notifempty" to /etc/logrotate.d/nginx on cp1008, it should remove cronspam for access_pipe.log.1.gz |
[production] |