Try to get rid of rx (-rx) for group and others for each usr home directory.
it should be drwx------.
-r disable the list the files and folders;
-x disable search.
You can use umask to keep this default.
Don't really understand what you mean "FTP用户权限,只能下载不能LS". How user downloads?