I imagine it is hard to date a Japanese man if you are not a Japanese woman because of cultural differences and language differences that would need to be overcome. Dating when you speak the same language and come from the same country is hard enough. One cultural difference from a Japanese man’s point of view is that they do not typically offer to pay the expenses for a first date.
One language difference is that “the Japanese expression suki desu is often translated to English as both ‘I love you’ and ‘I like you’. You can see how that might make a big difference, especially if you say it too early in the relationship!