Seven Eleven and Post Office
Seven Eleven will be the best place. You can find Seven Eleven stores almost every town, especially in Tokyo and the east part of Japan.
But, it's sometimes hard to find Seven Elevens in certain western areas like Shikoku island. In that case, find a post office. You can withdraw money with your foreign issued bank card there.