Stop by a TRAVELEX!
There are many Travelex stalls in Japan, usually at famous sightseeing areas or major stations. For example, near Kaminari-mon in Asakusa, one of the famous sightseeing spots in Tokyo, there is a small Travelex stall. There is also another one in Yokohama station. Look out for a blue and red sign!