Upvote:3
You must visit the customs office at your departure airport in Japan; they will just collect the receipts, you'll have nothing to pay.
http://tax-freeshop.jnto.go.jp/eng/shopping-guide.php
- Go through the procedure at the airport
Submit the Proof of Tax-Free Purchase attached to your passport when leaving the country
(Reminder: customs ≠ immigration.)