I deleted the one photo in my profile and all my likes - and cleaned up in the accounts I followed - but I'll still see if I can write a personal client that fetches the photos of people I am following and stores any "likes" in my own database.

After that - or before, if Instagram insist on changing their rules - I'll probably delete it altogether.