AWS always puts files created while the game is running (chat logs, screenshots, cache files, etc.) in My Documents/AfterWorld Survival/ folder and there's no option to change it. Cache files go into a Cache sub-folder, which also includes your in-game preferences such as window placement so if you change a lot of the default locations of windows you may want to leave the preferences.cache file. Once key bindings are saved, they'll probably be stored in the bindings.cache file but since they are reset at ever logout you can get rid of that file too (though I haven't seen it causing any problems).
The big problems are in the session-current.cache, session-previous.cache, and update.cache files so at a minimum you should delete those three when you start getting problems.