Dear Casey, in Český Krumlov you will find something here: http://www.zamek-ceskykrumlov.eu/to.../castle-museum/
. (look at 8.10 Armoury). Karlovy vary is a town of spas, glassworks, film festival and Russian tourists. Weapons would be in the castles of West Bohemia, I do not know if there is something directly in the city.
In Prague you could also visit Military History Museum and Náprstkovo museum (http://www.nm.cz/Naprstek-Museum/
). Nevertheless, as far as weapons in Náprstek Museum are concerned, there is only stable exhibition of American Indians ans Pacific weapons. Others, like e.g. Africa, are in deposits and they display it from time to time ----