Grab it when you can
Why pass up something of value to you when you have the opportunity to pick it up? People who worry that the price of gold or silver might fall after they bought it seem to be doing this.
Don't worry that you have traded FRNs for it, and that the price might be lower tomorrow; be glad you now have it. If the price falls later, get more and be glad you got a good deal.
And, if you don't want to have silver or gold on hand, don't feel I am telling you that you must. It is a part of the survival strategy, not the whole picture. I prefer to cover as many bases as I can- you do what you want.