Absolutely. While freezing the herring may change the texture and appearance of the fish, you’re more than welcome to store them in your freezer. Just be sure to move the contents of your herring jar into a freezer-safe plastic container or zip-lock bag to avoid broken glass.