Open frames are pretty easy to find at thrift stores and yard sales. You can also remove the glass from frames; and just use the frame. These are just a few of the frames I used for my gallery wall.
I personally love vintage wood frames, with decorative scrolls. Those can be hard to find at times. I have been lucky enough to find a few.