Art doesn't have to be expensive, though I do recommend buying art from the artist. Visiting an art fair, or art village, it is a great way to get exposed to a range of artists. If you can, always buy art directly from an artist. You know they are getting the most for their time and talent, and you get the best price.
You could also look for art at thrift stores which may lead to varying degrees of success, however buying frames could prove more useful. Don't forget you can always paint a frame.
Filling an entire house or apartment with art when your on a budget likely means you can't always purchase pieces from artist, sometimes you have to get creative.
One suggestion is to find a wall calendar with images you like, cut them out and frame them. To make them feel more finished add a pre-cut matte from a craft store.
Or check out Pinterest there are dozens of simple art how-to's just waiting to be explored.
(Click any image below for more info.)