I can't answer your specific question as to it being a good swap meet to go to or not, but here is a website on-line that may be of help. A better show may not always be decided by location or even how many folk attend. For example, Chickasha, in Ok, is limited to two events per year, but each has a different selection of year models they encourage for their swaps. Decatur, in Texas, can be similar, so that makes it more difficult to know how good a swap will actually be. There are many other event sites as this one on-line, so do a google search and type in Washington state car shows and events and you may find something even better than this example.
http://www.oldride.com/events/washington.html
My best advise is to ask on the h.a.m.b. or the rod group here, as rodders often seem to have a better handle on where the best shows and swaps are located.
Completely off topic note, but you mentioned Yakima and it brought back good childhood memories:
When I was a kid, my sister lived at Congdon Orchards up in Yakima. There was an actual castle on the grounds that was imported from England and i had free reign of the place as a 14 year old. That meant lots of barns to play about in the hay and a friskie farm dog (Mike) who was a Border Collie with tons of energy and love for a young boy as we romped in those barns, creek and fields of hops or apple orchards back then.
My brother-in-law was the mechanic for that orchard farm and raced jalopies at Sunnyvale (I believe that was the name of the circle track location there, but not for sure). Any rate, those old jalopies like his '39 Merc sedan had an awful lot to do with me loving vintage cars. Lots of Model A's and 40's vehicles racing back then. Most were from scrap yards and modified severely, but still fun to watch and root for as a kid.
Yup, those old cars they raced had an awful lot of influence on me as a kid to love vintage cars.
I guess you don't really know if Congdon's orchards still exists or not. Anyone else from Yakima know of them?