Well, I guess that's the way it goes.
I don't remember if I've seen Bayburn before - I've never played I&F so I'm not sure if it is related to that or if in WotN proper - sorry.
Really, the best way to find these places is to make sure you're thorough and go back through areas and talk to everyone again (multiple times even).
/C\/C\
|