When sat in there are you looking at them all the time? That could be making them nervous ( or not helping anyway), I'd sit in there with a book, newspaper, reading aloud, not moving anything fast.
Put a food bowl somewhere and each time you are in there move it nearer, but ignoring them as they approach it.
My thoughts anyway.