I did pause to pay a little attention to the secretary

I did think the secretary was a bit suspicious because she did get more screen time than the others at the beginning, but like you I also suspected the Englishwoman referred to Lady Smallwood instead.

Mary probably wanted a normal life but there'll always be a part of her that lived for danger.