 When the speaker states, ""Simply I credit her false-speaking tongue"" he is accepting her lies.The speaker and his lover are hiding their transgression by not bringing to light the issue that they are insecure about, i.e., ""Therefore I lie with her and she with me, and in our faults by lies we flattered be".