How do i determine Key Signature?

In this song i have...there is Bb and Eb. However, at some parts i
don't play those notes i just play B and E. Help me please! How would
i know the key signature?