Did John Dillinger stay loyal to Billie?

Not really. But they weren't even together for very long. Dillinger did not see her as lifelong commitment, and attitudes to women were different during the 30s. It is not like the film Public Enemies where the relationship was emphasized so much.