If Atheists believe in evidence and not faith then...?

You didn't ask about Jesus, you asked about Alexander the Great and Julius Ceasar. I believe there is good evidence for their existence because there are multiple accounts that can be traced back to well known contemporaneous sources, describing the events of their lives. And all of those accounts are in general accordance.