They are, to be fair from what I know of his views, the best description of his religious beliefs would be that of a pantheist. Meaning that he believed the universe itself was what others might call God. He even went so far as to say that if he believes in a god, the it is Spinoza's God, who is considered one of Pantheisms most vocal advocates.
Albert Einstein: "Your question [about God] is the most difficult in the world. It is not a question I can answer simply with yes or no. I am not an Atheist."
"science without religion is lame, religion without science is blind."
""Unquestionably! No one can read the Gospels without feeling the actual presence of Jesus. His personality pulsates in every word. No myth is filled with such life."
"Only the Church stood squarely across the path of Hitler's campaign for suppressing truth. I never had any special interest in the Church before, but now I feel a great affection and admiration because the Church alone has had the courage and persistence to stand for intellectual truth and moral freedom. I am forced thus to confess that what I once despised I now praise unreservedly."
"a person who is religiously enlightened appears to me to be one who has, to the best of his ability, liberated himself from the fetters of his selfish desires and is preoccupied with thoughts, feelings and aspirations to which he clings because of their super-personal value. It seems to me that what is important is the force of this superpersonal content ... regardless of whether any attempt is made to unite this content with a Divine Being, for otherwise it would not be possible to count Buddha and Spinoza as religious personalities. Accordingly a religious person is devout in the sense that he has no doubt of the significance of those super-personal objects and goals which neither require nor are capable of rational foundation ... In this sense religion is the age-old endeavor of mankind to become clearly and completely conscious of these values and goals and constantly to strengthen and extend their effect. If one conceives of religion and science according to these definitions then a conflict between them appears impossible. For science can only ascertain what is, but not what should be"