I think I've heard both of the following two sentences:
That's a great idea.
That's great idea.
Are they both correct? Do they have any differences?
The first one is correct.
Usually in English, if you have a singular noun, you need an article, either "a" or "the", or a possessive (like "Bob's great idea") or the word "one".