Does Punctuation Matter to Google or SEO?

Nope. Except for @, -, and ‘. @ is nice to find someone’s email address. – and ‘ are less helpful because Google goes ahead and searches for the word with the – or ‘ but also without them (substituting a space, or for – it combines the word).