Since you aren't familiar with programming, if you are really interested in games, I would start with XNA and C#. In terms of learning programming the language isn't as important as the concepts. The concepts are the same regardless of the programming language.
A good book that uses C# for making games is "C# Game Programming For Serious Game Creation". Though the book uses OpenGL instead of XNA, it is still a pretty good book. It gives a history of C# and covers game programming terminology but it doesn't teach a lot of basic programming concepts, those are a prerequisite for the book.