I actually just wrote a post today on my business blog regarding 10 things you should do every time you install WP (link). There are also several posts about must-have plugins, etc.
If you don't want to deal with coding/CSS, I highly recommend the Weaver II theme. It's a little overwhelming because there are options for EVERYTHING, but it's all checkboxes (link). No coding required. And if you like it and decide to upgrade to Weaver II Pro, it's only $25.
Hope that helps! Once you get used to WP, you'll be so glad you switched. :)