I finally got Wordpress all installed. (In a directory inside public_html). Now if I try to view the site, just the sample page I get an error 403 - Forbidden
You don't have permission to access /blog/?page_id=2 on this server.
Permissions are set at 755
Permissions really should be set at 644 (it's more secure then 755). Also did you check in WordPress to make sure the page is set for everyone to view?
Oh okay, I'm change the permissions, and your answer suggests that isn't the issue. I'm a complete newbie as to Wordpress, although the permissions are set to public for the page, I think yeah the problem must be there then. At least I know where to focus to fix it.
It seems like you didn't upload all the files required for Wordpress. In the blog directory an index.php and a .htaccess file are missing (possibly others too). Maybe try to remove/re-add the files?