Thanks for the Apache link. That's the site I've been using for information.
The troubleshooting docs aren't that good. I followed the install guide exactly
up to the point where it said "....and it should now all be working fine" but
didn't say where to start if it spits out weird error messages instead

Check your PM, wrote more about it there.