Will I be able to access my domain name with or without the "www" prefix?

Yes. You can access your web site by either the URL "http://www.my-domain.com" or "http://my-domain.com". The former is much more common.