If you look inside your index.php file there are some fields you can fill out for a little extra speed. Look for the following and fill in the values:
// set these values here for a small speed increase! :)
$database_type = "";
$database_server = "";
$database_user = "";
$database_password = "";
$dbase = "";
$table_prefix = "";
$base_url = "";
$base_path = "";
Also ask what the average server load of the server is that you’re currently hosted on. A lot of shared hosts over load their servers by squeezing too many accounts onto one server.
Finally, I’m not sure if this is my imagination or not, but I seem to get better (i.e. faster) results with php 4.x and apache 1.3.33 than I do with php 4.x and apache 2.x.
I think also a lot of the speed and overhead issues will/have been addressed in the next release.