Ok,
Figured it out!
Had to go into the database to do it. There are two table apm_parameters and apm_parameter_values.
The second one had the values in it including the SystemURL. I just updated the row and it worked.
I knew the wrong value I gave in, otherwise, I would have to join both tables and do some searching.
Its quite interesting, I changed the SystemURL value from http://mysite.com:8000 to http://mysite.com:8000/, an extra '/' at the end.
