Two weeks should do it without feeling too rushed. If you decide to go to Palm Springs then an option that would save you the need to go through the urban sprawl of LA more than once would be to head to Palm Springs from the Cambria area by cutting inland to I 5, East on CA 138 through Palmdale to I 15 /215 /10. From Palm Springs head to San Diego and then back to LA to finish your trip.