I spent 19 days doing a clockwise tour of Noway last year ['03], starting and ending in Kristiansand.
I would recommend you stay in the fjord region and forget Lillehammer. There are plenty of gravel tracks in the [Lillihammer] area but I found them to be mostly through forests and a little boring after a while. Don't get the idea that you'll be blazing a trail on these gravel tracks, you could have to wait to overtake a 10 wheel crane - I did.
Whilst the area is great and I'm sure you'll wonderful time if you do go, Telemark/Lillihammer do suffer in comparison to the west of Norway.
If you want loads more info on Norway you could do much worse than http://www.ukgser.com/forums/
and do a search in the travel section on Norway.
Don't speed in Norway. 60mph in a 50mph zone [10mph over] cost me exactly £200.
My photos from last year are at http://www.boxer.smugmug.com
Below is part of a post I made on UKGSer.
Here's a couple of high points of my trip that may be you'd like to try, but the truth is whatever you plan, whatever road you take, you can't go wrong. Michelin map 711 National is good for planning.
I went via Newcastle/Kristiansand and traveled up E39 to Stavanger, jumped the ferry to Tau and stayed in Hjelmeland.
From here you can do Prekestolen. Needs one day [I didn't because of time/ poor planning]. Also, the ferry from Forsand up the Lysefjorden to Lysebotn [passing under Prekestolen] is utterly breathtaking as is the ride out of Lysebotn. Return to Hjelmeland clockwise on 45 taking ferry from Lauvvik to Oanes.
It's a long day, but one you will not forget - promise. You may also be worrying that the best of you holiday is now over and it surely must decline from here on in, but no. As hard as it may be to believe it's just going to carry on and on like this for the next 2 weeks.
We stayed for 4 nights in Loen, about 50 miles south of Alesmund.
Based here we did 3 glaciers needing 2 days. These glaciers are every close to Loen and are good for giving you a break from riding.
From Loen the following route is possible and is unreservedly recommended.
Loen to Geiranger via the gravel road Gamle Strynefjellsveg [15?], before reaching Geiranger detour along a gravel road to Dalsnibba. From here Geiranger is visible 1500M down and 5miles distant. Leave Geiranger and catch the ferry at Eiddal and head towards Andalsnes over the Trollstigveien.