From my Haynes...
Primary Gear Endfloat : 0.0035" to 0.0065"
Idler Endfloat : 0.003" to 0.008"
Vizard et al:
For race engines go for about top limit.
My top tip:
Those thicker idler shims are expensive, but if you have access
to a milling machine you have another option...
You can close up the idler endfloat by machining a few thou off the
gasket face of the transmission face. Probably a good idea to
machine the other face by a few thou first to ensure that it is flat
and sits nicely on the machine when the gasket side is done.
NB: Just check that there is plenty of clearance for the "nose"
on the first motion shaft and the screws for the oil pump.
... and write down how much you took off for future reference.
If you have plenty of old shims available, you could even machine
the case slightly more than required. Put your old standard shims
on the mag-chuck of a surface grinder and make a selection of shims
of different thicknesses. The possibilities are almost endless...
I measure the thickness all the transmission gaskets I use and
have found that the standard type red gaskets are normally 0.031".
I bought one from MiniSport once that was about 0.010" thicker...
They must consider a tolerance of +/- 33% to be an acceptable
engineering tolerance.
Another idea:
The transmission case is dowelled to the gearbox to keep
the bearing [EDIT "bearingS", the one for the idler AND the
one for the first motion shaft /EDIT], in the 'box and the
bearing in the case aligned.
Sometimes if these are NOT inline, the transmission case
may need to be bored offset and a sleeve put in to correct it.
You really need engineering measuring gauges to check this
properly.
If bits are mixed and matched, like they are for most of us,
it could be just a set of adverse tolerances that are the problem
here.