put your lifters on a mirror or a piece of glass. They should spin like a top and have a little wobble due to a convex bottom. If they are flat or concave on the bottom, they're shot and a source of metal.
A non stock timing set can make metal too from normal use. Is the metal you found in the oil magnetic?