Your lifters may not have been rotating. The cam will partially rotate a lifter with every stroke. This must happen or you will get cam wear. Check lifters in the bores and see if there were any burrs or issues there. Without a cam in the block, they should just glide right through the bore and out the other side. The lifter bores in an engine are CRITICAL to making sure a flat tappet cam lives.
