Sounds like you ground it too fine. Lapis/Ultramarine is a bulk pigment -- it's only blue in larger granules (think about bulk versus streak colors). And if you grind in too much pyrite, well, that's gray in powder as well. Plus, there are better sources of Lapis that contain a higher percentage of blue lazurite.