Is there significant difference between pip and conda installations?

Is the recommendation to use anaconda apply only for compilation ?

Or is there any difference in BLAS or other libraries in pip binary distribution ?

Yeah, conda is recommended when building from source. The pip and conda binaries should be the same.