Scrapy Install Failure
Sytem Notes : OS X 10.11.1
python version: 2.7.6
When attempting to install Srapy (python based web spider library), I received the following error.
>>>pip install scrapy
... 1 error generated. Compile failed: command 'gcc' failed with exit status 1 creating var creating var/folders creating var/folders/fr creating var/folders/fr/xy474w2n7212f9pnc3vyf8nxv3qrhw creating var/folders/fr/xy474w2n7212f9pnc3vyf8nxv3qrhw/T cc -I/usr/include/libxml2 -I/usr/include/libxml2 -c /var/folders/fr/xy474w2n7212f9pnc3vyf8nxv3qrhw/T/xmlXPathInitRqETjP.c -o var/folders/fr/xy474w2n7212f9pnc3vyf8nxv3qrhw/T/xmlXPathInitRqETjP.o /var/folders/fr/xy474w2n7212f9pnc3vyf8nxv3qrhw/T/xmlXPathInitRqETjP.c:1:10: fatal error: 'libxml/xpath.h' file not found #include "libxml/xpath.h" Could not find function xmlCheckVersion in library libxml2. Is libxml2 installed?
However the helpful hint at the bottom corrected the issue.
Perhaps try: xcode-select --install
When in the Terminal I ran the suggested command.
>>>xcode-select --install
An Xcode installer started up and after following the prompt the Xcode command line tools completed successfully.
I tried the Srapy install again using pip and it was actually successful!
Leave a Reply