'Mc@srddlZddlZddlZddlZddlZddlZddlZddlmZm Z m Z m Z m Z m Z mZmZddlmZddlmZmZmZmZmZmZmZmZmZddlmZddlmZddd d d d d dddddddgZ e j!Z"ddZ$ej%dej&Z'ej%dej&Z(de)fdYZ*e*Z+dZ,dZ-ej%dej&Z.ej%dej&Z/dZ0dZ1d Z2d!Z3e4d"Z5d#Z6d$Z7d%Z8d&Z9d'Z:d(Z;d)Z<d*Z=d+Z>d,Z?d-e j@fd.YZAdS(/iN(tmd5tcopytreet xmlrpclibturllibturllib2turlparset string_typest HTTPError(tInstallationError( tsplitexttrmtreet format_sizet display_patht backup_dirtaskt unpack_filetcreate_download_cache_foldertcache_download(tvcs(tloggertxmlrpclib_transporttget_file_contentturlopentis_urlt url_to_patht path_to_urlt path_to_url2tgeturltis_archive_filetunpack_vcs_linktunpack_file_urlt is_vcs_urlt is_file_urltunpack_http_urlc Cstj|}|r9|jdj}|dkrd|rd|jdrdtd||fn|dkr|jddd}|jdd}tj |}|r|jdd|jddd}nt j |}|jdr d|j d}n|}q9t |}t||jfSnyt|}|j}Wn7tk rtjd}td t|n X|j||fS( skGets the content of a file; it may be a filename, file: URL, or http: URL. Returns (location, content)itfilethttps6Requirements file %s references URL %s, which is localt:s\t/t|s$Could not open requirements file: %s(t _scheme_retsearchtgrouptlowert startswithRtsplittreplacet_url_slash_drive_retmatchRtunquotetlstripRRtreadtopentIOErrortsystexc_infotstrtclose( turlt comes_fromR/tschemetpathtresptftcontentte((s0/usr/lib/python2.7/dist-packages/pip/download.pyRs8 *     s^(http|https|file):s /*([a-z])\|t URLOpenercBseeZdZdZdZdZd d dZdedZ dZ dZ dd Z RS( sD pip's own URL helper that adds HTTP auth and proxy support cCstj|_dS(N(RtHTTPPasswordMgrWithDefaultRealmtpassman(tself((s0/usr/lib/python2.7/dist-packages/pip/download.pyt__init__FscCs|j|\}}}|dkrytj|j|}Wqtjk rtjd}|jdkrxn|j |}qXn|j |||}|S(s If the given url contains auth info or if a normal request gets a 401 response, an attempt is made to fetch the resource using basic HTTP auth. iiN( textract_credentialstNoneRRt get_requestRR5R6tcodet get_response(RDR9tusernametpasswordtresponseR@((s0/usr/lib/python2.7/dist-packages/pip/download.pyt__call__Is cCs2t|tr.tj|didd6}n|S(s Wraps the URL to retrieve to protects against "creative" interpretation of the RFC: http://bugs.python.org/issue8732 theaderstidentitysAccept-encoding(t isinstanceRRtRequest(RDR9((s0/usr/lib/python2.7/dist-packages/pip/download.pyRH]scCstj|\}}}}}|j|} |jjd|\} } | dkr|dkr|jrtjt d|}tjt j d}n|r|r|jj d|||n|jjd|\} } nt j |j} t j| } | j| S(s~ does the dirty work of actually getting the rsponse object using urllib2 and its HTTP auth builtins. s User for %s: s Password: N(RturlsplitRHRCtfind_user_passwordRGt promptingRtquotet raw_inputtgetpasst add_passwordRtHTTPBasicAuthHandlert build_openerR3(RDR9RKRLR;tnetlocR<tquerytfragtreqtstored_usernametstored_passwordt authhandlertopener((s0/usr/lib/python2.7/dist-packages/pip/download.pyRJfs  tcCsd||_|j|}|r`tji|d6|d6}tj|tj}tj|ndS(s Sets the proxy handler given the option passed on the command line. If an empty string is passed it looks at the HTTP_PROXY environment variable. R#tftpN(RUt get_proxyRt ProxyHandlerR[tCacheFTPHandlertinstall_opener(RDtproxystrRUtproxyt proxy_supportRc((s0/usr/lib/python2.7/dist-packages/pip/download.pytsetup|s  cCsLd|krH|jddd}d|kr>|jddS|dfSdS(Nt@iiR$(NN(trsplitR,RG(RDR\tuserinfo((s0/usr/lib/python2.7/dist-packages/pip/download.pytparse_credentialss    c Cst|tjr*tj|j}ntj|}|\}}}}}|j|\}} |dkr||ddfS| dkr|jr|j d|dd}d||f} t j t j | } n|j d|| fdd}tj |||||f} | || fS(s Extracts user/password from a url. Returns a tuple: (url-without-auth, username, password) s%s@RdisPassword for %s@%s: s%s:%s@N(RQRRRRRSt get_full_urlRqRGRUR-RRVRXt urlunsplit( RDR9tresultR;R\R<R]R^RKRLtpromptt target_url((s0/usr/lib/python2.7/dist-packages/pip/download.pyRFs  cCs|stjjdd}n|rd|kr|jdd\}}d|kro|jdd\}}n.|}d||f}tjtj|}d|||fS|SndSdS( s Get the proxy given the option passed on the command line. If an empty string is passed it looks at the HTTP_PROXY environment variable. t HTTP_PROXYRdRniR$sPassword for %s@%s: s%s:%s@%sN(tostenvirontgetR,RRVRXRG(RDRjt user_passwordt server_porttuserRLRu((s0/usr/lib/python2.7/dist-packages/pip/download.pyRfs  N( t__name__t __module__t__doc__RERNRHRGRJtTrueRmRqRFRf(((s0/usr/lib/python2.7/dist-packages/pip/download.pyRABs     cCsId|krtS|jdddj}|ddddgtjkS(s)Returns true if the name looks like a URLR$iiR#thttpsR"Re(tFalseR,R*Rt all_schemes(tnameR;((s0/usr/lib/python2.7/dist-packages/pip/download.pyRs cCsz|jdstd||tdjd}tj|}tj|rl|dd|d}n d|}|S(s( Convert a file: URL to a path. sfile:s4You can only turn file: urls into filenames (not %r)R%iR$i(R+tAssertionErrortlenR1RR0t _url_drive_reR/(R9R<((s0/usr/lib/python2.7/dist-packages/pip/download.pyRs  s ^([a-z]):s ^([a-z])[:|]cCstjjtjj|}tj|rF|dd|d}ntj|}|jtjj d}|j d}d|S(sI Convert a path to a file: URL. The path will be made absolute. iR&iR%sfile:///( RxR<tnormcasetabspatht _drive_reR/RRVR-tsepR1(R<R9((s0/usr/lib/python2.7/dist-packages/pip/download.pyRscCstjjtjj|}tjj|\}}|jtjj}djg|D]}tj |^qX}|s|j d}nd||S(sh Convert a path to a file: URL. The path will be made absolute and have quoted path parts. R%sfile:///( RxR<tnormpathRt splitdriveR,RtjoinRRVR1(R<tdrivetfilepathtpartR9((s0/usr/lib/python2.7/dist-packages/pip/download.pyRs+cCsI|j}|jdd\}}|jdr7|Sd||fSdS(s6 Use instead of urllib.addinfourl.geturl(), which appears to have some issues with dropping the double slash for certain schemes (e.g. file://). This implementation is probably over-eager, as it always restores '://' if it is missing, and it appears some url schemata aren't always followed by '//' after the colon, but as far as I know pip doesn't need any of those. The URI RFC can be found at: http://tools.ietf.org/html/rfc1630 This function assumes that scheme:/foo/bar is the same as scheme:///foo/bar R$is//s%s://%sN(RR,R+(t urllib2_respR9R;trest((s0/usr/lib/python2.7/dist-packages/pip/download.pyRs  cCs0d}t|dj}||kr,tStS( s9Return True if `name` is a considered as an archive file.s.zips.tar.gzs.tar.bz2s.tgzs.tars .pybundlei(s.zips.tar.gzs.tar.bz2s.tgzs.tars .pybundle(R R*RR(Rtarchivestext((s0/usr/lib/python2.7/dist-packages/pip/download.pyRs  cCs3t|}|r"|j|n |j|dS(N(t_get_used_vcs_backendtexporttunpack(tlinktlocationt only_downloadt vcs_backend((s0/usr/lib/python2.7/dist-packages/pip/download.pyRs cCszt|j}tj|d}tjj|rctjj|rSt|nt||nt ||||dS(Ni( RR9t mimetypest guess_typeRxR<tisdirR RR(RRtsourcet content_type((s0/usr/lib/python2.7/dist-packages/pip/download.pyR's cCs=x6tjD]+}|j|jkr ||j}|Sq WdS(N(RtbackendsR;tschemesR9(RtbackendR((s0/usr/lib/python2.7/dist-packages/pip/download.pyR3scCstt|S(N(tboolR(R((s0/usr/lib/python2.7/dist-packages/pip/download.pyR:scCs|jjjdS(Nsfile:(R9R*R+(R((s0/usr/lib/python2.7/dist-packages/pip/download.pyR >scCsO|j}||jkrKtjd|||jftd|ndS(NsCMD5 hash of the package %s (%s) doesn't match the expected hash %s!sBad MD5 hash for package %s(t hexdigesttmd5_hashRtfatalR(t download_hashR((s0/usr/lib/python2.7/dist-packages/pip/download.pyt _check_md5Bs   cCsRt}t|d}x)|jd}|s4Pn|j|q|j|S(Ntrbi(RR3R2tupdateR8(t target_fileRRtfptchunk((s0/usr/lib/python2.7/dist-packages/pip/download.pyt_get_md5_from_fileJs  c Cst|d}d}|jr*t}nyt|jd}Wnttfk rcd}nXd}|dkpz| }|j}z|r|rt j d|t |fqt j d|nt j d|t j d |x|jd } | sPn|t| 7}|re|s=t jd t |qet jd d ||t |fn|jr~|j| n|j| q|jWd|rt jdt |nX|S(Ntwbscontent-lengthii(isDownloading %s (%s): sDownloading %s (unknown size): sDownloading %ssDownloading from URL %sis%ss %3i%% %sids %s downloadedi@(R3RGRRtinttinfot ValueErrortKeyErrortshow_urlRtstart_progressR tnotifytdebugR2Rt show_progressRtwriteR8t end_progress( R=Rt temp_locationRRt total_lengtht downloadedRRR((s0/usr/lib/python2.7/dist-packages/pip/download.pyt _download_urlVsD     ( cCs%t}tjj||j}tjj|rtdt|d }|dkr^t}q|dkrt j dt|tj |q|dkrt |}t j dt|t|ft j||qn|r!t j||t jd8_t jdt|ndS( Ns/The file %s exists. (i)gnore, (w)ipe, (b)ackup titwtbs Deleting %ssBacking up %s to %sisSaved %s(RRR(RRxR<RtfilenametexistsRR RRtwarntremoveR tshutiltmovetcopytindentR(RRRRRtdownload_locationRMt dest_file((s0/usr/lib/python2.7/dist-packages/pip/download.pyt _copy_files&      cCstjdd}|jjddd}d}d}|rtjj|tj |d}tjj |st |qn|rtjj |rtjj |drt |d}|jj} |j|jrt||}n|} tjd|nt||} | jd } |j} t| d} | srtj| } | rr| | 7} qrn| r|jt| krtjjt| d} | r| | 7} qntjj|| } t| || }|jrt||n|rt| || |nt| || ||rT|| krTt || | n|dkrptj!| ntj"|dS( Ns-unpackspip-t#iiRds .content-typesUsing download cache from %ss content-type(#ttempfiletmkdtempR9R,RGRxR<RRRVRRRR3R2tstripR8RRRRt_get_response_from_urlRRR Rtguess_extensionRRRRRRtunlinktrmdir(RRtdownload_cacheRttemp_dirRvRRRRRR=RR((s0/usr/lib/python2.7/dist-packages/pip/download.pyR!sV      cCsyt|}Wn{tjk rStjd}tjd|j|fn;tk rtjd}tjd||fnX|S(NisHTTP error %s while getting %ssError %s while getting %s( RRRR5R6RRRIR4(RvRR=R@((s0/usr/lib/python2.7/dist-packages/pip/download.pyRs tUrllib2HeadRequestcBseZdZRS(cCsdS(NtHEAD((RD((s0/usr/lib/python2.7/dist-packages/pip/download.pyt get_methods(R~RR(((s0/usr/lib/python2.7/dist-packages/pip/download.pyRs(BtreRXR5RxRRRtpip.backwardcompatRRRRRRRRtpip.exceptionsRtpip.utilR R R R R RRRRtpip.vcsRtpip.logRt__all__t TransportRRGRtcompiletIR'R.tobjectRARRRRRRRRRRRRRRR RRRRR!RRRR(((s0/usr/lib/python2.7/dist-packages/pip/download.pytsR       :@     $           +  0