9Mc@s1dZddlZddlZddlZddlZddlZddlZddlZddlZyddl Z Wne k re Z nXyddl Z ddl Z Wne k re Z nXddlmZddlmZmZddlmZddlmZmZmZddlmZmZddlmZdd lmZej Z iZ!d Z"d Z#d Z$d Z%e%dej&fdYZ'dej&fdYZ(dee)fdYZ*de)fdYZ+e+Z,dZ-de*fdYZ.dej&e*fdYZ/dS(s UNIX Process management. Do NOT use this module directly - use reactor.spawnProcess() instead. Maintainer: Itamar Shtull-Trauring iN(t implements(tlogtfailure(t switchUID(tfdesctabstractterror(tCONNECTION_LOSTtCONNECTION_DONE(t BaseProcess(tIProcessTransportcCs%xtjD]}|jq WdS(s( Reap all registered processes. N(treapProcessHandlerstvaluest reapProcess(tprocess((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pytreapAllProcesses)scCs|tkrtdnytj|tj\}}Wn(tjd|tjd}nX|r{|j |n |t| POLLOUT (writable in select), write pipe is not completely empty => POLLIN (readable in select), write pipe's reader closed => POLLIN|POLLERR (readable and writable in select) That's what this funky code is for. If linux was not broken, this function could be simply "return CONNECTION_LOST". BUG: We call select no matter what the reactor. If the reactor is pollreactor, and the fd is > 1024, this will fail. (only occurs on broken versions of linux, though). iN(R7R"R1R RRC(R;R1R%R&tx((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pytdoReads  ' cCs=tj|jtjj|||jj|j|dS(s= See abstract.FileDescriptor.connectionLost. N( Rt setBlockingR1RR,tconnectionLostR/tchildConnectionLostR0(R;treason((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRGs( t__name__t __module__t__doc__t connectedticR#R7R-R5RBRRERG(((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyR+js     t ProcessReadercBsSeZdZdZdZdZdZdZdZdZ dZ RS( sx ProcessReader I am a selectable representation of a process's output pipe, such as stdout and stderr. icCsItjj||tj|||_||_||_|jdS(sA Initialize, specifying a process to connect to. N( RR,R-RR.R/R0R1R:(R;R<R/R0R5((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyR-s     cCs|jS(s= Return the fileno() of my process's stderr. (R1(R;((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyR5scCs|dksttS(Nt(tAssertionErrorR(R;R@((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRBscCstj|j|jS(s@ This is called when the pipe becomes readable. (Rt readFromFDR1t dataReceived(R;((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyREscCs|jj|j|dS(N(R/tchildDataReceivedR0(R;R@((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRSscCsO|jrK|j rKd|_|j|jjd|jtjtndS(Nii( RMt disconnectingRCR<t callLaterRGRtFailureR(R;((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pytloseConnections   cCs-tjj|||jj|j|dS(sk Close my end of the pipe, signal the Process (which signals the ProcessProtocol). N(RR,RGR/RHR0(R;RI((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRG s( RJRKRLRMR-R5RBRERSRXRG(((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyROs     t _BaseProcesscBsbeZdZd Zd ZdZdZdZdZ dZ dZ dZ dZ RS( s0 Base class for Process and PTYProcess. cCsyZy"tj|jtj\}}Wn1tk rX}|jtjkrRd}qYnXWn+tj d|jtj d}nX|r|j |t ||ndS(s Try to reap a process (without blocking) via waitpid. This is called when sigchild is caught or a Process object loses its "connection" (stdout is closed) This ought to result in reaping all zombie processes, since it will be called twice as often as it needs to be. (Unfortunately, this is a slightly experimental approach, since UNIX has no way to be really sure that your process is going to go away w/o blocking. I don't want to block.) sFailed to reap %d:N( RRRRR9terrnotECHILDRRRRRR(R;RRte((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyR s "     cCsfd}}tj|r+tj|}ntj|}|sF|rYtj|||Stj|S(N(RRt WIFEXITEDt WEXITSTATUStWTERMSIGRtProcessTerminatedt ProcessDone(R;RtexitCodetsig((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyt _getReason<s  cCsW|dkr%ttd|f}n|jdkr@tntj|j|dS( s* Send the given signal C{signalID} to the process. It'll translate a few signals ('HUP', 'STOP', 'INT', 'KILL', 'TERM') from a string representation to its int value, otherwise it'll pass directly the value provided @type signalID: C{str} or C{int} tHUPtSTOPtINTtKILLtTERMsSIG%sN(ReRfRgRhRi(tgetattrtsignalRRtProcessExitedAlreadyRtkill(R;tsignalID((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyt signalProcessGs  cCsOxHtdtjD]4}tj|tjkrtj|tjqqWdS(Ni(trangeRktNSIGt getsignaltSIG_IGNtSIG_DFL(R;t signalnum((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyt_resetSignalDispositionWsc Ks>|d k p|d k }|rtj} tj} tj} tj} |d krc| }n|d krx| }ntjdtjdntj } tj ytj |_ WnF|rtj | | tj| | n| rtjnnX|j dkry=tjd |j||j|||||||Wny~tjdd}|jd|t|dt|ftjd||jx!tdD]}tj|qWWqqXnXtjdn|rtj | | tj| | n| r1tjnd |_d S( s Fork and then exec sub-process. @param path: the path where to run the new process. @type path: C{str} @param uid: if defined, the uid used to run the new process. @type uid: C{int} @param gid: if defined, the gid used to run the new process. @type gid: C{int} @param executable: the executable to run in a new process. @type executable: C{str} @param args: arguments used to create the new process. @type args: C{list}. @param environment: environment used for the new process. @type environment: C{dict}. @param kwargs: keyword arguments to L{_setupChild} method. iiR&s&Upon execvpe %s %s in environment %s :sid %stfileiiiN(RRtgetegidtgetgidtgeteuidtgetuidtsetuidtsetgidtgct isenabledtdisabletforkRtsetregidtsetreuidtenabletsystsettracet _setupChildt _execChildtfdopenRtstrtidt tracebackt print_exctflushRpR$t_exitR(R;tpathtuidtgidt executabletargst environmenttkwargst settingUIDtcuregidtcurrgidtcureuidtcurruidtcollectorEnabledtstderrR1((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyt_forkcs`                   cOs tdS(sB Setup the child process. Override in subclasses. N(tNotImplementedError(R;RR((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRscCsC|rtj|n|r,t||ntj|||dS(s? The exec() which is done in the forked child. N(RtchdirRtexecvpe(R;RRRRRRR((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRs cCsd|jj|j|jfS(s5 String representation of a process. s<%s pid=%s status=%s>(t __class__RJRR(R;((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyt__repr__s N(RJRKRLRRRR RdRoRvRRRR(((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRYs   Y  t _FDDetectorcBseeZdZejZejZeZdZdZ dZ dZ dZ dZ dZRS(sy This class contains the logic necessary to decide which of the available system techniques should be used to detect the open file descriptors for the current process. The chosen technique gets monkey-patched into the _listOpenFDs method of this class so that the detection only needs to occur once. @ivars listdir: The implementation of listdir to use. This gets overwritten by the test cases. @ivars getpid: The implementation of getpid to use, returns the PID of the running process. @ivars openfile: The implementation of open() to use, by default the Python builtin. cCs|j|_|jS(sF Figure out which implementation to use, then run it. (t_getImplementationt _listOpenFDs(R;((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRscCsy+|jd|jr#|jS|jSWnYy%|jd|jf|jSWqy|j|jSWq|jSXqXnXdS(s Check if /dev/fd works, if so, use that. Otherwise, check if /proc/%d/fd exists, if so use that. Otherwise, ask resource.getrlimit, if that throws an exception, then fallback to _fallbackFDImplementation. s/dev/fds /proc/%d/fdN(tlistdirt_checkDevFDSanityt_devFDImplementationt_fallbackFDImplementationtgetpidt_procFDImplementationt_resourceFDImplementation(R;((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRs      cCs:|jd}|jdd}|jd}||kS(s Returns true iff opening a file modifies the fds visible in /dev/fd, as it should on a sane platform. s/dev/fds /dev/nullR%(Rtopenfile(R;tstarttfptend((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyR scCs2d}gtj|D]}t|^q}|S(s Simple implementation for systems where /dev/fd actually works. See: http://www.freebsd.org/cgi/man.cgi?fdescfs s/dev/fd(RRtint(R;tdnameR1tresult((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRs(cCs9dtjf}gtj|D]}t|^q#S(sk Simple implementation for systems where /proc/pid/fd exists (we assume it works). s /proc/%d/fd(RRRR(R;RR1((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyR"scCsEddl}|j|jdd}|dkr;d}nt|S(s Fallback implementation where the resource module can inform us about how many FDs we can expect. Note that on OS-X we expect to be using the /dev/fd implementation. iNii(tresourcet getrlimitt RLIMIT_NOFILEtxrange(R;Rtmaxfds((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyR+s    cCsd}t|S(sn Fallback-fallback implementation where we just assume that we need to close 256 FDs. i(R(R;R((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyR;s(RJRKRLRRRtopenRRRRRRRR(((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRs     cCs tjS(sZ Use the global detector object to figure out which FD implementation to use. (tdetectorR(((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRFstProcesscBseZdZeeeZeZdZdZ e Z e ZddddZdZdZdZdZdZdZd Zd Zd Zd Zd ZdZdZdZdZdZRS(s An operating-system Process. This represents an operating-system process with arbitrary input/output pipes connected to it. Those pipes may represent standard input, standard output, and standard error, or any other file descriptor. On UNIX, this is implemented using fork(), exec(), pipe() and fcntl(). These calls may not exist elsewhere so this code is not cross-platform. (also, windows can only select on sockets...) ic  s |s9d| jkstd| jks9tntj||i|_i} | dkridd6dd6dd6} n|j} | rdG| GHngfd} i} y=x| jD]\}}| rd|G|GHn|dkr4| \}}| rd ||fGHn|| |<|| |n|rt||jkrtq>nytj|Wq>q>Xq>W|r|dI|IJn|j }|j x|D]}||}||kr |r|d|IJnt j |q||jkrtj |} |rJ|d|| fIJntj|x6|jD]%\} } | |krd| || &1' would correspond to an fdmap of {0:0, 1:1, 2:1}. 'command >foo.txt' would be {0:0, 1:os.open('foo.txt'), 2:2}. This is accomplished in two steps:: 1. close all file descriptors that aren't values of fdmap. This means 0 .. maxfds (or just the open fds within that range, if the platform supports '/proc//fd'). 2. for each childFD:: - if fdmap[childFD] == childFD, the descriptor is already in place. Make sure the CLOEXEC flag is not set, then delete the entry from fdmap. - if childFD is in fdmap.values(), then the target descriptor is busy. Use os.dup() to move it elsewhere, update all fdmap[childFD] items that point to it, then close the original. Then fall through to the next case. - now fdmap[childFD] is not in fdmap.values(), and is free. Use os.dup2() to move it to the right place, then close the original. sstarting _setupChild Rs%d already in placesos.dup(%d) -> %dsos.dup2(%d,%d)toldN(t debug_childRRRR RR5RR$tkeystsortRt_unsetCloseOnExectdupRtdup2tappendRv( R;RRterrfdtdestListR1t childlisttchildRt newtargettctpR((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRs\                cCs|j|j|dS(N(RR(R;RR@((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyt writeToChild.scCs'||jkr#|j|jndS(N(RRX(R;R((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyt closeChildFD1scCs:x3|jjD]"}t|tr|jqqWdS(N(Rt itervaluest isinstanceRORC(R;R((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pytpauseProducing9scCs:x3|jjD]"}t|tr|jqqWdS(N(RRRROR:(R;R((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pytresumeProducing>scCs|jddS(sD Call this to close standard input on this process. iN(R(R;((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyt closeStdinDscCs|jddS(Ni(R(R;((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyt closeStdoutJscCs|jddS(Ni(R(R;((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyt closeStderrMscCs"|j|j|jdS(N(RRR(R;((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRXPs  cCs*d|jkr&|jdj|ndS(s Call this to write to standard input on this process. NOTE: This will silently lose data if there is no standard input. iN(RR(R;R@((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRUscCs7d|jkr)|jdj||n |jdS(s Call this to register producer for standard input. If there is no standard input producer.stopProducing() will be called immediately. iN(RtregisterProducert stopProducing(R;tproducert streaming((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyR^scCs'd|jkr#|jdjndS(s= Call this to unregister producer for standard input.iN(RtunregisterProducer(R;((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRjscCs*d|jkr&|jdj|ndS(s Call this to write to standard input on this process. NOTE: This will silently lose data if there is no standard input. iN(Rt writeSequence(R;tseq((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRpscCs|jj||dS(N(RRT(R;R0R@((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRTzscCsZtj|j|j|j|=y|jj|WntjnX|jdS(N( RR$RR5RRHRRtmaybeCallProcessEnded(R;RRI((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRH~s cCs5|jr dS|js$|jdStj|dS(N(Rt lostProcessR RYR(R;((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRs    N( RJRKRLRR R#RRRRRR+RRORR-RRRRRRRRRXRRRRRTRHR(((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRNs2  e a           t PTYProcesscBseZdZeedZd Zd d d dZdZ dZ dZ dZ dZ dZd Zd Zd ZRS( s< An operating-system Process that uses PTY support. ic Cstdkr1t| ttf r1tdntjj||t j||t| ttfr{| \} } } n!tj \} } t j | } y,|j ||||||d| d| Wn<t| ttfst j| t j| nnXt j| tj| | |_|jd|_d|_y|jj|WntjnXt|j|dS(s  Spawn an operating-system process. This is where the hard work of disconnecting all currently open files / forking / executing the new process happens. (This is executed automatically when a Process is instantiated.) This will also run the subprocess as a given user ID and group ID, if specified. (Implementation Note: this doesn't support all the arcane nuances of setXXuid on UNIX: it will assume that either your effective or real UID is 0.) s:cannot use PTYProcess on platforms without the pty module.tmasterfdtslavefdiiN(tptyRRttupletlistRRR,R-RYtopenptyRtttynameRR$RR.R1R:RMRRRRRRR( R;R<RRRRRRRtusePTYRRR((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyR-s8"        cCsetj|ttdry tjdtjtjB}Wntk rOqXytj |tj dWnnXtj|ntj ttdrtj |tj dnx0t dD]"}||krtj|qqWtj|dtj|dtj|dx;tD]0}|dkr#ytj|WqSqSXq#q#W|jd S( sE Setup child process after fork() but before exec(). t TIOCNOTTYs/dev/ttyRPt TIOCSCTTYiiiiN(RR$thasattrttermiosRtO_RDWRtO_NOCTTYR9tfcntltioctlRtsetsidRRpRRRv(R;RRR1((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRs6       cCsdS(N((R;((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRscCsdS(N((R;((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRscCsdS(N((R;((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRscstjjfdS(sM Called when my standard output stream is ready for reading. csjjd|S(Ni(RRT(R@(R;(s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyt s(RRRR1(R;((R;s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyREscCs|jS(sR This returns the file number of standard output on this process. (R1(R;((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyR5 scCs#|jdkrtj|ndS(Ni(RRYR(R;((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRscCs@tjj||tj|j|jd7_|jdS(sU I call this to clean up when one or all of my connections has died. iN(RR,RGRR$R1RR(R;RI((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRGscCstj|j|S(s6 Write some data to the open process. (RR>R1(R;R@((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRB&sN(RJRKRLRR RRRR-RRRRRER5RRGRB(((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyRs 0 *      (0RLR~RRR2RR RkRZRt ImportErrorRRRtzope.interfaceRttwisted.pythonRRttwisted.python.utilRttwisted.internetRRRttwisted.internet.mainRRttwisted.internet._baseprocessR ttwisted.internet.interfacesR RlR RRRR*R,R+ROtobjectRYRRRRR(((s</usr/lib/python2.7/dist-packages/twisted/internet/process.pyt s@`        r:n  K