Xc@`sbddlmZmZmZddlZddlZddlZddlZddlZddl m Z ddl Z ddl mZe jjdddgZejdZejejkrejejnejZd Ze ded Zdd ZeZd Zd Z e!Z"e"ddddZ#dZ$de!fdYZ%dS(i(tabsolute_importtprint_functiontdivisionN(tcontextmanager(tconfigiiistheano.gof.compilelockcC`s$tddddddtdS(s> Delete the compilation lock if someone else has it. tmin_waititmax_waitgMbP?ttimeoutN(tget_lockt release_lock(((s6/tmp/pip-build-X4mzal/theano/theano/gof/compilelock.pyt force_unlocksck`s)td||dV|s%tndS(Ntlock_dir(RR (R t keep_locktkw((s6/tmp/pip-build-X4mzal/theano/theano/gof/compilelock.pytlock_ctx%scK`s|d kr'tjjtjd}nttdsxdt_ttdsZt t_ n|t_ t tj t_ nB|tj krtjdkst|t_ t tj t_ ntj rtjdkr ttj |tjt jtj tjt_qtjd krExtjdkr5tqWtdntj}|tjtjjdkrtjjtj d}tjdt|t||t_qntjd 7_d S( s Obtain lock on compilation directory. Parameters ---------- kw Additional arguments to be forwarded to the `lock` function when acquiring the lock. Notes ----- We can lock only on 1 directory at a time. R tn_lockitlock_is_enabledsUFor some unknow reason, the lock was already taken, but no start time was registered.itlocksRefreshing lock %siN(tNonetostpathtjoinRt compiledirthasattrRRtTrueRR tUnlockertunlockertAssertionErrorRtatexittregistertunlockttimet start_timeR t ExceptiontcompileRt_loggertinfotstrt refresh_lock(R R tnowtlockpath((s6/tmp/pip-build-X4mzal/theano/theano/gof/compilelock.pyt _get_lock0s8         cC`s_tjd8_tjdks$ttjr[tjdkr[dt_tjjdtndS(s1 Release lock on compilation directory. iitforceN( RRRRRR RRtFalse(((s6/tmp/pip-build-X4mzal/theano/theano/gof/compilelock.pyR qs  cC`s |t_dS(s0 Enable or disable the lock on the compilation directory (which is enabled by default). Disabling may make compilation slightly faster (but is not recommended for parallel execution). Parameters ---------- use_lock : bool Whether to use the compilation lock or not. N(RR(tuse_lock((s6/tmp/pip-build-X4mzal/theano/theano/gof/compilelock.pytset_lock_status~s icC`s|dkrtjj}n|dkr4|d}n|tkrOtjj}ntjj|}tjj |sytj |Wqt k rt j dqXntjj |sttjj|d}tj}|dk}d} d} xtryWd} t j } t} xtjj |ryt|}|jdj}WdQXy|jdd}Wntk rd}nX|tkry'tjt|jdddWqt k rt} qtk rqXnWntk r d}nX| r^|sEd|jdd}tjd ||ntj j!d tq n| |kr|dk rt j | |kr|s|dkrd }nd|jdd}tjd ||ntj j!d tq qn|} t j } |dk}| r| dkr|dkr6d }nd|jdd}tj"d ||tj"d||dkrt}qn| d7} t j t#j$||q Wytj%|Wn0t k r| d7} | dkrwqnXtjj |s tt&|}t|}|jdj}WdQX||krTwndSWqtk r}tjdt'||| d7} | dkrnt j t#j$||qqXqWdS(s# Obtain lock access by creating a given temporary directory (whose base will be created if needed, but will not be deleted after the lock is removed). If access is refused by the same lock owner during more than 'timeout' seconds, then the current lock is overridden. If timeout is None, then no timeout is performed. The lock is performed by creating a 'lock' file in 'tmp_dir' that contains a unique id identifying the owner of the lock (the process id, followed by a random string). When there is already a lock, the process sleeps for a random amount of time between min_wait and max_wait seconds before trying again. If 'verbosity' is >= 1, then a message will be displayed when we need to wait for the lock. If it is set to a value >1, then this message will be displayed each time we re-check for the presence of the lock. Otherwise it is displayed only when we notice the lock's owner has changed. Parameters ---------- tmp_dir : str Lock directory that will be created when acquiring the lock. timeout : int or None Time (in seconds) to wait before replacing an existing lock (default config 'compile.timeout'). min_wait: int Minimum time (in seconds) to wait before trying again to get the lock (default config 'compile.wait'). max_wait: int Maximum time (in seconds) to wait before trying again to get the lock (default 2 * min_wait). verbosity : int Amount of feedback displayed to screen (default 1). iRitno_ownerNt_tfailures process '%s's7Overriding existing lock by dead %s (I am process '%s')R*sunknown processs2Overriding existing lock by %s (I am process '%s')s3Waiting for existing lock by %s (I am process '%s')s'To manually release the lock, delete %sii sSomething wrong happened: %s %s(((RRR"twaittnotsetRRRtdirnametisdirtmakedirstOSErrorRtsleepRRtgetpidRR+topent readlineststriptsplitt IndexErrorthostnametkilltinttAttributeErrorR!R#twarningRRRR$trandomtuniformtmkdirR&ttype(ttmp_dirRRRt verbosityt base_lockt lock_filetmy_pidt no_displaytnb_errortnb_waitt last_ownert time_startt other_deadtft read_ownert other_hosttmsgt unique_idtownerte((s6/tmp/pip-build-X4mzal/theano/theano/gof/compilelock.pyRs%            '                                c C`sdtjdjgtdD]}ttjdd^qtf}y-t|d}|j |dWdQXWn>t k rxt j dkrt qWtjd nX|S( s 'Refresh' an existing lock by re-writing the file containing the owner's unique id, using a new (randomly generated) id, which is also returned. s%s_%s_%sti ii tws NsNRefreshing lock failed, we release the lock before raising again the exception(RR8RtrangeR%RCtrandintR>R9twriteR!RRR R#twarn(RJtiRVt lock_write((s6/tmp/pip-build-X4mzal/theano/theano/gof/compilelock.pyR&8s 7    RcB`s#eZdZdZedZRS(s Class wrapper around release mechanism so that the lock is automatically released when the program exits (even when crashing or being interrupted), using the __del__ class method. cC`s ||_dS(N(RG(tselfRG((s6/tmp/pip-build-X4mzal/theano/theano/gof/compilelock.pyt__init__ZscC`stjj|jd}|syot|]}|jdj}|jd\}}}|ttj ks|t krdSWdQXWqt k rqXnytj |Wnt k rnXytj |jWnt k rnXdS(sS Remove current lock. This function does not crash if it is unable to properly delete the lock file and directory. The reason is that it should be allowed for multiple jobs running in parallel to unlock the same directory at the same time (e.g. when reaching their timeout limit). RiR/N(RRRRGR9R:R;R<R%R8R>R!tremovetrmdir(RaR*RJRRRWtpidR/thname((s6/tmp/pip-build-X4mzal/theano/theano/gof/compilelock.pyR]s$$   (t__name__t __module__t__doc__RbR+R(((s6/tmp/pip-build-X4mzal/theano/theano/gof/compilelock.pyRRs (&t __future__RRRRRtsocketRtloggingt contextlibRtnumpytnpttheanoRRCt RandomStatet getLoggerR#tleveltNOTSETtsetLeveltINFOt gethostnameR>R RR+RR)RR R-tobjectR2RR&R(((s6/tmp/pip-build-X4mzal/theano/theano/gof/compilelock.pyts0         >