Xc@`sdZddlmZmZmZddlmZddlmZddl Z ddl Z ddl Z ddl Z ddl mZmZddlZddlmZmZdd lmZe jeZd Zd efd YZd efdYZdefdYZdefdYZyUejj rRej!j"j#dnddlm$Z$de$j%efdYZ&Wnwe'k rnge(ej!j"j#fk rZ)geD]Z*e*j+dkre*^qdj,j-d st.e)nXdej/fdYZ0dS(s VMs that run Theano graph computations. A VM is not actually different from a Linker, we just decided VM was a better name at some point. i(tabsolute_importtprint_functiontdivisioni(tlink(t defaultdictN(tconfigt_config_var_list(t iteritemst itervalues(txrangecC`si}i}x|jD]}g||((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pyt__init__s     cC`stddS(s Run the machine. Postcondition - all output variables have been computed. VMs vary in what exactly this means and how it is done. s override meN(tNotImplementedError(RE((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pyt__call__scC`stddS(s Free any internal references to temporary variables. Free internal variables and outputs. Essentially, free as much memory as possible without intefering with the ability to evaluate subsequent calls. s override meN(RG(RE((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pyt clear_storages cC`sjxt|j|j|j|jD]t\}}}}|jj|d|j|c|7<|jj|d|j|c|7Rt enumerateRNR=R<ttimeR?R@Rt raise_with_op(REtcontR8RWR.tt0tt1((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pyRHs(   "(R[R\R]RAtallow_gcRH(((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pyR^stLoopGCcB`s eZdZdZdZRS(s Unconditional start-to-finish program execution in Python. Garbage collection is possible on intermediate results. cC`sltt|j|||||_t|_t|t|koWt|knshtndS(N(tsuperRfRFtpost_thunk_clearRCReRR;(RER<R=R>Rh((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pyRF s   .c C`s||jrx|jD]}d|dRRNR=R<RhR`R?R@RRa( RERbR8RWR.t old_storageRcRdtold_s((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pyRHs8      (R[R\R]RFRH(((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pyRfs tStackcB`s5eZdZddddZdZddZRS(s Finish-to-start evalution order of thunks. This supports lazy evaluation of subtrees and partial computations of graphs when only some inputs have changed. At a pseudo-code level, the basic idea is the following: def recursively_evaluate(var): if var is up to date: return if var.owner.inputs are up to date: update var return for input in var.owner.unputs: recursively_evaluate(var) for output in outputs: recursively_evaluate(output) The actual logic is more complex to support intermediate garbage collection, lazily-evaluated nodes, and better speed. c C`sZtt|j|||||_d|_g|jD]} | jr8| j^q8|_|j|_||_i|_ i|_ ||_ i|_ } | |_ | |_||_|j}xft|jD]U\}}|| |R$RoR#ReRsR&RqRrtoRptordsR8R.tprereq((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pyRFLs.  +              c C`s|j|}tj}|j|}|jj|ttj|d}|jdk r|jd|d|j|d|jd|j n||fS(sw Run the thunk corresponding to Apply instance `node`. Calls self.callback if it is defined. g|=R.RWR$RoN( RpR`R=RLRtmaxRqRR$Ro(RER.R-Rctrvaltdt((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pytrun_thunk_of_node|s      c!`s |j}|j|j}|j}g|_g|_x]|jD]R}|jdk|d<|jr@|dr@|j||j|dq@q@W|dk rt |j |j }|t t |t |j }g|D]&}|j |jr|j |j^q}nt |j}d} xt|jD]\} } | ddkrWq5nt| jdr| jj| d} nd} | |j| t|} |j}|j}|j }||j}tfd |D}tfd |D}||j|j s|rz| rzy_|j!|\}}~t"j#st"j$r&|j|}|j%|cd 7<|j&|c|7sc3`s|]}|dVqdS(iN((RR6(Ro(s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pys siR$c3`s|]}|dVqdS(iN((RR6(Ro(s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pys siR sThere was a bug that existed in the default Theano configuration, only in the development version between July 5th 2012 and July 30th 2012. This was not in a released version. The bug was affecting this script.t stacklevelics`s!|]}|jr|jVqdS(N(R(Rtinp((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pys 3s(5R$RoR=R&RLRMRRRrRRRstlistRRnRRRRR}RKRRARt c_contiguousRRURtpopRRuRRptlazyR|RRVtprint_global_statsR?R@R_R<t ExceptionRRaReRtindextwarnt vm_gc_bugRtwarningstextendRC(!REt output_subsetR$R=R&tkt first_updatedR8t apply_stacktlast_apply_stack_lenR)tdatatshtsttapply_stack_lent current_applytcurrent_inputstcurrent_outputst current_depst computed_inst computed_outst_R{t current_idxR-Rvt input_indextrequirestrtempty_storage_maptxt final_indexR6((Ros-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pyRHs>      "   ) &                                   !        N(R[R\R]RRFR|RH(((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pyRk2s  - s@lazylinker will not be imported if theano.config.cxx is not set.(t lazylinker_ctCVMcB`seZdZRS(cO`stjj|||dS(N(Rt CLazyLinkerRF(REtargstkwargs((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pyRFs(R[R\RF(((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pyRstlinkertcvmt VM_Linkerc B`sweZdZdedddddddZdddZdZdZdZ dddddZ dZ RS( s Class that satisfies the Linker interface by acting as a VM factory. Parameters ---------- allow_gc Force the virtual machine to clean up unnecessary references, in order to allow garbage collection on intermediate values during computation of a function. If None use as default the value of the Theano flag allow_gc. use_cloop Use the C-based virtual machine if possible callback A callable object to call after each call to a thunk within the virtual machine. It will be called with four arguments called 'node', 'thunk', 'storage_map', and 'compute_map'. callback_input A callable object to call on each input to the graph (variables with no owner). This includes constants and shared variables values. It will be called with two arguments: 'var', 'value'. lazy Useful only when use_cloop is False. When lazy is None, use the theano flag vm.lazy value. Then if we have a None (default) we auto detect if lazy evaluation is needed and use the apropriate version. If lazy is True or False, we force the version used between Loop/LoopGC and Stack. c_thunks If None or True, don't change the default. If False, don't compile c code for the thunks. allow_partial_eval If True, enforces usage of Stack or CVM, to allow for partial evaluation of functions (calculating a subset of outputs). c C`s|dkrtj}nd|_||_||_||_||_||_|dkrott jj }n||_ ||_ i|_ |r||_ndS(N(RRReR#t use_cloopRqRrRtboolRtcxxtc_thunkstallow_partial_evalt updated_varstschedule( REReRRqRrRRRR((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pyRFs            cC`s|d krg}n|jd k r|j|k rt|d|jd|jd|jd|jd|jd|jd|j d|j j |||S||_||_ ||_ |S( s Check if fgraph is the first FunctionGraph that has ever been associated to self, else, create a new VM_Linker associated to fgraph Parameters ---------- fgraph A PerformLinker can have accepted one FunctionGraph instance at a time. no_recycling WRITEME Returns ------- Self if fgraph is the first FunctionGraph that has ever been associated to self, else, a new VM_Linker associated to fgraph. ReRRqRrRRRRN(RR#RReRRqRrRRRRtacceptt no_recyclingRV(RER#RRV((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pyRs"               cC`s ||_dS(N(R(RER((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pytaccept_var_updates scC`si}x{|D]s}g||<|jr |jr g}x5|jD]*}|ddkr?||dj7}q?q?W||c|7 list of variables [v1, v2, v3, ...] for each K in variables. The variables v1, v2, ... are the full set of variables that depend directly on K. When we know that none of them will need to be computed, we know that: * K will not need to be computed. * If K is already computed, it can be released for garbage collection. Parameters ---------- variables Iterable over the variables used in a graph computation. Notes ----- It doesn't take care of the view_map/destroy_map. So it means it relies on Python gc no to free the object real storage. N.B. gc means garbage collection itoutput(RtclientsR(RER R&Rtlstcl((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pytcompute_gc_dependenciess  c 1&C`sQg|jD]} || ^q } |jdk sl|jdk sltjsPtjrYtjsl|jr?|j r?|j r|jdk s|jdk rt j dn|j rtjrt j dn|j r|jrt j dn|j |} t||| |||j|jt| d| d|jd|j} n|j rxi}i}xUt|D]G\}}|||tdepsRt nodes_idxtvars_idxR8R.t nodes_idx_invt vars_idx_invR)RRtdependency_maptdtdependency_map_listRRRRRt inputs_idxt outputs_idxRtthRRRwRRtprereq_var_idxst prereq_nodeRtupdate_in_from_outtivartovartoidxtc0R((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pytmake_vm@s          **A     "# %        '       c# C`s|j}|j|}|j}tj|||||\}}}i}x$|D]} | jdkg|| siiR&tpytimpliRs5The following error happened while compiling the nodes (,R#RRRt map_storageRRRRRRVRR9R`RRARRt make_thunkRRRRRtlinker_node_make_thunkstlinker_make_thunk_timeRNRRRRRRRRqRrRt gc_helperReRRR$Rot ContainerRC(#REtprofilerRRR$R#R"RRoRR=R%R)R&R'RcRRR.t thunk_startteRdRWR6RRtpairRt last_userRhtclear_after_this_thunktinputRtstorageR((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pytmake_alls           #'   '!         14cC`se|jj|t|ds+t|_nt|dsFd|_nt|dsad|_ndS(NRRRr(t__dict__tupdateRRRCRRRRr(RER((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pyt __setstate__Xs  N( R[R\R]RRARFRRRRRR(((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pyRs#  *  + g(1R]t __future__RRRRlRt collectionsRtloggingRR`Rttheano.configparserRRttheano.gof.cmoduleRtsixRRt six.movesR t getLoggerR[RR9tobjectR:R^RfRkRtgoftcmodulet MissingGXXRRRt ImportErrortOSErrorRRtfullnametdefaultt startswithRt LocalLinkerR(((s-/tmp/pip-build-X4mzal/theano/theano/gof/vm.pyts<      Yn!/`    8