ó àÆ÷Xc@`sÁddlmZmZmZddlmZddlmZddlZddl Z ddl Z ddl Z ddl m Z ddl mZdefd„ƒYZd efd „ƒYZd efd „ƒYZd efd„ƒYZdd#d„ƒYZdd$d„ƒYZdefd„ƒYZdefd„ƒYZdeefd„ƒYZdefd„ƒYZdefd„ƒYZdefd„ƒYZdefd „ƒYZd!efd"„ƒYZdS(%i(tabsolute_importtprint_functiontdivision(tpartial(t OrderedDictN(tconfig(tgrapht AlreadyTherecB`seZdZRS(s¦ Raised by a Feature's on_attach callback method if the FunctionGraph attempting to attach the feature already has a functionally identical feature. (t__name__t __module__t__doc__(((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyRstReplacementDidntRemovedErrorcB`seZdZRS(sÉ This exception should be thrown by replace_all_validate_remove when an optimization wanted to remove a Variable or a Node from the graph, but the replacement it gived didn't do that. (RR R (((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyR stFeaturecB`sGeZdZd„Zd„Zd„Zd„Zdd„Zd„Z RS(sE Base class for FunctionGraph extensions. A Feature is an object with several callbacks that are triggered by various operations on FunctionGraphs. It can be used to enforce graph properties at all stages of graph optimization. See Also -------- theano.gof.toolbox : for common extensions. cC`sdS(s§ Called by FunctionGraph.attach_feature, the method that attaches the feature to the FunctionGraph. Since this is called after the FunctionGraph is initially populated, this is where you should run checks on the initial contents of the FunctionGraph. The on_attach method may raise the AlreadyThere exception to cancel the attach operation if it detects that another Feature instance implementing the same functionality is already atttached to the FunctionGraph. The feature has great freedom in what it can do with the function_graph: it may, for example, add methods to it dynamically. N((tselftfunction_graph((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyt on_attach2scC`sdS(s› Called by remove_feature(feature). Should remove any dynamically-added functionality that it installed into the function_graph. N((R R((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyt on_detachCscC`sdS(sY Called whenever a node is imported into function_graph, which is just before the node is actually connected to the graph. Note: on_import is not called when the graph is created. If you want to detect the first nodes to be implemented to the graph, you should do this by implementing on_attach. N((R Rtnodetreason((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyt on_importJscC`sdS(s‡ Called whenever a node is pruned (removed) from the function_graph, after it is disconnected from the graph. N((R RRR((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyton_pruneTscC`sdS(s' Called whenever node.inputs[i] is changed from r to new_r. At the moment the callback is done, the change has already taken place. If you raise an exception in this function, the state of the graph might be broken for all intents and purposes. N((R RRtitrtnew_rR((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyton_change_input[scC`stƒS(sA Called by toposort. It should return a dictionary of {node: predecessors} where predecessors is a list of nodes that should be computed before the key node. If you raise an exception in this function, the state of the graph might be broken for all intents and purposes. (R(R R((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyt orderingsfs N( RR R RRRRtNoneRR(((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyR $s     t BookkeepercB`seZd„Zd„ZRS(cC`s:x3tj|j|jƒD]}|j||dƒqWdS(s# Called by FunctionGraph.attach_feature, the method that attaches the feature to the FunctionGraph. Since this is called after the FunctionGraph is initially populated, this is where you should run checks on the initial contents of the FunctionGraph. RN(Rt io_toposorttinputstoutputsR(R tfgraphR((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyRuscC`s:x3tj|j|jƒD]}|j||dƒqWdS(su Should remove any dynamically added functionality that it installed into the function_graph sBookkeeper.detachN(RRRRR(R RR((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyRs(RR RR(((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyRss t GetCheckpointcB`seZd„Zd„ZRS(cC`s||_||_d|_dS(Ni(thRtnb(R thistoryR((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyt__init__Šs  cC`s)g|jj|j<|jd7_|jS(Ni(R!R#RR"(R ((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyt__call__s(RR R$R%(((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyR ˆs t LambdExtractcB`seZdd„Zd„ZRS(cC`s1||_||_||_||_||_dS(N(RRRRR(R RRRRR((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyR$—s     cC`s.|jj|j|j|jdd|jfƒS(NRtRevert(Rt change_inputRRRR(R ((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyR%žsN(RR RR$R%(((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyR&•s tHistorycB`sSeZdZddgZd„Zd„Zd„Zd„Zd d„Z d„Z RS( sÖKeep an history of changes to an FunctionGraph. This history can be reverted up to the last checkpoint.. We can revert to only 1 point in the past. This limit was added to lower the memory usage. t checkpointtrevertcC`s i|_dS(N(R#(R ((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyR$­scC`set|dƒst|dƒr-tdƒ‚ng|j|>tfiles+validate failed on node %s. Reason: %s, %ssExtra scan introducedtnames Scan removed(s›Please, report this to theano-dev mailing list. As a temporary work around, you can raise Python stack limit with: import sys; sys.setrecursionlimit(10000)(R*RRtoptimizer_verbosetscantdebugt apply_nodest isinstancetopttheanot scan_moduletscan_optScantreplaceRGR?tstrtargstsyststderrRHttypeR+R4tlentgetattr(R Rt replacementsRR;tchktntscansRRRLtmsgts1ts2ts3touttscans2R"tnb2((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyR:JsR    :        7   ( +c C`s£|j||ƒ}|jj|ƒxz|D]r}||jksM||jkr)|j|ƒ|rtj}tdd|ƒt||d|ƒnt ƒ‚q)q)WdS(s– As replace_all_validate, revert the replacement if the ops in the list remove are still in the graph. Also print a warning. sWARNING: An optimization wanted to replace a Variable in the graph, but the replacement for it doesn't remove it. We disabled the optimization. Your function runs correctly, but it would be appreciated if you submit this problem to the mailing list theano-users so that we can fix it.RXN( R:RVtupdateR]t variablesR+RgRhRHR ( R RRltremoveRtwarnRmtrmRt((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyRT€s   cC`s)|jjƒ}d|kr%|d=n|S(NR#(t__dict__tcopy(R td((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyt __getstate__™s  cC`s||jkrt|_ndS(N(RVRQRW(R RRR((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyRŸscC`s+|jr't|_tjjdƒ‚ndS(Ns$Trying to reintroduce a removed node(RWRGR`tgoftInconsistencyError(R R((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyR4£s  N(RR R)R2R3RR-RRRSR:RQRTRRR4(((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyRR!s 6  t NodeFindercB`s>eZd„Zd„Zd„Zd„Zd„Zd„ZRS(cC`sd|_i|_dS(N(RRR~(R ((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyR$«s cC`sn|jdk rtdƒ‚nt|dƒr<tdƒ‚n||_t|j|ƒ|_tj ||ƒdS(Ns7A NodeFinder instance can only serve one FunctionGraph.t get_nodessANodeFinder is already present or in conflict with another plugin.( RRR?R,RRtqueryRƒRR(R R((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyR¯s cC`sA|j|k rtdƒ‚nd|_|`tj||ƒdS(su Should remove any dynamically added functionality that it installed into the function_graph sAThis NodeFinder instance was not attached to the provided fgraph.N(RR?RRƒRR(R R((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyRºs  cC`sÆy#|jj|jgƒj|ƒWnœtk r7dStk rÁ}tdt|ƒt|jƒdtj ƒy#tdt |jƒdtj ƒWn$tk r·tddtj ƒnX|‚nXdS(NsOFFENDING nodeRXsOFFENDING node hashsOFFENDING node not hashable( R~t setdefaultR_R.t TypeErrorR?RHRiRgRhthash(R RRRRL((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyRÆs# (# cC`sPy|j|j}Wntk r(dSX|j|ƒ|sL|j|j=ndS(N(R~R_R†Ry(R RRRtnodes((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyRÓs  cC`sMy|jj|gƒ}Wn!tk r<td|ƒ‚nXt|ƒ}|S(Ns7%s in unhashable and cannot be queried by the optimizer(R~RFR†tlist(R RR_tall((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyR„Üs  (RR R$RRRRR„(((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyR‚©s   t PrintListenercB`sDeZed„Zd„Zd„Zd„Zd„Zdd„Z RS(cC`s ||_dS(N(tactive(R RŒ((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyR$èscC`s|jrtd|ƒndS(Ns-- attaching to: (RŒRH(R R((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyRës cC`s|jrtd|ƒndS(su Should remove any dynamically added functionality that it installed into the function_graph s-- detaching from: N(RŒRH(R R((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyRïs cC`s$|jr td||fƒndS(Ns-- importing: %s, reason: %s(RŒRH(R RRR((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyR÷s cC`s$|jr td||fƒndS(Ns-- pruning: %s, reason: %s(RŒRH(R RRR((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyRûs cC`s*|jr&td||||fƒndS(Ns)-- changing (%s.inputs[%s]) from %s to %s(RŒRH(R RRRRRR((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyRÿs N( RR RQR$RRRRRR(((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyR‹æs      t PreserveNamescB`seZdZdd„ZRS(sz This preserve some variables names during optimization. Deprecated. We need to keep it to allow unpickling. cC`s1|jdk r-|jdkr-|j|_ndS(N(RYR(R RRRRRR((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyR sN(RR R RR(((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyRstPreserveVariableAttributescB`seZdZdd„ZRS(sN This preserve some variables attributes and tag during optimization. cC`sv|jdk r-|jdkr-|j|_nt|jdtƒrrt|jdtƒtkrr|jj|j_ndS(Ntnan_guard_mode_check(RYRRkttagRGR(R RRRRRR((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyRs N(RR R RR(((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyRŽstNoOutputFromInplacecB`s eZddd„Zd„ZRS(icC`s||_||_dS(N(t first_idxtlast_idx(R tfirst_output_idxtlast_output_idx((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyR$ s c C`sÅt|dƒstSt|jƒ|j|j!}x|D]‡}|jdkrQq6n|j}|j}|jj |ƒ}t|dƒr6||j kr6t j j dddd|ddd ƒ‚q6q6WdS( Nt destroyerst destroy_maps5A function graph Feature has requested (probably for s6efficiency reasons for scan) that outputs of the graphs.be prevented from being the result of inplace s&operations. This has prevented output s from s-being computed by modifying another variable sinplace.(R,RQR‰RR’R“townerRR_tindexR—R`R€R(R Rtoutputs_to_validateRtRR_tout_idx((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyR4$s$      N(RR RR$R4(((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyR‘s(((t __future__RRRt functoolsRt collectionsRRgR=R@R`Rt theano.gofRR?RR tobjectR RR R&R)R3RRR‚R‹RRŽR‘(((s2/tmp/pip-build-X4mzal/theano/theano/gof/toolbox.pyts,      O ;Cˆ=