Xc@`sdZddlmZmZmZddlZddlZddlZddlZddl j j Z ddl m Z mZddlmZddlZddlZddlmZmZddlmZddlmZmZdd lmZmZdd lmZm Z m!Z!m"Z"dd l#m$Z$dd l%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+dd l,m-Z-m.Z.ddl/m0Z0dZ1ej2dZ3dej4fdYZ5e3j6e5de7fdYZ8de8fdYZ9de8fdYZ:de8fdYZ;de8fdYZ<de8fdYZ=de8fd YZ>d!Z?d"d#e@eAejBeAeAe@d$eAe@e@e@e@e@e@eAd%ZCeAd&ZDd'fd(YZEeEZFd)ZGeHe@eHd*ZId+ZJd,ZKd-ZLd.ZMd/ZNd0ZOd1ZPeNZQd2ZRd3ZSd4eTfd5YZUd6eTfd7YZVeejjWjXgZYd8eTfd9YZZd:ej!j[fd;YZ\d<gZ]d=e&fd>YZ^d?Z_e j`e^e_d@e-fdAYZae.dBeadCdDdS(Es Provides `DebugMode`, an evaluation mode for debugging theano internals. TODO: add support for IfElse Op, LazyLinker, PureOp, etc. i(tabsolute_importtprint_functiontdivisionN(tchaintproduct(tizip(tgoftconfig(tget_unbound_function(t iteritemst itervalues(tStringIOtxrange(tgraphtutilstlinktops_with_inner_function(t raise_with_op(t FunctionMakertFunctiontinfer_reuse_patterntSymbolicOutputt Supervisort std_fgraph(tModet register_mode(t OutputGuardsrestructuredtext enstheano.compile.debugmodetNoDuplicateOptWarningFiltercB`seZegZdZRS(cC`sI|j}|jdrE||jkr.tS|jj|tSntS(NsOptimization Warning: (t getMessaget startswitht prev_msgstFalsetaddtTrue(tselftrecordtmsg((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pytfilter(s (t__name__t __module__tsetRR%(((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR%s tDebugModeErrorcB`seZdZRS(sK Generic Exception raised to indicate an internal theano problem. (R&R't__doc__(((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR):stBadThunkOutputcB`sSeZdZdZdZdZdZdZddZ dZ dZ dZ RS(s< Exception: Calling the same Op twice gives inconsistent outputs. It can be raised, for instance, if an Op's c_code and perform method do not agree, or if one of these methods do not give the same result when called twice with the same inputs (but different memory layouts for the output). tcC`sMtt|j||_||_||_||_||_||_dS(N( tsuperR+t__init__trtthunk1tval1tthunk2tval2t inputs_val(R"R/R0R1R2R3R4((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR.bs     cC`st|jjjS(se Return the Op class whose c_code and perform implementations didn't match. (ttypeR/townertop(R"((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyt offending_opkscC`s |jS(N(tstr_diagnostic(R"((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyt__str__sscC`s3t}tdd|td|jjd|td|jd|td|jjd|tdt|jddd|tdt|jd dd|td g|jjj D]}|j^qd|td g|j D]}t|dd^qd|td g|j D]}t|d d^qd|g}xF|j D];}t|d ddkr|j |qT|j dqTWtd|d|td|jd|td|j d|td|j d|ddljj}t|j|j|jddd||j}|S(sd Return a pretty multiline string representing the cause of the exception. R+tfiles Apply :s op :s Outputs Type:s Outputs Shape:tshapes Outputs Strides:tstridess Inputs Type :s Inputs Shape:s Inputs Strides:tsizeii s not showns Inputs values: %ss Bad Variable:s thunk1 :s thunk2 :iN(R tprintR/R6R8R5tgetattrR1tNonetinputsR4tappendR0R2ttheano.tests.unittest_toolstteststunittest_toolsR9R3tgetvalue(R"tsiotitvalt scalar_valuestipttutttret((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR9vs6 "+ , ,( N(( R&R'R*RAR/R0R1R2R3R.R8R:R9(((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR+Cs   tBadOptimizationcB`sSeZdZdZdZdZdZdZdZ dZ dZ dZ dZ RS(sU Exception: some variable and its substitute take different runtime values. R,cC`sVtt|j||_||_||_||_||_||_||_ dS(N( R-ROR.told_rtnew_rt old_r_valt new_r_valtreasont old_grapht new_graph(R"RPRQRRRSRTRURV((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR.s      cC`s |jS(N(R9(R"((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR:sc C`st}d}tdtt|jd|tdt|j|jd|td|jjd|tdt|j d|yt}tddd d|t|j j dd d|t|j j dd d|t|j j d|t|jd|Wntk r"nXt|j }t||krjtd t|j | d d|ntd t|j d|yt}td dd d|t|j j dd d|t|j j dd d|t|j j d|t|jd|Wntk r nXt|j }t||krhtd t|j | d d|ntd t|j d|ytj|j }tj|j }t}tj||}tdtj|d|tdtj|d|tdtj|d|tdtj|d|tj|} |j| |j| f} td| d||tjtj|tj|d} tdtj| d|tdtj| d|tdtj| d|tdtj| d|tj| } |j| |j| f} td| d|t|jd|Wntk rnXtdt|jd|tdd|t|jd|tdd|t|jd|tdd|tdd|tdd||jS(sf Return a pretty multiline string representating the cause of the exception. i sBadOptimization ErrorR;s Variable: ids Ops Value Type:s" Old Value shape, dtype, strides:tendt s Old Value: s...s" New Value shape, dtype, strides:s New Value: s Max Abs Diff: s Mean Abs Diff: s Median Abs Diff: s Std Abs Diff: s Value at Max Diff: g:0yE>s Max Rel Diff: s Mean Rel Diff: s Median Rel Diff: s Std Rel Diff: s Reason: s Old Graph:s New Graph:R,s8Hint: relax the tolerance by setting tensor.cmp_sloppy=1s8 or even tensor.cmp_sloppy=2 for less-strict comparison(R R?R-ROR:tidRQR6R5RSRRR<tdtypeR=RGt ExceptiontstrtlentnptasarraytabsolutetmaxtmeantmediantstdtargmaxtflattentmaximumRTRURV( R"RHtval_str_len_limittssiot str_old_r_valt str_new_r_valtovtnvtabs_difft arg_max_valt values_at_maxtreldiff((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR9s  "           N(R&R'R*RARQRPRRRSRTRURVR.R:R9(((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyROs  t BadDestroyMapcB`s eZdZdZdZRS(sf Exception: Some perform() or c_code() modified an input that wasn't in the destroy_map. cC`sDtt|j||_||_||_||_||_dS(N(R-RrR.tnodetidxtold_valtnew_valtperform(R"RsRtRuRvRw((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR.Cs     cC`st}td|jd|td|jd|tdg|jjD]}t|t|f^qHd|tdt|jjdid|td|j d|td|jj|j j d|td t |j d|td t |j d|yitj|j }tj|j }td |j|jd|td |j|jd|td |j|jd|td|j|jd|||}td|jd|td|jd|tdtj|j|jd|tdtj|j|jd|tdtjtj|d d|tdd|Wn-tk r}tdt|d|nXtdd||jS(Ns node:R;s perform:s node.inputs:s destroy_map:t destroy_maps changed input idx:s changed input type:s repr (old val):s repr (new val):s value dtype (new old):s value shape (new old):s value min (new old):s value max (new old):s value min (new-old):s value max (new-old):s value argmin (new-old):s value argmax (new-old):s" location of first 10 mismatches:i R,s(Numpy-hints failed with: %s)sz Hint: this can also be caused by a deficient values_eq_approx() or __eq__() implementation [which compared input values](R R?RsRwRBR\RYR@R7RtR5treprRuRvR^R_RZR<tminRat unravel_indextargminRet transposetnonzeroR[RG(R"RHRIt npy_old_valt npy_new_valtdeltate((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR:KsP  5   # (R&R'R*R.R:(((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyRr=s t BadViewMapcB`s&eZdZdddZdZRS(sh Exception: Some perform() or c_code() created a memory alias that wasn't in the view_map. cC`sDtt|j||_||_||_||_||_dS(N(R-RR.Rst output_idxt out_storaget in_alias_idxt out_alias_idx(R"RsRRRR((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR.~s     cC`s_t}td|jd|tdg|jjD]}t|t|f^q2d|tdg|jjD]}t|t|f^qpd|tdt|jjdid|tdt|jjdid|td |j d|td |j d||j r3td |j d|n|j rUtd |j d|n|j S( Ns node:R;s node.inputs:s node.outputs:s view_map:tview_maps destroy_map:Rxs aliased output:s aliased output storage:s aliased to inputs:s aliased to outputs:(R R?RsRBR\RYtoutputsR@R7RRRRRG(R"RHRI((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR:s   5 5%  N(R&R'R*RAR.R:(((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyRwstStochasticOrdercB`seZdZRS(s Exception: Repeated Optimizations of the same graph do not give identical results. The most common cause is that an Optimization iterates over some objects in a memory-address-dependent order (such as id() or object.hash()). If you see this error and you think it is related to optimizations within Theano, email theano-dev with the message attached to this exception. (R&R'R*(((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyRs tInvalidValueErrorcB`s)eZdZddddZdZRS(sd Exception: some Op an output value that is inconsistent with the Type of that output. tnonecC`sDtt|j||_||_||_||_||_dS(N(R-RR.R/tvt client_nodethintt specific_hint(R"R/RRRR((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR.s     cC`s|j|j}}|j}t|}t|dd!}d}d}d}d} d} yF|j}|j}|j}|j} tj tj |} Wnt k rnX|j } |j } |j} t|dddddtj}d tS( NiidsN/Atprefixs tdepthi R;sInvalidValueError type(variable) = %(type_r)s variable = %(r)s type(value) = %(type_v)s dtype(value) = %(v_dtype)s shape(value) = %(v_shape)s value = %(v_val)s min(value) = %(v_min)s max(value) = %(v_max)s isfinite = %(v_isfinite)s client_node = %(client_node)s hint = %(hint)s specific_hint = %(specific_hint)s context = ... %(context)s (R/RR5R\R<RZRzRaR^talltisfiniteR[RRRt debugprintR RGtlocals(R"R/Rttype_rttype_vtv_valtv_dtypetv_shapetv_mintv_maxt v_isfiniteRRRtcontext((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR:s.          N(R&R'R*RAR.R:(((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyRs cC`sld}d}|dkr!d}nxD|dkrg||}ttd|}||}||}q$W|S(sd Converts number to string by rendering it in base 26 using capital letters as digits. iR,itA(tchrtord(tnumbertbasetrvalt remaindertnew_char((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pytchar_from_numbers    R,itCHARc* `s|dkrdSdkr%gndkr=tn| dkrRg} n|rhdj}nd}| dkr|} ndkrtntfd}tjdrj}tdd}|dkrd}n|rttjjdd}nd}|rLttjjd d}nd}|rq|d krqd |}n|r|d krd |}nd}rtj j}n|k}||}t |j d krd}nd|j j }d}|r5dt|j |j dd}nd}|rt tdgd krfd}dtgj D]'\}} ||t||f^q~}n| dks|| jkrtd||j|||||||||f d|n| j|}!|!| jd}"| j}#|#|}$|#|| jd}%t |j d krod}nd|j j }td||j||||||||||!|"|$|%fd||s| stdojdk r | d}&| d}'xt|jD]\}} |t |jd krK| d}'nt| drt| jdrt| jjtjjjr| j| qnt| |&d|d dd|d|ddd| d |'d!| d"| d#|d$|d%d&|qWq qn|dk r|kr|}|}(t|(jdra||(j})n ||(})td'||||)fd|nZd}|rdt|j d}n|}td(||||fd||S()s Print the graph leading to `r` to given depth. Parameters ---------- r Variable instance. prefix Prefix to each line (typically some number of spaces). depth Maximum recursion depth (Default -1 for unlimited). done Internal. Used to pass information when recursing. Dict of Apply instances that have already been printed and their associated printed ids. print_type Whether to print the Variable type after the other infos. file File-like object to which to print. print_destroy_map Whether to print the op destroy_map after other info. print_view_map Whether to print the op view_map after other info. order If not empty will print the index in the toposort. ids How do we print the identifier of the variable : id - print the python id value, int - print integer character, CHAR - print capital character, "" - don't print an identifier. stop_on_name When True, if a node in the graph has a name, we don't print anything below it. scan_ops Scan ops in the graph will be added inside this list for later printing purposes. scan_inner_to_outer_inputs A dictionary mapping a scan ops inner function inputs to the scan op inputs (outer inputs) for printing purposes. smap None or the storage_map when printing an Theano function. used_ids Internal. Used to pass information when recursing. It is a dict from obj to the id used for it. It wasn't always printed, but at least a reference to it was printed. print_clients If True, we will print the clients of nodes when they have more then one clients. iNs <%s>R,c`s|kr|}n|dkr.d}ndkrSdtt}n_dkrxdtt}n:dkrdtt}ndkrd}n|r|| %8.2es %4.1f%% %8.2es %4.1f%%s |s R6RRt print_typeRRt stop_on_namet prefix_childtscan_opstprofiletscan_inner_to_outer_inputstsmapRt print_clientss%s%s %s%s -> %ss %s%s %s%s%s(RAtdictR5R!thasattrR6R@R\R7RR]RtgetRRt apply_timeR?t fct_call_timetcompute_total_timesRt enumerateRBt isinstancettheanot scan_moduletscan_optScanRCR(*R/RRRRR;tprint_destroy_maptprint_view_mapRRRRRRRRRRttype_strRtatr_nametdestroy_map_strt view_map_strtotalready_printedRRttdataRRRRItop_timetop_time_percentt tot_time_dictttot_timettot_time_percentt new_prefixtnew_prefix_childtouter_rt outer_id_str((RRRR/Rs8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyRs8              !!     &$ ;         !           c `s{g|D]}|j^q}g|D]}|jr#|j^q#}g|D]}|j^qH|}t}tjj||d|g|sx{jD]-}t|jddrt d|qqWn@x=jD]2}t|jddrj tj PqqWj t fdt|jDx!tjD]} j | qEWttt||fS(s Create a FunctionGraph for debugging. Parameters ---------- input_specs: WRITEME fgraph inputs. output_specs: WRITEME fgraph outputs. accept_inplace : bool Are inplace ops permitted in the original graph? Returns ------- FunctionGraph A new FunctionGraph with a cloned graph, with debugging `Feature` instances already installed. tfeaturesRxs)Graph must not contain inplace operationsc3`sB|]8\}}|jp3tdo3j|s|VqdS(t destroyersN(tmutableRR(t.0tspectinput(tfgraph(s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pys s N(tvariabletupdatet_VariableEquivalenceTrackerRtfgt FunctionGrapht apply_nodesR@R7RAt TypeErrortattach_featuretDestroyHandlerRtzipRBRRtlisttmapR( t input_specst output_specstaccept_inplaceRt orig_inputstupdatest orig_outputstequivalence_trackerRstfeature((Rs8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyt_optcheck_fgraphs(%    &t DataDestroyedcB`seZRS((R&R'(((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyRscC`s<t|jdr%|jj||S|jj||SdS(Ntvalues_eq_approx(RttagRR5(tvarR1R3((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pytcheck_eq'scC`s[g}t|jdi} x't| D]\} } |j| q(Wg|D]} |j| ^qL} g}t|jdi}xt|D]\}}|j|}||d}||j|dd}t|jdr |jj||r |j |j|n|r| rt |jt r/qn||k r^t j d|dt|q^qqWt|jdi}xt|D]\}}|j|}||d}||j|dd}t|jdo|jj||}|r|j |j|n|rt|dddkr,qnt |jt rDqn|smt j d |dt|qmqqWxt|jD]\}}|jj||||ds|| kr,||krP|j|d|fd|k rtd n|r||d|f||iisYOptimization Warning: input idx %d marked as viewed but new memory allocated by node '%s'sfailure in topological ordering(R@R7R textendRBRRR5RRCRRt_loggertwarningR\Rt values_eqRR[tdata_destroyedRr(Rst storage_maptr_valstdr_valst active_nodestclobber_dr_valsRwtwarn_input_not_reusedtdestroyed_idx_listRxto_post i_pos_listRItdestroyed_res_listtactually_inplace_outputstdmaptootiiRtout_vartin_vartvmapt may_sharetr_idxR/((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyt _check_inputs.sb        !  "cC`s0x)t|jD]\}}ii}}||d}t|jdi}t|jdi}xt|jD]\} } || d} | tkrqqnt| jdrq| jj|| rqt | } | || <| g|j |dks| g|j |dkr)|j | ||     $    cC`s |jdgkp|jgk S(sd Returns ------- bool True if `var` is used by another node in the graph. Ri(soutputi(R(R((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyRs cC`s|dkrdSy|j|jk}Wntk r:dSX|std|j|j|j|jt|f}|dkr|qtd|dtjndS(sf Parameters ---------- warn_err If 0, no warning, if 1 warning, if 2 error. iNsStride mismatchisWARNING:R;(R=R[RR<R\R?tsyststderr(Rtbtwarn_errR7t strides_eqR((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyt_check_strides_matchs    cC`sddlm}t|tjtjfkrC|jdd}n*t||kr^|}ntj|}t|t|kstt|t|ft |tjr|j |j kstn|S(sW Parameters ---------- a Any object Returns ------- object A copy of `a` that shares no internal storage with the original (a deep copy). This function handles numpy arrays specially, because copy.deepcopy() called on a 0-d array will return a numpy scalar, not an array. i(t _cdata_typeRtK( ttheano.gof.typeR2R5R^tndarraytmemmaptcopytdeepcopytAssertionErrorRRZ(RR2R((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyt_lessbroken_deepcopys 6c C`s!xt|D] \}}x|jD]}x||D]\}}}} ||} ||} |j|jksrtt|jdr|jj| | } n9t|dr|j| | } n|jj| | } | s4td|d|d| d| d|d|d| q4q4Wq#Wq Wd S( sa Use a simple algorithm to find broken optimizations. This algorithm is simple to understand, but sometimes when there's a problem it identifies the wrong optimization as the culprit. The problem stems from the fact that results are not evaluated in chronological order (looking at when they were introduced to the graph). RRPRQRRRSRTRURVN(RRR5R9RRRRO( RtreasonsR RIRsRQRTR/t old_graph_strt new_graph_strRStr_valtcheck((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyt_find_bad_optimizations0s&   cC`si}i}xt|D]\}}|||tfirst_broken_set((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyt_find_bad_optimizations19sF       c`srtfdfdx8t|D]*\}}x|jD]}|qVWq@WdS(sa Use a simple algorithm to find broken optimizations. This algorithm is simple to understand, but sometimes when there's a problem it identifies the wrong optimization as the culprit. The problem stems from the fact that results are not evaluated in chronological order (looking at when they were introduced to the graph). c`sx|D]\}}}}|}|}|j|jksY|jj|| r td|d|d|d|d|d|d|q q WdS( sQ Verify that `r` has the same value as the results it replaces. RPRQRRRSRTRURVN(R5RRO(RQRTR/R<R=RSR>(R R;(s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pytcheck_variable_noreczs    c`s|krdSj|g|D]\}}}}|^q(}d|jk rh||jj7}nx|D]}|qoW|dS(N(R RAR6RB(R/RTRPtoldstnewst list_of_varstvar_that_could_make_r_look_bad(tcheck_variableRMtchecked_variablesR;(s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyRRs  ) N(R(RR(RR;R RIRsRQ((RRRMRSR R;s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyt_find_bad_optimizations2ls c 2 c`sddlm} ddlm} m} | rOddlm}ddlm}ng}x-|jD]"}|| kr_|j|q_q_Wd|ksd|kri}x+|D]#}|| kr| |||tr_buftdimt shape_difftdiffRat r_shape_difftsdt out_shape((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyt_get_preallocated_mapss      ' "         $       )  &"  %   !       ,c `szt} tt|ddtkrtt|j} t|j| d} | syt| d syt| jd rtj d|j| qt | jj t r| jj }t j |}t|_t|_d|_g|_d|_|| j_ t} tjdqnt}t|jdi}t|jd i}x^t|jD]M\}tfd tt|t|DrW|j|qWqWWtjd x#t|||||||||| | D]\}}tjd |d ||f}|s(tj d|qnx&|D]}t||||dss%starting preallocated output checkings name = %ss%s with %s outputs%s: out_map is emptyRRR RwR R0sReference valueR1R2R3R4s%finished preallocated output checkingNschanging mode back()RR5R@RARR7RRRtwarnRRRlR7t check_py_codetcheck_isfinitetrequire_matching_stridestcheck_preallocated_outputtstability_patienceR!tinfoR(RRBtanyRR R tdebugRR:RRtis_valid_valueRtvalue_validity_msgRR+RR6R+(RsRqRrRsRR R RwRtRuRvtchanged_inner_modet fn_attr_nametfnt backup_modetnew_modetaliased_inputsRRR/Rtout_mapt thunk_nametinpR4((RIs8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyt_check_preallocated_outputs          1     $   t_FunctionGraphEventcB`sVeZdZdZdZdZdZdZdddZ dZ dZ dZ RS(s A record of an event in the life of an FunctionGraph. The __eq__ function is important here, as it is the basis for comparing optimization runs. R,cC`sU||_|dkr*d|_d|_n||_|j|_||_||_dS(NR(tkindRsR7RtRT(R"RRsRtRT((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR.s       cC`s|jdkrp|jdkr9tt|jj}nd}djd|jt|jt|j|gSt|j SdS(NtchangeRR,RX( RR7R\R]RsRBtjoinRTRtt__dict__(R"R$((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR:$s    cC`sft|t|k}|rbxAddddgD]*}|oXt||t||k}q1Wn|S(NRR7RtRT(R5R@(R"totherRtattr((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyt__eq__3s +cC`s ||k S(N((R"R((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyt__ne__=sN( R&R'R*RRARsR7RtRTR.R:RR(((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyRs  RcB`seZdZdZdZdZdZdZdZ dZ dZ dZ dZ dZdZdZddZdZRS( sh A FunctionGraph Feature that keeps tabs on an FunctionGraph and tries to detect problems. cC`s d|_dS(N(RAR(R"((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR.`scC`s|jdksti|_t|_t|_||_g|_i|_i|_ g|_ x'|j D]}|j ||dqpWdS(Nt on_attach( RRAR9tequivR(R tinactive_nodestall_variables_everR;t replaced_byt event_listttoposortt on_import(R"RRs((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyRcs        cC`s"||jkstd|_dS(N(RR9RA(R"R((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyt on_detachpscC`sm|jjtd|d|||jks4t||jksIt|jj||jj|dS(NtpruneRT(RRCRR R9RtremoveR (R"RRsRT((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyton_prunets  cC`sB|jjtd|d|||jks4t|jj|||jkr|jj|x|jD]}||j ksmtqmWnxr|jD]g}||j kstt |g|j |<|j j||j j |g|jj |gqWx7|jD],}|j j |g|jj |gqWdS(NtimportRT(RRCRR R9R RRRRR(RR;RBRRB(R"RRsRTR/((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR|s" cC`sx|jjtd|dt|d||jj|g|jj|gt}x>|j|D]/}|d|kre|d|kret}qeqeW|rGt } t } |j|j||t |dddd d t d | d | j t |dddd d t d | d | j f|j|j||fn||j krf|j |} n.|j j|t|g} |jj|||j kr|j |} n.|j j|t|g} |jj||| kst|| kst| j| x-| D]%} | |j | <| | kstqW|j || ks[t|j || ksttdS( NRRTRtiiRs RiR;RR(RRCRR\R;RBRR!RRRR RGRR(RR9R(R"RRsRIR/RQRTt append_reasonttupRRtr_sett new_r_sett like_new_r((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyton_change_inputsJ         cC`sGx@|jD]5}t|x"|j|D]}td|q(Wq WdS(Ns (RR?(R"R'R((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyt printstuffs N(R&R'R*RARRR RRR;RRR.RRRRRR(((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyRAs      5t _DummyLinkercB`seZddZRS(cC`s|S(N((R"tallow_gc((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pytclonesN(R&R'RAR(((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyRst_LinkercB`s>eZdZddZdddZdddddZRS(s$ Special debugging linker. cC`s>ttj|jd|_||_|r:||_ndS(N(R-Rt LocalLinkerR.RARRtschedule(R"RR((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR.s   cC`s|dkrg}n|jdk rp|j|k rpt|tksKtt|d|jj|||S||_||_|S(NR(RARR5RR9Rtacceptt no_recycling(R"RRR((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyRs     c `soddlmj}}j}tj|j}~|jtjj |j } t | g} t j || \ g g x"D]} i} x| j D]} tg| |  fS( Ni(RUt debug_performRitpyRs9Op %s doesn't have a perform, forcing check of the C codesZWe won't check the perform function of node '%s' but we will check its make_thunk functionc`s tjdtjd jjjxD]}d|d |dj>krB ||dj? |dj?krB t||dj?r" ||d |d(qX |dj@||dq[ ||d |d7ss%i - running thunk_csc outputRR0R1R2tc_codeR3R4c`s0y Wntk r+tnXdS(N(R[R((Rstthunk_c(s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyRqs  s4%i - calling _check_preallocated_output with thunk_csc codes%i - done with nodesNo code run for %s(ARRRRRRAR6R]R9R5RRR\RCRR R?RRRBRRtVariableR:RtMethodNotDefinedtNotImplementedErrorR[RR;t __class__R,texc_infoRRRRlR RR!R+RtstdouttflushR@R7RRRRR1RRR+Rtgctcollectt_find_bad_optimizationsRR^R5R6RZR<titemset(txR/toriginal_storage_map_keysR R tr_vals_initializedRvRtthunk_pyRRTtoptR$tnew_etexc_typet exc_valuet exc_tracethint2twarn_inptpy_inplace_outsRrtclobberRRtc_inplace_outsRR4RqRtRtstorage( RtRsRt input_storagetno_recycling_mapRtoutput_storageR"Rtthunks_ct thunks_py(RIRsRs8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pytfvs            >            >           $      "  !     c`sfd}|S(Nc`s7j}jjj_z SWd|_XdS(N(tfilter_checks_isfiniteRRR(told_filter_checks_isfinite(RURR"(s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pytdecos   ((RR(RUR"(Rs8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyt run_with_tensortype_filter_checks treadonly(8RbRURRR7RtreverseR t io_toposortRBRR(Rt map_storageR!RRRARR7t make_thunktdefault_make_thunkRRRt check_c_codeRRRRtOpt prepare_nodet make_c_thunkRCRRRwt__code__tPureOpt make_py_thunkRRRRRt differenceRRt unitteststrseedRRR]R9Rt Container(R"tprofilerRRRtinput_storage_toutput_storage_t fgraph_equivt order_outputst active_orderRRst compute_maptkt thunk_otherRqRRR/RRRRR(( RURtRsRRRRRR"RRRs8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pytmake_alls        ##  !            -   !!77N(R&R'R*RAR.RR(((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyRs   t NODEFAULTt_MakercB`sAeZdZdZeedddddZdeddZRS(s Special debugging FunctionMaker. Parameters ---------- inputs : list of SymbolicInput instances outputs : list of SymbolicOutput instances Outputs may also be a single Variable (not a list), in which case the functions produced by FunctionMaker will return their output value directly. accept_inplace True iff it is acceptable to have inplace operations in the graph from the inputs to the outputs. on_unused_input What to do if a variable in the 'inputs' list is not used in the graph. Possible values are 'raise', 'warn' and 'ignore'. output_keys If the outputs argument for theano.function was a list, then output_keys is None. If the outputs argument was a dict, then output_keys is a sorted list of the keys from that dict. Notes ----- The constructor sets TensorType.filter_checks_isfinite when `mode.check_isfinite` is True. ic  C`s||_|j} t} t} |dkr9t} g}nt|ttfs`t} |g}nt|ttfs|g}ng|D]} |j| ^q}g|D]}|j |^q}t j j g|D]}|j ^qg|D]!} t| dtr| j^q}|j|||g|D]}|g|j||^q3}xt|jD]|} t|||\}}}||_tjj}zHtjjtj_| |tjjj||tt||Wd|tj_X| dkr |}qh|jj}|jj}||krt}t dd|t dd|t dd|t dd|x#tt!t"|t"|D]}|t"|krt d|d|t d t#||d|q|t"|kr0t d | d |d|t d t#||d|q||||krt d | d |d|t d t#||d|t d t#||d|qqWt$|j%qh|j&rht d | dt"|ddt'j(qhqhW||_)t*|}gt+|j,||D]\}}|j-s|^q}|r_|j.|dt/|||_0n|j.||_0||_1||_ ||_2||_,| |_3| |_4||_5||_6||_7||_8| |_9dS(NRis,WARNING: Optimization process is unstable...R;s8 (HINT: Ops that the nodes point to must compare equal)s5(event index) (one event trace) (other event trace)s5-----------------------------------------------------s"trailing event in optimization 0 :s strailing event in optimizationt:snon-equal optimization eventssOPTCHECK: optimizationtofsevents was stable.R(:Rt optimizerRRAR!RRRotwrap_intwrap_outRR RBRR@Rt_check_unused_inputst expand_inR RRRRRtcompute_test_valuetcompute_test_value_opttcompiletfunction_moduletinsert_deepcopyRRR R?RaR]R\RRGtverboseR,R-RRRRtborrowRRtlinkertindicestexpanded_inputst unpack_singlet return_noneRtfunction_builderRton_unused_inputt output_keys(R"RBRRRR&RR'RR(RR$R%RIRt_inputsRR"tadditional_outputsRtcompute_test_value_origtfgraph0tlitl0tinfologtjR!RRt no_borrow((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR.; s      """ %)                (                       c C`s|dkr%dgt|j}ng}g}xht|j|D]T\\}}}} | } t| tjr|dk rtdn|j | j d} n|j dg|j dk r,| dkr|st| tjr|j t t dfq)t d|q|j t t | fqD| dkr|sPt| tjri|j t t dfq|j tt dfqD|j t t| fqDW|}|jjd|d|\} } } |j| | | |j|j||j|j|j| }|S(s Create a function. Parameters ---------- defaults A list matching the inputs list and providing default values if the default for an input is None, then that input is a required input. For an input with an update, the default acts as initialization. trustme Disables some exceptions, used internally. s@Cannot take a Container instance as default for a SymbolicInput.sKA default (initial) value is required for an input which can update itself.RRN(RAR]RBRR"RRRRRCRRRRR!R!RR&RR$R%R((R"tdefaultsttrustmeRRt _defaultsRR"t subinputstdefaultt_Maker__defaultt_fnt_it_oR((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pytcreate sB        N( R&R'R*RRRRAR.R;(((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR s wcC`stddS(Ns DebugMode is not picklable (yet)(R(R((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyt_pickle_DebugMode_Maker sRlc B`seZdZejjZejjZejj Z ejj Z ejj ZejjZejdZdZdddddddedZdZRS(s Evaluation Mode that detects internal theano errors. This mode catches several kinds of internal error: - Inconsistent outputs when calling the same Op twice with the same inputs, for instance if c_code and perform implementations, are inconsistent, or in case of incorrect handling of output memory (see `BadThunkOutput`). - A variable replacing another when their runtime values don't match. This is a symptom of an incorrect optimization step, or faulty Op implementation (raises `BadOptimization`). - Stochastic optimization ordering (raises `StochasticOrder`). - Incomplete `destroy_map` specification (raises `BadDestroyMap`). - An op that returns an illegal value not matching the output Variable Type (raises InvalidValueError). Each of these exceptions inherits from the more generic `DebugModeError`. If there are no internal errors, this mode behaves like FAST_RUN or FAST_COMPILE, but takes a little longer and uses more memory. Raises ------ DebugModeError If there are internal errors. Notes ----- The work of debugging is implemented by the `_Maker`, `_Linker`, and `_VariableEquivalenceTracker` classes. RcO`s(||kstt|||||S(s[ Return an instance of `_Maker` which handles much of the debugging work. (R9R(R"RIRtmtargstkwargs((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pytfunction_makerr stfast_runc C`st|ts!td|ntt|jd|d||dk rX||_n|dk rp||_n|dk r||_ n|dk r||_ n|dk r||_ n|dk r||_ n|jp|j st dndS(s If any of these arguments (except optimizer) is not None, it overrides the class default. The linker argument is not used. It is set there to allow Mode.requiring() and some other fct to work with DebugMode too. sBDebugMode can only use its own linker! You should not provide one.RR!s4DebugMode has to check at least one of c and py codeN(RRR[R-RlR.RARRRRRRR( R"RRRRRRRR!((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR.z s&             cC`sd|j|jfS(Ns"DebugMode(linker=%s, optimizer=%s)(tprovided_linkertprovided_optimizer(R"((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyR: sN(R&R'R*RRltpatienceRtcheck_cRtcheck_pyRt check_finiteRt check_stridesRRtsplitR@RARR.R:(((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyRl s$%       &t DEBUG_MODERRA(bR*t __future__RRRR7R,Rtloggingtsix.moves.copyregtmovestcopyregt itertoolsRRRnt theano.compatRtnumpyR^RRRRtsixR R t six.movesR R t theano.gofR RRRttheano.gof.linkRttheano.compile.function_moduleRRRRRRttheano.compile.modeRRttheano.compile.opsRt __docformat__t getLoggerRtFilterRt addFilterR[R)R+RORrRRRRRARRRRRRRR!RR+RR1R:R@RLRTRRRtobjectRRRRRRRRt _NODEFAULTRR<tpickleRl(((s8/tmp/pip-build-X4mzal/theano/theano/compile/debugmode.pyts      ".  Y:#>     =  U E  " ' 3 8 lL8