ó ąĘ÷Xc@`sfdZddlmZmZmZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl m Z ddlmZddlZddlZddlmZdZdZd Zd Zd Zd Zejd ƒZe j ƒZdZdZdZ ej!Z!ga"e#a$d„Z%d„Z&de'fd„ƒYZ(de(fd„ƒYZ)dS(s8 ProfileStats object for runtime and memory profiling. i(tabsolute_importtprint_functiontdivisionN(t defaultdict(t iteritems(tgraphsJames BergstrasRazvan Pascanus (c) 2011, Universite de Montreals3-clause BSD Licenses(theano-dev srestructuredtext enstheano.compile.profilinggc C`s,tjrg}tjjdkr-tj}n3tjjdkrKtj}nttjjdƒ}x“tt dd„ƒddd…D]}|j dksæ|j dksæt |d d ƒdkr |j d |d tjjd tjjƒt|tƒs|j|ƒqqƒtdƒqƒWt|ƒdkrtj|d ƒ}dt|ƒ}||_x|dD]ƒ}xOdddddddddg D],}t||t ||ƒt ||ƒƒqˆWxqddddddgD]W}t ||ƒ}x?tt ||ƒƒD](\}}||kst‚|||@sNi’’’’it callcountitfiletn_ops_to_printtn_apply_to_printsSkipping empty ProfilesBSum of all(%d) printed profiles at exit excluding Scan op profile.R R t fct_callcountt vm_call_timetoptimizer_timet linker_timet validate_timet import_timetlinker_node_make_thunkst apply_timetapply_callcountt apply_cimpltvariable_shapetvariable_stridestlinker_make_thunk_times&Got an exception while merging profile(tconfigtprofilet profilingt destinationtsysRRtopentsortedt_atexit_print_listRR tgetattrtsummarytn_opstn_applyt isinstancetScanProfileStatstappendtprinttlentcopytmessagetsetattrRtAssertionErrortoptimizer_profilet merge_profilet ExceptiontNonetprint_global_stats( tto_sumtdestination_filetpstcumtmsgtattrtcum_attrR tvaltmergete((s8/tmp/pip-build-X4mzal/theano/theano/compile/profiling.pyt_atexit_print_fn/sh           *   "  %     cC`sŖtjjdkrtj}n3tjjdkr<tj}nttjjdƒ}tddd|ƒtddtjƒt t t t fd|ƒtddd|ƒd S( sī Print the following stats: -- Time elapsed since Theano was imported -- Time spent inside Theano functions -- Time spent in compiling Theano functions -- on graph optimization -- on linker RRRt=i2RsGlobal stats: s¢Time elasped since Theano import = %6.3fs, Time spent in Theano functions = %6.3fs, Time spent compiling Theano functions: optimzation = %6.3fs, linker = %6.3fs N( RR!R"R#RRR$R.ttimettheano_imported_timettotal_fct_exec_timettotal_graph_opt_timettotal_time_linker(R:((s8/tmp/pip-build-X4mzal/theano/theano/compile/profiling.pyR8ws     t ProfileStatscB`smeZdZd„ZdZdZdZdZeZ eZ eZ eZ iZ iZdZdZdZdZdZiZejjZdZeZeeed„Zd„Zd„Zd„Zd „Z d „Z!d „Z"d „Z#d „Z$d„Z%d„Z&e'j(ed„Z)e'j(ed„Z*e'j(ed„Z+d„Z,d„Z-ed„Z.e'j(ddd„Z/d„Z0RS(sæ Object to store runtime and memory profiling information for all of Theano's operations: compilation, optimization, execution. Parameters ---------- atexit_print : bool True means that this object will be printed to stderr (using .summary()) at the end of the program. **kwargs : misc initializers These should (but need not) match the names of the class vars declared in this class. cC`s1d|_d|_d|_i|_i|_dS(s Ignore previous function callgiN(R RRRR(tself((s8/tmp/pip-build-X4mzal/theano/theano/compile/profiling.pytreset¦s     gii’’’’cK`sƒtjr‡|r‡ttdƒr?ttjdƒr?tjjjsZttdƒr‡tjjr‡t j j ddƒdkr‡t dƒ‚q‡ntjrĪ|rĪttdƒrĪtjjrĪtj j rĪtjdƒni|_i|_i|_i|_i|_i|_|dkr"tj j|_n ||_|jj|ƒ|rmtj|ƒtsmtj t!ƒt"aqmntjj j|_dS( NtsandboxtcudatgpuarraytCUDA_LAUNCH_BLOCKINGt0t1s$You are running the Theano profiler with CUDA enabled. Theano GPU ops execution is asynchronous by default. So by default, the profile is useless. You must set the environment variable CUDA_LAUNCH_BLOCKING to 1 to tell the CUDA driver to synchronize the execution to get a meaningful profile.s˜Theano flag profiling.ignore_first_call is False. This cause bad profiling result in the new gpu back-end, we as sometimes we compile at the first call.(#RR thasattrttheanoRMRNt cuda_enabledROtpygpu_activatedtostenvirontgetR6R!tignore_first_calltloggertwarnRt output_sizeRRRRR7t time_thunkstflag_time_thunkst__dict__tupdateR&R-t_atexit_registeredtatexittregisterRCtTrue(RKt atexit_printR_t gpu_checkstkwargs((s8/tmp/pip-build-X4mzal/theano/theano/compile/profiling.pyt__init__žs>               cC`sYi}xLt|jƒD];\}}t|jƒ}|j|dƒ||c|7 total time on thunks i(RRttypetopt setdefault(RKtrvaltnodettttyp((s8/tmp/pip-build-X4mzal/theano/theano/compile/profiling.pyt class_time+s cC`sYi}xLt|jƒD];\}}t|jƒ}|j|dƒ||c|7 total number of thunk calls i(RRRjRkRl(RKRmRntcountRp((s8/tmp/pip-build-X4mzal/theano/theano/compile/profiling.pytclass_callcount8s cC`sYi}xLt|jƒD];\}}t|jƒ}|j|dƒ||cd7 total number of nodes ii(RRRjRkRl(RKRmRnRrRp((s8/tmp/pip-build-X4mzal/theano/theano/compile/profiling.pyt class_nodesEs cC`s’i}x…|jD]z}t|jƒ}|j|r;d}nd}|j||ƒ|||krt||ƒdkr||c|7 total number of nodes sC tPyi(RRjRkRRlR/(RKRmRnRptimpl((s8/tmp/pip-build-X4mzal/theano/theano/compile/profiling.pyt class_implRs  &cC`sPi}xCt|jƒD]2\}}|j|jdƒ||jc|7 total time on thunks i(RRRlRk(RKRmRnRo((s8/tmp/pip-build-X4mzal/theano/theano/compile/profiling.pytop_timeds cC`s}|j|}x_|jƒD]Q}|j|jkr|j|krW|j|j|ƒn|||j7}qqW||| fill total time icluding its parents (returns nothing) N(Rt get_parentstownertfill_node_total_time(RKRnt total_timesttotaltparent((s8/tmp/pip-build-X4mzal/theano/theano/compile/profiling.pyR{ps cC`s=i}x0|jD]%}||kr|j||ƒqqW|S(sF dict op -> total time icluding the time for parents (RR{(RKRmRn((s8/tmp/pip-build-X4mzal/theano/theano/compile/profiling.pytcompute_total_times~s  cC`sPi}xCt|jƒD]2\}}|j|jdƒ||jc|7 total number of thunk calls i(RRRlRk(RKRmRnRr((s8/tmp/pip-build-X4mzal/theano/theano/compile/profiling.pyt op_callcount‰s cC`sPi}xCt|jƒD]2\}}|j|jdƒ||jcd7 total number of nodes ii(RRRlRk(RKRmRnRr((s8/tmp/pip-build-X4mzal/theano/theano/compile/profiling.pytop_nodes•s cC`sHi}x;|jD]0}|j|r3d||j 'C' or 'Py' depending how the op is implemented sC Ru(RRRk(RKRmRn((s8/tmp/pip-build-X4mzal/theano/theano/compile/profiling.pytop_impl”s  c C`sŸ|jr!t|jjƒƒ}nd}|dkrGtdd|ƒdS|jƒ}|jƒ}|jƒ}|jƒ}|dkr•t |jƒ}ngt |ƒD]P\}} | d|| ||j |dƒ|j |dƒ|j |dƒf^q¢} | j dd„dt ƒd} td d|ƒtd d|ƒg} g} | d g7} | d g7} | d g7} | dg7} | dg7} | dg7} | dg7} | dg7} | dg7} | dg7} | dg7} | dg7} | dg7} | dg7} tjg| D]}t |ƒ^qƒt | ƒ}t|j|dƒ}| dg7} | dg7} dj| ƒ}dj| ƒ}t|d|ƒx§| | D]›\}} }}}}|dkrŠ| dks”t‚q”n| | 7} | d|}t|ƒdd!| }t|||| | |||||fd|ƒq”Wtdtdt | ƒ|ƒtd„| |Dƒƒtd „| |Dƒƒfd|ƒtd!d|ƒdS("NisMProfileStats.summary_class: total time 0 (did you forget to enable counters?)Rids R cS`s|d|d|dfS(Niii((Ro((s8/tmp/pip-build-X4mzal/theano/theano/compile/profiling.pyR ÅstreversetClasss---s<% time>s %4.1f%% ss %5.1f%% s s %7.3fs s