˽Xc@`sydZddlmZmZmZddlZddlZddlZddl m Z m Z ddl Z ddlmZddlmZmZmZmZmZmZmZddlmZmZdd lmZejd kZdZdZ d Z!d Z"d Z#dZ$ide6de 6de!6de"6de#6de$6d5d6d7d8d9gd6dd6Z%i ed6ed6ed6ed6e d6e d6e!d6e"d6e#d6e$d6e$d 6Z&dZ'dZ(d Z)id!d6d"d6d#d 6d$d 6d%d 6Z*id&e'6d'e(6d(e)6Z+d)e,fd*YZ-d+e,fd,YZ.d-efd.YZ/d/d0Z0d1e,fd2YZ1d3e,fd4YZ2dS(:s1 Classes for read / write of matlab (TM) 4 files i(tdivisiontprint_functiontabsolute_importN(tasbytestasstr(t string_typesi(t MatFileReadert docfillertmatdimst read_dtypetconvert_dtypest arr_to_charstarr_dtype_number(tsqueeze_elementtchars_to_strings(treducetlittleiiiitf8tf4ti4ti2tu2tu1tmopttmrowstncolstimagftnamlentheadertU1tc32tc24tc16tc8tS1ts VAX D-floats VAX G-floattCraytdoubletchartsparset VarHeader4cB`seZeZeZdZRS(cC`s1||_||_||_||_||_dS(N(tnametdtypetmclasstdimst is_complex(tselfR*R+R,R-R.((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pyt__init__Us     (t__name__t __module__tFalset is_logicalt is_globalR0(((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pyR)Pst VarReader4cB`s\eZdZdZdZedZedZdZdZ dZ dZ RS( s" Class to read matlab 4 variables cC`s=||_|j|_|j|_|j|_|j|_dS(N(t file_readert mat_streamtdtypestchars_as_stringst squeeze_me(R/R7((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pyR0es     c C`s?t|j|jd}|jjt|djd}|ddks^|ddkrmtdnt|dd\}}|dkrtj d t |t nt|d \}}|dkrtd nt|d \}}|}|d|df}|dd k} |j|} t || ||| S(s% Read and return header for variable RRtRiis.Mat 4 mopt wrong format, byteswapping problem?iisBWe do not support byte ordering '%s'; returned data may be corruptids,O in MOPT integer should be 0, wrong format?i RRR(ii( R R8R9treadtinttstript ValueErrortdivmodtwarningstwarnt order_codest UserWarningR)( R/tdataR*tMtresttOtPtTR-R.R+((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pyt read_headerls.%      cC`s|j}|tkr'|j|}ne|tkrc|j|}|r|jrt|}qn)|tkr||j|St d||r|j rt |S|S(NsNo reader for class code %s( R,t mxFULL_CLASStread_full_arrayt mxCHAR_CLASStread_char_arrayR:RtmxSPARSE_CLASStread_sparse_arrayt TypeErrorR;R (R/thdrtprocessR,tarr((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pytarray_from_headers      c C`s|j}|j}|j}x|D]}||9}q"W|jjt|}t||krvtd|jnt j d|d|d|dd}|r|j }n|S(s Mat4 read using header `hdr` dtype and dims Parameters ---------- hdr : object object with attributes ``dtype``, ``dims``. dtype is assumed to be the correct endianness copy : bool, optional copies array before return if True (default True) (buffer is usually read only) Returns ------- arr : ndarray of dtype givem by `hdr` ``dtype`` and shape givem by `hdr` ``dims`` sNot enough bytes to read matrix '%s'; is this a badly-formed file? Consider listing matrices with `whosmat` and loading named matrices with `variable_names` kwarg to `loadmat`tshapeR+tbuffertordertF( R+R-titemsizeR8R=R>tlenR@R*tnptndarraytcopy( R/RTR`tdtR-t num_bytestdRYRV((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pytread_sub_arrays      cC`sL|jr?|j|dt}|j|dt}||dS|j|S(sM Full (rather than sparse) matrix getter Read matrix (array) can be real or complex Parameters ---------- hdr : ``VarHeader4`` instance Returns ------- arr : ndarray complex array if ``hdr.is_complex`` is True, otherwise a real numeric array R`y?(R.RdR3(R/RTtrestres_j((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pyRNs   cC`sg|j|jtj}|jjd}tjd|jdtjddtj |j S(s latin-1 text matrix (char matrix) reader Parameters ---------- hdr : ``VarHeader4`` instance Returns ------- arr : ndarray with dtype 'U1', shape given by `hdr` ``dims`` slatin-1RXR+RRY( RdtastypeR^tuint8ttostringtdecodeR_R-R+tarrayR`(R/RTRVtS((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pyRPs cC`s7|j|}|ddddf}|dddf}tj|dddfdd}tj|dddfdd}|d8}|d8}|jddkrtj|dddfdd }n>tj|dddfdd }|dddf|_tjj|||ff|S( s Read and return sparse matrix type Parameters ---------- hdr : ``VarHeader4`` instance Returns ------- arr : ``scipy.sparse.coo_matrix`` with dtype ``float`` and shape read from the sparse matrix data Notes ----- MATLAB 4 real sparse arrays are saved in a N+1 by 3 array format, where N is the number of non-zero values. Column 1 values [0:N] are the (1-based) row indices of the each non-zero value, column 2 [0:N] are the column indices, column 3 [0:N] are the (real) values. The last values [-1,0:2] of the rows, column indices are shape[0] and shape[1] respectively of the output matrix. The last value for the values column is a padding 0. mrows and ncols values from the header give the shape of the stored matrix, here [N+1, 3]. Complex data is saved as a 4 column matrix, where the fourth column contains the imaginary component; the last value is again 0. Complex sparse data do *not* have the header ``imagf`` field set to True; the fact that the data are complex is only detectable because there are 4 storage columns NiiiR+tintciitfloattcomplex(RdR^tascontiguousarrayRXtimagtscipyR(t coo_matrix(R/RTRettmpR-tItJtV((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pyRRs%%  (%c C`s|j}|tkr0ttt|j}nZ|tkrmttt|j}|jr|d }qn|tkrz|j }|j}t |dko|ddko|ddksd S|j j |j |dddtjdd d|d|j j|j }|j j |j |dddtjdd d|d|j j|j }t|t|f}ntd||jrtg|D]}|dkr|^q}n|S( swRead the shape of the array described by the header. The file position after this call is unspecified. iiiiRXR+RYsNo reader for class code %s((i(i(R,RMttupletmapR>R-ROR:RQR+R]R8tseekR\R^R_R=RSR;( R/RTR,RXRaR-trowstcolstx((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pytshape_from_header s.       2"" .( R1R2t__doc__R0RLtTrueRWRdRNRPRRR~(((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pyR6bs    $   )tMatFile4ReadercB`sYeZdZedZdZdZdZedZ ddZ dZ RS( s Reader for Mat4 files cO`s)tt|j|||d|_dS(sR Initialize matlab 4 file reader %(matstream_arg)s %(load_args)s N(tsuperRR0tNonet_matrix_reader(R/R8targstkwargs((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pyR01scC`s|jjdt|jtjd}|jjd|dkrKdS|dksc|dkrstrodprdStrdpdS(NiRR#iR$(R8RzR R^R+tSYS_LITTLE_ENDIAN(R/R((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pytguess_byte_order;s cC`s(tt|j|_t||_dS(sa Run when beginning read of variables Sets up readers from parameters in `self` N(R tmdtypes_templatet byte_orderR9R6R(R/((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pytinitialize_readGscC`sz|jj}td|jd}|jj|}|jr]|jtk r]|d9}n|j j |}||fS(sb Read and return header, next position Parameters ---------- None Returns ------- header : object object that can be passed to self.read_var_array, and that has attributes ``name`` and ``is_global`` next_position : int position in stream of next variable cS`s||S(N((R}ty((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pyt_sii( RRLRR-R+R\R.R,RQR8ttell(R/RTtntremaining_bytest next_position((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pytread_var_headerOs cC`s|jj||S(s Read array, given `header` Parameters ---------- header : header object object with fields defining variable header process : {True, False}, optional If True, apply recursive post-processing during loading of array. Returns ------- arr : array array with post-processing applied or not according to `process`. (RRW(R/RRU((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pytread_var_arrayfscC`st|tr|g}n|dk r6t|}n|jjd|ji}x|js |j\}}t |j }|dk r||kr|jj|qYn|j |||<|jj||dk rY|j |t |dkr Pq qYqYW|S(s, get variables from stream as dictionary Parameters ---------- variable_names : None or str or sequence of str, optional variable name, or sequence of variable names to get from Mat file / file stream. If None, then get all variables in file iN(t isinstanceRRtlistR8RzRt end_of_streamRRR*RtremoveR](R/tvariable_namestmdictRTRR*((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pyt get_variablesxs(       cC`s|jjd|jg}x~|js|j\}}t|j}|jj|}t j |j d}|j |||f|jj|q#W|S(s list variables from stream itunknown( R8RzRRRRR*RR~t mclass_infotgetR,tappend(R/tvarsRTRR*RXtinfo((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pytlist_variabless N( R1R2RRR0RRRRRRRR(((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pyR/s    trowcC`s=t||}t|dkr0tdn|j|S(s Make ``arr`` exactly two dimensional If `arr` has more than 2 dimensions, raise a ValueError Parameters ---------- arr : array oned_as : {'row', 'column'}, optional Whether to reshape 1D vectors as row vectors or column vectors. See documentation for ``matdims`` for more detail Returns ------- arr2d : array 2D version of the array is=Matlab 4 files cannot save arrays with more than 2 dimensions(RR]R@treshape(RVtoned_asR-((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pyt arr_to_2dst VarWriter4cB`sYeZdZdZdZeeddZdZdZ dZ dZ RS( cC`s|j|_|j|_dS(N(t file_streamR(R/t file_writer((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pyR0s cC`s |jj|jdddS(NRZR[(RtwriteRi(R/RV((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pyt write_bytesscC`s|jj|dS(N(RR(R/ts((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pyt write_stringsic C`stjdtd}t }d}|d|d|d||d<|d|d<|d|d <||d tk r||rd|jd}n|jd}t}nX|j ||j d|dt d||r|j |j |j |jn |j |dS(Ntcitc128RRJRKR(RRR+tkindt np_to_mtypeststrtKeyErrorRgtmiDOUBLERRXRMRtrealRq(R/RVR*RRJ((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pyRs$    cC`st|}t||j}|j}|j||dtdt|jjdkrt j |}t j dd dt ||d|}|j jd}t j d|ddd|}n|j|dS( NRJRKtURXR+RYslatin-1R"((R RRRXRtmiUINT8ROR+RR^tproductR_R titemtencodeR(R/RVR*R-tn_charstst_arrtst((s3/tmp/pip-build-7oUkmx/scipy/scipy/io/matlab/mio4.pyRs    !cC`s;|j}|jjdk}tj|jdd|fdd}|j|dddf<|j|dddf<|dddd fcd7<|r|jj |ddd f<|jj |dddfsz    4     y