ó ¾÷Xc @@s˜dZddlmZddlZddlZddlZddlmZddl Z ddl m Z m Z m Z mZmZmZmZddlmZmZmZmZmZdd l mZdd l mZdd l mZdd lmZee d ƒƒZ!e j"ƒj#Z$d„Z%ddddddddddddd„ Z'de(fd„ƒYZ)e$r~de(fd„ƒYZ*ndefd„ƒYZ+dS(s7 Implements support for high-level dataset access. i(tabsolute_importN(txrangei(th5th5sth5tth5rth5dth5pth5fdi(tHLObjecttphilt with_philtEmptytis_empty_dataspace(tfilters(t selections(t selections2(tDatatypei cC@s˜t|ƒdkr|S|jdkr4tdƒ‚nx0|D](}||jkr;td|ƒ‚q;q;Wtjg|D]}||j|df^qtƒS(s, Make a NumPy dtype appropriate for reading is+Field names only allowed for compound typess&Field %s does not appear in this type.N(tlentnamestNonet ValueErrortnumpytdtypetfields(tbasetypeRtname((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pytreadtime_dtype"s c C@sÃ|dk rSt|tƒ rSddlm} tj|ddd| j|ƒƒ}n|dkr¡|dkr•|dkr†tdƒ‚nt|ƒ}n|j }nHt |ƒ}|dk rétj |ƒtj |j ƒkrét dƒ‚n|dk rû|n|}t|t ƒrPt d„t||ƒDƒƒrPd j||ƒ}t |ƒ‚nt|tƒrt|j}|j}nr|dkrž|dkržtjd ƒ}n3|dkrÂ|dk rÂ|j}ntj|ƒ}tj|d dƒ}t ||||| fƒr|tkrt d ƒ‚n|tkrF| dkr=d } nd}n|tkr|| dk rmtdƒ‚n|} d}ntj||||| |||| ƒ }| dk rÎtj| ƒ} |j| ƒn| ttfkrð|j| ƒn| dk r tdƒ‚n|dk r0t d„|Dƒƒ}nt|tƒrTtjtjƒ}ntj ||ƒ}t!j|jd||d|ƒ}|dk r¿t|tƒ r¿|j"tj#tj#|ƒn|S(sU Return a new low-level dataset identifier Only creates anonymous datasets. i(tbasetordertCRs-One of data, shape or dtype must be specifieds%Shape tuple is incompatible with datacs@s-|]#\}}|dk r||kVqdS(N(R(t.0tdimtchunk((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pys Oss^Chunk shape must not be greater than data shape in any dimension. {} is not compatible with {}s=f4tlogicals1Chunked format required for given storage optionsitgzipsConflict in compression optionss(track_times must be either True or Falsecs@s*|] }|dk r|ntjVqdS(N(RRt UNLIMITED(Rtm((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pys stdcplN($Rt isinstanceR tRRtasarrayt guess_dtypet TypeErrortshapettupletproductRtanytziptformatRtidRRt py_createtFalsetTruet_LEGACY_GZIP_COMPRESSION_VALSRt generate_dcpltarraytset_fill_valuetset_obj_track_timesRtcreatetNULLt create_simpleRtwritetALL(tparentR,Rtdatatchunkst compressiontshufflet fletcher32tmaxshapetcompression_optst fillvaluet scaleoffsett track_timesRt tmp_shapeterrmsgttidR&tsidtdset_id((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyt make_new_dset2sp '     -    '          !t AstypeContextcB@s)eZdZd„Zd„Zd„ZRS(sQ Context manager which allows changing the type read from a dataset. cC@s||_tj|ƒ|_dS(N(t_dsetRRt_dtype(tselftdsetR((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyt__init__—s cC@s|j|jj_dS(N(RSRRt_localtastype(RT((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyt __enter__›scG@sd|jj_dS(N(RRRRWRX(RTtargs((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyt__exit__Ÿs(t__name__t __module__t__doc__RVRYR[(((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyRQ‘s  tCollectiveContextcB@s)eZdZd„Zd„Zd„ZRS(s$ Manages collective I/O in MPI mode cC@s ||_dS(N(RR(RTRU((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyRVªscC@s|jjjtjƒdS(N(RRt_dxplt set_dxpl_mpioRtMPIO_COLLECTIVE(RT((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyRY­scG@s|jjjtjƒdS(N(RRR`RaRtMPIO_INDEPENDENT(RTRZ((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyR[±s(R\R]R^RVRYR[(((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyR_¤s  tDatasetcB@sZeZdZd„Zer3eed„ƒƒZneed„ƒƒZeed„ƒƒZ eed„ƒƒZ e j ed„ƒƒZ eed„ƒƒZ eed„ƒƒZ eed „ƒƒZeed „ƒƒZeed „ƒƒZeed „ƒƒZeed „ƒƒZeed„ƒƒZeed„ƒƒZeed„ƒƒZeed„ƒƒZed„ƒZd!d„Zed„ƒZd„Zed„ƒZed„ƒZed„ƒZd!d!d„Zd!d!d„Z ed!d„ƒZ!ed„ƒZ"e#e$j%dƒr4ed„ƒZ&ne#e$j%dƒrXed „ƒZ'nRS("s( Represents an HDF5 dataset cC@s t||ƒS(sÈ Get a context manager allowing you to perform reads to a different destination type, e.g.: >>> with dataset.astype('f8'): ... double_precision = dataset[0:100:2] (RQ(RTR((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyRX»scC@s t|ƒS(s3 Context manager for MPI collective reads & writes (R_(RT((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyt collectiveÅscC@sddlm}||ƒS(s3 Access dimension scales attached to this dataset. i(tDimensionManager(tdimsRf(RTRf((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyRgÌscC@s |jjS(s5Numpy-style attribute giving the number of dimensions(R2trank(RT((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pytndimÓscC@s |jjS(s1Numpy-style shape tuple giving dataset dimensions(R2R,(RT((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyR,ÙscC@s|j|ƒdS(N(tresize(RTR,((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyR,ÞscC@stj|jƒS(s3Numpy-style attribute giving the total dataset size(RtprodR,(RT((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pytsizeäscC@s |jjS(s%Numpy dtype representing the datatype(R2R(RT((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyRêscC@stdƒ|dS(s Alias for dataset[()] s;dataset.value has been deprecated. Use dataset[()] instead.((tDeprecationWarning(RT((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pytvalueðs cC@s,|j}|jƒtjkr(|jƒSdS(sDataset chunks (or None)N(t_dcplt get_layoutRtCHUNKEDt get_chunkR(RTR&((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyRBøs  cC@s(x!dD]}||jkr|SqWdS(sCompression strategy (or None)R#tlzftszip(sgzipRsRtN(t_filtersR(RTtx((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyRCs cC@s|jj|jdƒS(s< Compression setting. Int(0-9) for gzip, 2-tuple for szip. N(RutgetRCR(RT((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyRG scC@s d|jkS(sShuffle filter present (T/F)RD(Ru(RT((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyRDscC@s d|jkS(s"Fletcher32 filter is present (T/F)RE(Ru(RT((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyREscC@s,y|jddSWntk r'dSXdS(sScale/offset filter settings. For integer data types, this is the number of bits stored, or 0 for auto-detected. For floating point data types, this is the number of decimal places retained. If the scale/offset filter is not in use, this is None.RIiN(RutKeyErrorR(RT((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyRIs cC@s2|jjƒ}|jtƒ}td„|DƒƒS(scShape up to which this dataset can be resized. Axes with value None have no resize limit. cs@s*|] }|tjkr|ndVqdS(N(RR$R(RRv((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pys /s(R2t get_spacetget_simple_extent_dimsR5R-(RTtspaceRg((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyRF(scC@s0tjdd|jƒ}|jj|ƒ|dS(s*Fill value for this dataset (0 by default)iRi(i(RtndarrayRRotget_fill_value(RTtarr((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyRH1scC@sddlm}t|tjƒs5td|ƒ‚ntj||ƒ|jj ƒ|_ t j t j ƒ|_tj|j ƒ|_|ƒ|_d|j_dS(sJ Create a new Dataset object by binding to a low-level DatasetID. i(tlocals%s is not a DatasetIDN(t threadingRR'Rt DatasetIDRR RVR2tget_create_plistRoRR;t DATASET_XFERR`Rt get_filtersRuRWRRX(RTtbindR((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyRV9s c C@sÞtÒ|jdkr%tdƒ‚n|dk r¸|dkoL||jjksltd|jjdƒ‚nyt|ƒ}Wntk r›tdƒ‚nXt|j ƒ}|||Value too big for Python's __len__; use Dataset.len() instead.(Rtsystmaxsizet OverflowError(RTRl((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyt__len__is cC@sCt7|j}t|ƒdkr1tdƒ‚n|dSWdQXdS(sÐ The size of the first axis. TypeError if scalar. Use of this method is preferred to len(dset), as Python's built-in len() cannot handle values greater then 2**32 on 32-bit systems. is'Attempt to take len() of scalar datasetN(R R,RR+(RTR,((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyRts  cc@sR|j}t|ƒdkr*tdƒ‚nx!t|dƒD]}||Vq;WdS(sŠ Iterate over the first axis. TypeError if scalar. BEWARE: Modifications to the yielded data are *NOT* written to file. is#Can't iterate over a scalar datasetN(R,RR+R(RTR,ti((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyt__iter__€s  c C@s}t|tƒr|n|f}t|jƒrg|tƒkpH|tfksZtdƒ‚nt|jƒStd„|Dƒƒ}td„|Dƒƒ}tj rµtd„|Dƒƒ}nt |j ddƒ}|dk rèt ||ƒ}nt |jj|ƒ}tj|ƒ}t|ƒdkr%t|dtjƒr%tj|d|jƒ}||jkrktdƒ‚ntj|d|jƒ}tj|ƒ}|dkr²tjdd |ƒStj|ƒdkrÚtj|d |ƒStj|d |ƒ}tj|ƒ} | jƒ|jj| |||ƒ|Stj|jƒdkrt|tfks[|tƒkrttj|jd |ƒSn|jdkr*|jj ƒ} t!j"| |ƒ} tj#| j$d |ƒ} x-| D]%\} } |jj| | | |ƒqÃWt|ƒdkr| |d} n| j$dkr&| dS| Stj%|j|d |jƒ} | j&dkrmtj#| j$d |ƒS| j$dk}|rˆdn| j$}tj#||d d ƒ} t|ƒt|jƒkrèdt|jƒt|ƒ|}ntj|ƒ} | j} |jj| | | |d |j'ƒt|ƒdkrE| |d} n| jdkrftj(| ƒ} n|ry| d} n| S(s Read a slice from the HDF5 dataset. Takes slices and recarray-style field names (more than one is allowed!) in any order. Obeys basic NumPy rules, including broadcasting. Also supports: * Boolean "mask" array indexing sEmpty datasets cannot be slicedcs@s'|]}t|tjƒr|VqdS(N(R'tsixt string_types(RRv((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pys  scs@s'|]}t|tjƒs|VqdS(N(R'R‘R’(RRv((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pys ¡scs@s6|],}t|tjƒr*|jdƒn|VqdS(sutf-8N(R'R‘t text_typetencode(RRv((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pys £sRXiis+Region reference must point to this datasetRtdsidRRtdxplN(i((((i(i(()R'R-R R2tEllipsisRR RR‘tPY2tgetattrRWRRRR3RRtRegionReferencet dereferencet get_regiontselt guess_shapeRR8R.temptyRR=t select_alltreadR,Rytsel2t select_readR|tmshapetselecttnselectR`tasscalar(RTRZRt new_dtypetmtypetobjRNR¤touttsid_outtfspacet selectionR~tmspacetsingle_element((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyt __getitem__sz    (  $ " cC@st|tƒr|n|f}td„|Dƒƒ}td„|Dƒƒ}tjrltd„|Dƒƒ}ntjd|jƒ}|dk rÕ|ttj fkrÕyt j |d|ƒ}Wnct k r y>t j g|D]}t j |d|ƒ^qÛd|jƒ}Wq!t k rq!XnX||jkrA|jdkr§t jd|jd dtƒ}g|jt j|jd ƒ|jdfƒD] }|^q‹|jƒ(n"t j dgdtƒ}||d <|}qAnl|jjd ks0|jjd kr,t|t jƒ s|jjd kr,|jjdkr,t|ƒdkr¢|jjdk r¢|d |jjkrt d |d ƒ‚n|jj|d d }t} n|j}t} t j |d|jd dƒ}| rA|jt j|d |fgƒƒ}|j|jt|jƒt|jƒ ƒ}qAnt j |d dƒ}|jjdk rã|jjd} |jt| ƒ } | | krœtd| | fƒ‚ntjt j|j| fƒƒ} |jd t|jƒt| ƒ!} nÏt|ƒd kr£|j} |jjdkrtdƒ‚ng|D]}||jjkr&|^q&}t|ƒd krˆdj d„|Dƒƒ}t d|ƒ‚nt|ƒdkrü|jjdkrütj|jƒ}tj!tj"|j#ƒƒ} | j$|j%|d ƒd |ƒq²g|jj&D]}||kr |^q }tj!tj"|jj'ƒ} xm|D]S}tj|jj|d ƒ}|jj|d}| j$|j%|ƒ||ƒqIWn|j} d} t(j)|j|d|j*ƒ}|j+d krãdS| dkrZ|j,dkrZ|jjdk rtdƒ‚nt j|j,dd|jƒ}||d<|}|j} nt| ƒt|jƒkr™dt|jƒt| ƒ| }n| }t-j.|t-j/ft|ƒƒ}x9|j0| ƒD](}|j*j1|||| d|j2ƒqÑWdS(sÔ Write to the HDF5 dataset from a Numpy array. NumPy's broadcasting rules are honored, for "simple" indexing (slices and integers). For advanced indexing, the shapes must match. cs@s'|]}t|tjƒr|VqdS(N(R'R‘R’(RRv((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pys scs@s'|]}t|tjƒs|VqdS(N(R'R‘R’(RRv((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pys scs@s6|],}t|tjƒr*|jdƒn|VqdS(sutf-8N(R'R‘R“R”(RRv((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pys stvlenRiR,iÿÿÿÿitOtVsNo such field for indexing: %sRRsWWhen writing to array types, last N dimensions have to match (got %s, but should be %s)s1Illegal slicing argument (not a compound dataset)s, cs@s|]}d|VqdS(s"%s"N((RRv((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pys Gss8Illegal slicing argument (fields %s not in dataset type)R•Ns5Scalar broadcasting is not supported for array dtypes.R–(((i(3R'R-R‘R˜Rt check_dtypeRRtbytesR“RR)RR8RiRŸR,tobjecttreshapeR.traveltkindR|tsubdtypeRRR5R4RtviewR+R3tjoinR;tCOMPOUNDtget_sizetinsertt_eRtitemsizeRR¥R2R¦R¤RR=R$t broadcastR>R`(RTRZtvalRR²RvttmpRRt cast_compoundtshptvalshpR©R¤tmismatchtsubtypet fieldnamest fieldnametoffsetR®tval2t mshape_padR¯R­((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyt __setitem__ús¤ !  5  @  %$  %2 !& +$#+ #   $"c C@sìtàt|jƒr%tdƒ‚n|dkrFtj|jƒ}ntj|j||jƒ}|j}|dkr‹tj|jƒ}ntj|j||jƒ}x9|j |j ƒD]%}|jj |||d|j ƒq¹WWdQXdS(sù Read data directly from HDF5 into an existing NumPy array. The destination array must be C-contiguous and writable. Selections must be the output of numpy.s_[]. Broadcasting is supported for simple indexing. s+Empty datasets have no numpy representationR–N( R R R2R+RRtSimpleSelectionR,R¥RÃR¤R¡R`(RTtdestt source_seltdest_selR­R¯((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyt read_directxs   c C@sìtàt|jƒr%tdƒ‚n|dkrFtj|jƒ}ntj|j||jƒ}|j}|dkr‹tj|jƒ}ntj|j||jƒ}x9|j |j ƒD]%}|jj |||d|j ƒq¹WWdQXdS(sÝ Write data directly to HDF5 from a NumPy array. The source array must be C-contiguous. Selections must be the output of numpy.s_[]. Broadcasting is supported for simple indexing. s#Empty datasets cannot be written toR–N( R R R2R+RRRÑR,R¥RÃR¤R>R`(RTtsourceRÓRÔR¯R­((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyt write_direct‘s   cC@sZtj|jd|dkr$|jn|ƒ}tj|jƒdkrI|S|j|ƒ|S(sá Create a Numpy array containing the whole dataset. DON'T THINK THIS MEANS DATASETS ARE INTERCHANGABLE WITH ARRAYS. For one thing, you have to read the whole dataset everytime this method is called. RiN(RRŸR,RRR.RÕ(RTRR~((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyt __array__ªs - cC@sÊ|stjdƒ}n˜|jdkr9tjdƒ}nRtjtj|jƒƒ}tjdƒ|tjdƒkr{|n tjdƒ}tjdƒ||j|jj f}tj rÆ|j dƒS|S(Nss ("anonymous")s"%s"R(t/s&tutf8( R‘tuRRtpptbasenametnormpathR,RtstrR˜R”(RTtrtnamestrR((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyt__repr__¹s +   trefreshcC@s|jjƒdS(sÆ Refresh the dataset metadata by reloading from the file. This is part of the SWMR features and only exist when the HDF5 librarary version >=1.9.178 N(t_idRã(RT((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyRãËstflushcC@s|jjƒdS(s Flush the dataset data and metadata to the file. If the dataset is chunked, raw data chunks are written to the file. This is part of the SWMR features and only exist when the HDF5 librarary version >=1.9.178 N(RäRå(RT((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyRåÕsN((R\R]R^RXtMPItpropertyR ReRgRiR,tsetterRlRRnRBRCRGRDRERIRFRHRVRRjRŽRRR±RÐRÕR×RØRâthasattrRRRãRå(((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyRdµsf     m~ (,R^t __future__Rt posixpathRÜR‹R‘t six.movesRRR(RRRRRRRRR R R R R RRRRR¢tdatatypeRt frozensettrangeR6t get_configtmpiRæRRRPR·RQR_Rd(((s./tmp/pip-build-isqEY4/h5py/h5py/_hl/dataset.pyt s.    4(    \