o h4 @s"UdZddlZddlZddlmZmZmZmZddlZddlm Z m Z ddl m Z mZmZddlmZddlmZee eefZejZejZd agaeeegdfeefed <eZe Z!eZ"e#ej$d rpej$j%Z&n d ed efddZ&e#ej$drej$j'Z(n d ed efddZ(ddZ)ddZ*d e+fddZ,dOddZ-Gddde.Z/d e+fddZ0d e+fdd Z1dPd eed dfd!d"Z2d efd#d$Z3d efd%d&Z4dPd eed efd'd(Z5dPd eed efd)d*Z6 dQd-eed.ed/ed dfd0d1Z7d e8eeffd2d3Z9d4eeeeegdfd dfd5d6Z:dPd eed eeeffd7d8Z;dOd9d:Zd?Z>dPd eed e8eeffd@dAZ?GdBd d Z GdCdDdDZ@d;edEd e@fdFd;ZAdRd eeeej fd e fdHdIZB GdRdJe d eeeej fd dfdKdLZCddMlDTgdNZEdS)SzH This package enables an interface for accessing MTIA backend in python N)AnyCallableOptionalUnion)deviceTensor) _dummy_type_LazySeedTracker classproperty)Device)_get_device_indexF _queued_calls_mtia_exchangeDevicerreturncC|dkrdStdNrz)PyTorch was compiled without MTIA support RuntimeErrorrrY/home/www/facesmatcher.com/frenv_anti/lib/python3.10/site-packages/torch/mtia/__init__.py_exchange_device%r_mtia_maybeExchangeDevicecCrrrrrrr_maybe_exchange_device/rrcCs tdSN) _lazy_initrrrrinit5 rcCs tot S)z9Return whether PyTorch's MTIA state has been initialized.) _initialized_is_in_bad_forkrrrris_initialized9s r#cC tjSr)torch_CZ_mtia_isInBadForkrrrrr">r r"c Cststtdr dStqtr WddStr tdts'tdtj dt_ t ddtDz1t D]'\}}z|Wq>tye}zdt|dd |}t||d}~wwWttdnttdwdaWddS1swYdS) Nis_initializingzwCannot re-initialize MTIA in forked subprocess. To use MTIA with multiprocessing, you must use the 'spawn' start methodzTorch not compiled with MTIA enabled. Ensure you have `import mtia.host_runtime.torch_mtia.dynamic_library` in your python src file and include `//mtia/host_runtime/torch_mtia:torch_mtia` as your target dependency!Tcss|]}|r|VqdSrr).0Zcallsrrr dsz_lazy_init..z6MTIA call failed lazily at initialization with error: z( MTIA call was originally invoked at: )r#hasattr_tls_initialization_lockr"r _is_compiledAssertionErrorr%r&Z _mtia_initr'rextend_lazy_seed_trackerZ get_calls ExceptionstrjoinDeferredMtiaCallErrordelattrr!)Z queued_callZorig_tracebackemsgrrrrBsB       "rc@s eZdZdS)r5N)__name__ __module__ __qualname__rrrrr5usr5cCr$)z*Return true if compiled with MTIA support.)r%r&Z _mtia_isBuiltrrrrr.y r.cCstsdStdkS)z'Return true if MTIA device is availableFr)r. device_countrrrr is_available~s r>cCs:tj| tjWdS1swYdS)z?Waits for all jobs in all streams on a MTIA device to complete.N)r%mtiarr&Z_mtia_deviceSynchronizerrrr synchronizes$r@cCr$)z,Return the number of MTIA devices available.)r%r&Z_mtia_getDeviceCountrrrrr= r=cCr$)z0Return the index of a currently selected device.)r%r&Z%_accelerator_hooks_get_current_devicerrrrcurrent_devicer<rBcCtjt|ddS)aSReturn the currently selected :class:`Stream` for a given device. Args: device (torch.device or int, optional): selected device. Returns the currently selected :class:`Stream` for the current device, given by :func:`~torch.mtia.current_device`, if :attr:`device` is ``None`` (default). Toptional)r%r&Z_mtia_getCurrentStreamr rrrrcurrent_stream rFcCrC)a=Return the default :class:`Stream` for a given device. Args: device (torch.device or int, optional): selected device. Returns the default :class:`Stream` for the current device, given by :func:`~torch.mtia.current_device`, if :attr:`device` is ``None`` (default). TrD)r%r&Z_mtia_getDefaultStreamr rrrrdefault_streamrGrHallpythonenabledstacks max_entriescCstsdStj|||dS)aEnable/Disable the memory profiler on MTIA allocator Args: enabled (all or state, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). stacks ("python" or "cpp", optional). Select the stack trace to record. max_entries (int, optional). Maximum number of entries to record. N)r#r%r&Z_mtia_recordMemoryHistory)rKrLrMrrrrecord_memory_historysrNcCr$)z4Return a dictionary of MTIA memory allocator history)r%r&Z_mtia_memorySnapshotrrrrsnapshotrArOobservercCstj|dS)z9Attach an out-of-memory observer to MTIA memory allocatorN)r%r&Z_mtia_attachOutOfMemoryObserver)rPrrrattach_out_of_memory_observersrQcCrC)aReturn capability of a given device as a tuple of (major version, minor version). Args: device (torch.device or int, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). TrD)r%r&Z_mtia_getDeviceCapabilityr rrrrget_device_capabilityrRcCr$)zEmpty the MTIA device cache.)r%r&Z_mtia_emptyCacherrrr empty_cacher<rTstreamcCs|durdStj|dS)aSet the current stream.This is a wrapper API to set the stream. Usage of this function is discouraged in favor of the ``stream`` context manager. Args: stream (Stream): selected stream. This function is a no-op if this argument is ``None``. N)r%r&Z_mtia_setCurrentStreamrUrrr set_streams rWcCs$t|}|dkrtj|dSdS)zSet the current device. Args: device (torch.device or int): selected device. This function is a no-op if this argument is negative. rN)r r%r&Z%_accelerator_hooks_set_current_devicerrrr set_devicesrXcCrC)zReturn a dictionary of MTIA device properties Args: device (torch.device or int, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). TrD)r%r&Z_mtia_getDevicePropertiesr rrrrget_device_propertiesrSrYc@s<eZdZdZdefddZddZdededefd d Zd S) rzContext-manager that changes the selected device. Args: device (torch.device or int): device index to select. It's a no-op if this argument is a negative integer or ``None``. cCst|dd|_d|_dS)NTrDr)r idxprev_idx)selfrrrr__init__ s zdevice.__init__cCstj|j|_dSr)r%r&(_accelerator_hooks_maybe_exchange_devicerZr[)r\rrr __enter__szdevice.__enter__typevalue tracebackcCstj|j|_dS)NF)r%r&r^r[rZ)r\r`rarbrrr__exit__szdevice.__exit__N)r9r:r;__doc__rr]r_rcrrrrrs c@sNeZdZUdZeded<dedfddZddZd ed ed efd d Z dS) StreamContextaContext-manager that selects a given stream. All MTIA kernels queued within its context will be enqueued on a selected stream. Args: Stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: Streams are per-device. torch.mtia.Stream cur_streamrUcCstd|_||_tdd|_tjs|jdurd|_tjs dntjd|_ tjs1d|_ dStjd|_ dS)NTr) rgrUr rZr%ZjitZ is_scriptingr?rHsrc_prev_streamdst_prev_stream)r\rUrrrr]&s     zStreamContext.__init__cCs|j}|dus |jdkrdStjd|_|jj|jkr9t|jtj|j|_Wdn1s4wYtj|dSNr) rUrZr%r?rFrhrrirW)r\rgrrrr_5s zStreamContext.__enter__r`rarbcCsJ|j}|dus |jdkrdS|jj|jkrtj|jtj|jdSrj)rUrZrhrr%r?rWri)r\r`rarbrgrrrrcDs zStreamContext.__exit__N) r9r:r;rdr__annotations__r]r_rrcrrrrres  rerfcCst|S)a,Wrap around the Context-manager StreamContext that selects a given stream. Arguments: stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: In eager mode stream is of type Stream class while in JIT it doesn't support torch.mtia.stream )rerVrrrrURsr?cCs$tjdtddtjdgtj|dS)zReturns the random number generator state as a ByteTensor. Args: device (torch.device or int, optional): The device to return the RNG state of. Default: ``'mtia'`` (i.e., ``torch.device('mtia')``, the current mtia device). z.get_rng_state is not implemented in torch.mtia stacklevelr )Zdtyper)warningswarn UserWarningr%ZzerosZuint8rrrr get_rng_state]s rr new_statecCstjdtdddS)aSets the random number generator state. Args: new_state (torch.ByteTensor): The desired state device (torch.device or int, optional): The device to set the RNG state. Default: ``'mtia'`` (i.e., ``torch.device('mtia')``, the current mtia device). z.set_rng_state is not implemented in torch.mtiarlrmN)rorprq)rsrrrr set_rng_statels   rt)*)rr>r#r@r=rBrFrHZ memory_statsZmax_memory_allocatedZreset_peak_memory_statsrRrYrNrOrQrTrXrWrUrrtrr)rNr)rIrJr)r?)Frd threadingrotypingrrrrr%rZ_devicerZ torch._utilsrr r Z torch.typesr Z_utilsr r3intZ _device_tEventZStreamr!rlisttuplerklocalr,Lockr-r1r+r&rrrrrr#boolr"rr2r5r.r>r@r=rBrFrHrNdictrOrQrRrTrWrXrYrerUrrrtZmemory__all__rrrrs       3       :