o h@sddlmZddlmZddlmZmZmZmZddl m Z ddl m Z m Z mZmZmZmZddlmZddlmZ edZGd d d e eeZGd d d eZd S))abstractmethod) defaultdict)AnyGenericOptionalTypeVar)override)_serialize_single_cache CacheArtifactCacheArtifactFactoryCacheArtifactManagerCacheArtifactsResult CacheInfo)AppendingByteSerializer) OrderedSetTc@sBeZdZdZed ddZedefddZede fdd Z dS) PrecompileCacheArtifacta5 Data for each cache artifact that will be serialized and deserialized by PrecompileContext, rather than CacheArtifactManager. T represents the deserialized type of the artifact, i.e. the return type of after_deserialization PrecompileCacheArtifact is a frozen dataclass - you can add new serializable fields and metadata specific to your own artifacts as needed, and use them in after_deserialization. Example implementation: class MyPrecompileCacheArtifact(PrecompileCacheArtifact[MySerializableType]): my_field: int def after_deserialization(self) -> MySerializableType: result = pickle.loads(self.content) # Do some extra work post deserialization result.my_post_deserialization_function(self.my_field) return result returnNcCtd)Nz1Precompile cache artifacts do not populate caches) RuntimeErrorselfrf/home/www/facesmatcher.com/frenv_anti/lib/python3.10/site-packages/torch/_dynamo/precompile_context.pypopulate_cache.z&PrecompileCacheArtifact.populate_cachecCdS)NTrrrrrprecompile_compatible2sz-PrecompileCacheArtifact.precompile_compatiblecCr)z Code to be run after reading raw byte contents from disk. Generally converts self.content from raw bytes back into its original form. Nrrrrrafter_deserialization6sz-PrecompileCacheArtifact.after_deserializationrN) __name__ __module__ __qualname____doc__rrboolrrrrrrrrrs rc seZdZUdZiZeeefed<e e Z e ed<e Ze eed<eedZeeee efed<eZeed<edfd d Zeed ed ededd fddZedddZed edeefddZedeeeefffdd Zede defddZ edddZ!Z"S)PrecompileContexta PrecompileContext is a special CacheArtifactManager for handling precompilation It uses the same interface as CacheArtifactManager, but handles deserialization differently: instead of placing each artifact into respective caches, it will stitch all the cache artifacts for a single key together and place it into a global Precompile Cache. The following artifact types are supported by PrecompileContext: - BundledAOTAutogradCacheArtifact - CodeStateArtifact (from torch._dynamo.package once available) _new_cache_artifacts_by_key_new_cache_artifacts_seen_artifacts)Z serialize_fn _serializer _cache_inforNcs|jtdSN)r&clearsupercls __class__rrr,]s zPrecompileContext.clear artifact_typekeycontentcCs6t|||}||jvrdS||j|<|j|dS)zg Called from each caching operation to record the artifact in this "mega" list N)r Z encode_creater(r&add)r/r2r3r4artifactrrrrecord_artifactbs   z!PrecompileContext.record_artifactcCs4|jD] }|j|j|q|jdS)z We normally record artifacts by key, but serialization expects them to be organized by artifact type. This function transfers artifacts from _new_cache_artifacts_by_key to _new_cache_artifacts N)r&valuesr'r1typeappendr,)r/r6rrr_save_artifacts_by_typezsz)PrecompileContext._save_artifacts_by_typecCs|j|dS)zP Serialize all artifacts with the given key returned in a list. N)r&get)r/r3rrrserialize_artifact_by_keysz+PrecompileContext.serialize_artifact_by_keycs|tSr+)r;r- serializer.r0rrr>s zPrecompileContext.serialize artifactscCr)NTODO)NotImplementedError)r?rrrpopulate_cachesrz!PrecompileContext.populate_cachescCsddlm}dS)Nr)BundledAOTAutogradCacheArtifact)Z-torch._functorch._aot_autograd.autograd_cacherC)r/rCrrr"_ensure_cache_artifacts_registeredsz4PrecompileContext._ensure_cache_artifacts_registeredr)#r r!r"r#r&dictstrr __annotations__rlistr'r rr(rr r)tuplerr* classmethodr,rrr7r;rr=bytesr> staticmethodrBrD __classcell__rrr0rr%?s>    r%N)abcr collectionsrtypingrrrrZtyping_extensionsrZtorch.compiler._cacher r r r r rZ&torch.utils._appending_byte_serializerrZtorch.utils._ordered_setrrrr%rrrrs     &