o h$@s@ddlmZddlZddlZddlmZddlmZmZm Z ddl m Z ddl m Z ddlmZddlmZdd lmZmZmZmZdd lmZdd lmZGd d d eZeZeeddZeeddZ ej!ddZ"eej#e eddeej$ddZ%ddZ&eddZ'ddZ(ddZ)d d!Z*dS)")contextmanagerN) DispatchKey)_ConstantFunction flat_apply to_graphable strict_mode)autograd_not_implemented)HigherOrderOperator)FakeTensorMode)get_proxy_slotPreDispatchTorchFunctionModeProxyTorchDispatchModetrack_tensor_tree)_pytree)"is_traceable_wrapper_subclass_typecs(eZdZfddZfddZZS)ExportTracepointcstddS)N_export_tracepoint)super__init__)self __class__\/home/www/facesmatcher.com/frenv_anti/lib/python3.10/site-packages/torch/_export/wrappers.pyrszExportTracepoint.__init__cstj|i|SN)r__call__)rargskwargsrrrrzExportTracepoint.__call__)__name__ __module__ __qualname__rr __classcell__rrrrrs rcOs<t|jj||f\}}|jdt||}t||d|jdS)N call_functionZconstanttracer)pytreeZtree_mapr&Z unwrap_proxy create_proxyrr)moderrZp_argsZp_kwargsproxyrrrexport_tracepoint_dispatch_mode%s r+cOs,| |WdS1swYdSrr)r)rrrrr"export_tracepoint_fake_tensor_mode.s$r,cOsR||}||}|t|i||WdS1s"wYdSr)Zunwrap_tensorsZredispatch_to_nextr)ctxrrZunwrapped_argsZunwrapped_kwargsrrrexport_tracepoint_functional4s   $r.T)Zdeferred_errorcOs|Srr)rrrrrexport_tracepoint_cpuCsr/cst|tjjs JdksJtjj|}fddddfdd}fdd }|j|d d }|j|d d }||fS) NcsB|vr|d|ksJ|d|ksJ||d|<dS)Nin_specout_spec)r1r2r)pathr1r2)module_call_specsrrupdate_module_call_signaturesMsz6_wrap_submodule..update_module_call_signaturescSs:|D]}t|tjttttfs|dustd|qdS)NzGOnly Tensors or scalars are supported as pytree flattened inputs, got: ) isinstancetorchTensorstrintfloatboolAssertionError) flat_argsarrrcheck_flattenedSsz(_wrap_submodule..check_flattenedcsBt||f\}}|t|dd}t||\}}||fS)NZmodule_call_inputskindr3r' tree_flattenrZtree_unflatten)modulerrr>r1)r@r3rrpre_hookZs z!_wrap_submodule..pre_hookcsPt||f\}}t|\}}|t|dd}||t||S)NZmodule_call_outputsrArC)rErrres_r1Zflat_resr2)r@r3r5rr post_hookas   z"_wrap_submodule..post_hookT)Z with_kwargs) r6r7nnModuleZfxZ graph_moduleZ _get_attrZregister_forward_pre_hookZregister_forward_hook)modr3r4 submodulerFrIZ pre_handleZ post_handler)r@r4r3r5r_wrap_submoduleHs  rNc csVg}z|D] }|t|||qdVW|D]}|qdS|D]}|q#wr)extendrNremove)fZpreserve_signatureZmodule_call_signaturesZhandlesr3handlerrr_wrap_submodulesns  rScCsdd}||_|S)NcWs t||Srr)rrrrrcall|s z'_mark_strict_experimental..call)r)clsrTrrr_mark_strict_experimental{srVcCs`|d}t|j|rt|j||ksJ|d|diS||}t|j|||d|diS)a This is a wrapper utility method on top of tracer to cache the already registered subclass spec attribute. This is useful because Subclass.__init__ will be same for each subclass. By default, fx will create multiple attributes/proxies for given attribute. 0get_attrr)hasattrrootgetattrr(get_fresh_qualnamesetattr)r&namespecZfx_namequalnamerrr'_register_subclass_spec_proxy_in_tracers  racs2dd}|stdjdfdd}|S)a) Experimental decorator that makes subclass to be traceable in export with pre-dispatch IR. To make your subclass traceble in export, you need to: 1. Implement __init__ method for your subclass (Look at DTensor implementation) 2. Decorate your __init__ method with _mark_constructor_exportable_experimental 3. Put torch._dynamo_disable decorator to prevent dynamo from peeking into its' impl Example: class FooTensor(torch.Tensor): @staticmethod def __new__(cls, elem, *, requires_grad=False): # ... return torch.Tensor._make_subclass(cls, elem, requires_grad=requires_grad) @torch._dynamo_disable @mark_subclass_constructor_exportable_experimental def __init__(self, elem, ...): # ... cSst|o|jdkS)Nr)callabler )fnrrr_is_initrzCmark_subclass_constructor_exportable_experimental.._is_initztorch._export.wrappers.mark_constructor_exportable_experimental can only be applied on subclass tensor.__init__But, you are adding it on z which is not supported. If __init__ doesn't exist on your subclass, please add it. Look at DTensor.__init__ implementation for examplecstt|ds"jdsJjdtd }td|d|i|tjs0dStj }dd|D}t|dksKJdt|t|dkrSdS|d}|j |d}t t |dd|f\}}d jd } | } tj| |d | d i} ttjfd d|} tjjtt|\} }t|jd}t||}dt|| g| Ri}t||dddS)Nrrz5Applying mark_constructor_exportable_experimental on z is not valid as it is not a traceable tensor subclass. Please look at DTensor.__init__ implementation as an example of proper usage of this API.cSsg|] }t|tr|qSr)r6r ).0r)rrr s zVmark_subclass_constructor_exportable_experimental..wrapper..z6Expected only one PreDispatchTorchFunctionMode, found rH.rXrcs t|jSr)r r*)xr&rrs zTmark_subclass_constructor_exportable_experimental..wrapper..Z_const_func_specr$r%) rtyper"endswithlen RuntimeErrorr7Z_CZ_is_torch_function_mode_enabledZ overridesZ _get_current_function_mode_stackr&rtuplejoinlowersplitr\r]rZr(r'Z tree_map_onlyr8utilsrrDrr rarr)rrobj_nameZtorch_function_mode_stackZpre_dispatch_tf_modesr)subclassr>r1Zconstructor_spec_namer`Z spec_proxyZflat_proxy_argsrHZ func_specZ!fxable_constructor_call_spec_nameZfunc_spec_proxyZ inner_proxyconstructor_subclassrjrwrappers`          zBmark_subclass_constructor_exportable_experimental..wrapper)ror )rxrdryrrwr1mark_subclass_constructor_exportable_experimentals Grz)+ contextlibrr7Ztorch._custom_opsZtorch._CrZ"torch._higher_order_ops.flat_applyrrrZ#torch._higher_order_ops.strict_moderZtorch._higher_order_ops.utilsr Z torch._opsr Ztorch._subclasses.fake_tensorr Z"torch.fx.experimental.proxy_tensorr r rrZ torch.utilsrr'Ztorch.utils._python_dispatchrrrZpy_implr+r,Zpy_functionalize_implr.ZAutogradZCPUr/rNrSrVrarzrrrrs>              &