o h[@sUddlmZddlmZddlmZmZmZmZm Z m Z m Z m Z ddl Z ddlmmZddl mZmZddlmZddlmZmZmZmZdZeeed <gd Zd e eefd eed ffddZ dee e!efde ede ed efddZ"dede!d efddZ#d3dede$d efddZ%ded efdd Z&d3dede$d efd!d"Z'e d#d$d%Z(e d&d$d'Z)Gd(d)d)ee(e)fZ*Gd*d+d+e*e(e)fe+Z,d4d,ed-e!d efd.d/Z-d4d0ed-e!d efd1d2Z.dS)5)Sequence)update_wrapper)AnyCallableFinalGenericOptionaloverloadTypeVarUnionN)SymIntTensoris_tensor_like)_dtype_NumberDeviceNumbergox?euler_constant) broadcast_alllogits_to_probs clamp_probsprobs_to_logits lazy_propertytril_matrix_to_vecvec_to_tril_matrixvaluesreturn.cstdd|Ds tdtdd|Ds@ttd|D]}t|tjr1t|j|jdq2qfdd|D}tj |Stj |S) a Given a list of values (possibly containing numbers), returns a list where each value is broadcasted based on the following rules: - `torch.*Tensor` instances are broadcasted as per :ref:`_broadcasting-semantics`. - Number instances (scalars) are upcast to tensors having the same size and type as the first tensor passed to `values`. If all the values are scalars, then they are upcasted to scalar Tensors. Args: values (list of `Number`, `torch.*Tensor` or objects implementing __torch_function__) Raises: ValueError: if any of the values is not a `Number` instance, a `torch.*Tensor` instance, or an instance implementing __torch_function__ css"|] }t|p t|tVqdSN)r isinstancer.0vr#_/home/www/facesmatcher.com/frenv_anti/lib/python3.10/site-packages/torch/distributions/utils.py +s z broadcast_all..ziInput arguments must all be instances of Number, torch.Tensor or objects implementing __torch_function__.css|]}t|VqdSrrr r#r#r$r%0s)dtyper&devicecs*g|]}t|r |ntj|fiqSr#)rtorchZtensorr optionsr#r$ 6sz!broadcast_all..) all ValueErrordictr)Zget_default_dtyperr r&r(Zbroadcast_tensors)rvalue new_valuesr#r*r$rs     rshaper&r(cCsBtjrttj|||dtj|||dStj|||dS)Nr')r)_C_get_tracing_statenormalZzerosZonesemptyZnormal_)r2r&r(r#r#r$_standard_normal=s r7r0dimcCs0|dkr|S|jd| d}||dS)z Sum out ``dim`` many rightmost dimensions of a given tensor. Args: value (Tensor): A tensor of ``.dim()`` at least ``dim``. dim (int): The number of rightmost dims to sum out. rN)r9)r2Zreshapesum)r0r8Zrequired_shaper#r#r$_sum_rightmostKsr;Flogits is_binarycCs|rt|Stj|ddS)a Converts a tensor of logits into probabilities. Note that for the binary case, each value denotes log odds, whereas for the multi-dimensional case, the values along the last dimension denote the log probabilities (possibly unnormalized) of the events. r9)r8)r)ZsigmoidFZsoftmax)r<r=r#r#r$rYs rprobscCs t|jj}|j|d|dS)aClamps the probabilities to be in the open interval `(0, 1)`. The probabilities would be clamped between `eps` and `1 - eps`, and `eps` would be the smallest representable positive number for the input data type. Args: probs (Tensor): A tensor of probabilities. Returns: Tensor: The clamped probabilities. Examples: >>> probs = torch.tensor([0.0, 0.5, 1.0]) >>> clamp_probs(probs) tensor([1.1921e-07, 5.0000e-01, 1.0000e+00]) >>> probs = torch.tensor([0.0, 0.5, 1.0], dtype=torch.float64) >>> clamp_probs(probs) tensor([2.2204e-16, 5.0000e-01, 1.0000e+00], dtype=torch.float64) )minmax)r)finfor&epsclamp)r?rDr#r#r$resrcCs,t|}|rt|t| St|S)a$ Converts a tensor of probabilities into logits. For the binary case, this denotes the probability of occurrence of the event indexed by `1`. For the multi-dimensional case, the values along the last dimension denote the probabilities of occurrence of each of the events. )rr)loglog1p)r?r=Z ps_clampedr#r#r$rs rTT) contravariantR) covariantc@seZdZdZdeegefddfddZe dddde dd fd d Z eddede defd d Z dde edfde dd fdd Z dS)rz Used as a decorator for lazy loading of class attributes. This uses a non-data descriptor that calls the wrapped method to compute the property on first call; thereafter replacing the wrapped method into an instance attribute. wrappedrNcCs||_t||dSr)rLrselfrLr#r#r$__init__szlazy_property.__init__instanceobj_typez!_lazy_property_and_property[T, R]cCdSrr#rNrPrQr#r#r$__get__szlazy_property.__get__cCrRrr#rSr#r#r$rTsz%R | _lazy_property_and_property[T, R]cCsX|dur t|jSt ||}Wdn1swYt||jj||Sr)_lazy_property_and_propertyrLr)Z enable_gradsetattr__name__)rNrPrQr0r#r#r$rTs   r) rW __module__ __qualname____doc__rrHrJrOr rrTr r#r#r#r$rs,  rc@s,eZdZdZdeegefddfddZdS)rUzWe want lazy properties to look like multiple things. * property when Sphinx autodoc looks * lazy_property when Distribution validate_args looks rLrNcCst||dSr)propertyrOrMr#r#r$rOsz$_lazy_property_and_property.__init__)rWrXrYrZrrHrJrOr#r#r#r$rUs rUmatdiagcCs|jd}tjs$|| ks||kr$td|d| d|ddtj||jd}||dd|dk}|d|f}|S) z Convert a `D x D` matrix or a batch of matrices into a (batched) vector which comprises of lower triangular elements from the matrix in row order. r9zdiag (z) provided is outside [z, r@z].r(.)r2r)r3r4r.aranger(view)r\r]nr_ tril_maskvecr#r#r$rs " rrccCsdd| dd|dd|jddt||ddd}t|jj}tjsEt|||krEt d|jddd t |tj rQt| nt|}| |jd dt||f}tj||jd }||dd|dk}||d |f<|S) z Convert a vector or a batch of vectors into a batched `D x D` lower triangular matrix containing elements from the vector in row order. r@r9g?zThe size of last dimension is z which cannot be expressed as z3the lower triangular part of a square D x D matrix.Nr^.)r2absr)rCr&rDr3r4roundr.rr itemZ new_zerosSizer_r(r`)rcr]rarDr\r_rbr#r#r$rs$ 4 " r)F)r)/collections.abcr functoolsrtypingrrrrrr r r r)Ztorch.nn.functionalnnZ functionalr>r r Ztorch.overridesrZ torch.typesrrrrrfloat__annotations____all__tuplerintr7r;boolrrrrHrJrr[rUrrr#r#r#r$s< ( " "