o H&iQ@sUddlZddlZddlZddlZddlZddlZddlZddlmZmZm Z m Z m Z m Z m Z mZmZddlmZddlmZddlmZmZerOddlmZgdZed d Gd d d e ZiZe ee ejfed <ddZeeej<GdddZ ej!ej"ej#ej$ej%j&ej'ej(e e)de*dd Z+e,eD] Z-e.ee-e+e-<qdddefddZ/dej0j1dejfddZ2iZ3e e e4e4fejfed<dej0j1dejfddZ5ed d ded e d!d"e e4d#ffd$d%Z6ed d dd5ejd8ejd e ed9fd"e e4efd2e7de ef d:d;Z?dS)?N) AnyCallableDictListOptionalTuple NamedTuplecast TYPE_CHECKING)boolean_dispatched) compatibility)OpOverloadPacket OpOverload)Argument)ArgsKwargsPaircheck_for_mutable_operationget_signature_for_torch_opcreate_type_hint type_matchesnormalize_functionnormalize_moduleF)Zis_backward_compatiblec@s2eZdZUdZeedfed<eeefed<dS)rz< Simple named tuple for wrapping args/kwargs pairs. .argskwargsN) __name__ __module__ __qualname____doc__rr__annotations__rstrr r DC:\wamp64\www\opt\env\Lib\site-packages\torch/fx/operator_schemas.pyrs r_manual_overridescCs>g}dd}|t|dtfdd}|t||S)NcSdSNr )selfr r r!nonzero z!_nonzero_schemas..nonzeroas_tuplecSr#r$r )r%r(r r r!r&$r')appendinspect signaturebool) signaturesr&r r r!_nonzero_schemass r.c@seZdZddZdS)_FakeGlobalNamespacecCs|dkrtStd)Ntorchz!Expected a torch namespace lookup)r0 RuntimeError)r%namer r r! __getattr__-sz _FakeGlobalNamespace.__getattr__N)rrrr3r r r r!r/,s r/t) TensorZDeviceZLayoutnumberFutureZ AnyEnumTypeZQSchemeZ __torch__NoneTyper4ts_typeztorch._C.JitTypereturncCs t|jtS)z Convert a TorchScript type to a Python type (including subtypes) via eval'ing the annotation_str. _type_eval_globals sets up expressions like "List" and "Future" to map to actual types (typing.List and jit.Future) )evalZannotation_str_type_eval_globals)r9r r r! _torchscript_type_to_python_type:s r= ts_schemac Csddlm}g}|jD]\}t|j}|r|jn|j}|jdkr$|jnd}|j r,|j n|j }|dkr\||j ks:J|j }t |D]\}} | j|j ksMJ|| j|j | j| jd||<qA||||||dq dd|jD} t| dkryd} nt| d kr| d} nt| } tj|| d S) Nr) Parameterr%inputfrom)r2kinddefault annotationcSsg|]}t|jqSr )r=type).0retr r r! Zsz9_torchscript_schema_to_signature_impl..r )return_annotation)r*r? argumentsr=rEZhas_default_value default_valueemptyr2Z kwarg_only KEYWORD_ONLYPOSITIONAL_OR_KEYWORDPOSITIONAL_ONLY enumeraterBrCrDr)returnslentuple Signature) r>r? parametersargarg_typerCr2rBidxpZ return_types return_typer r r!%_torchscript_schema_to_signature_implBs*      r[_SCHEMA_TO_SIGNATURE_CACHEcCs6|j|jf}t|}|dur|St|}|t|<|Sr$)r2Z overload_namer\getr[)r> cache_keyZ cache_valresr r r! _torchscript_schema_to_signaturefs  r`targetr)r.rrc Cst|dd\}}|r\|r^g}t||D]'\}}z|j|i||||fWqty:}zWYd}~qd}~wwdd} t|dkrGdSt|dkrY|d\} } | | dS dSdSdS)NT)return_schemascSs|jr td|ddS)Nz!Tried to trace mutable operation z|. FX only supports functional code, so operations that mutate operands in-place (e.g. via `out` arguments) are not supported)Z is_mutabler1)schemar r r!throw_if_mutablesz5check_for_mutable_operation..throw_if_mutablerr )rzipbindr) TypeErrorrR) rarrr-schemasmatched_schemascandidate_signaturercerd_Zschema_to_checkr r r!rqs(    roprbcsttr jg}n7ttrfddD}n&t}|r*|r(|dfSdStjj }|dur;|r9dSdStj |}dd|D}|rN||fS|S)a Given an operator on the `torch` namespace, return a list of `inspect.Signature` objects corresponding to the overloads of that op.. May return `None` if a signature could not be retrieved. Args: op (Callable): An operator on the `torch` namespace to look up a signature for Returns: Optional[List[inspect.Signature]]: A list of signatures for the overloads of this operator, or None if the operator signatures could not be retrieved. If return_schemas=True, returns a tuple containing the optional Python signatures and the optional TorchScript Function signature csg|]}t|jqSr )getattr_schema)rFoverloadrmr r!rHsz.get_signature_for_torch_op..N)NNcSsg|]}t|qSr )r`rFrcr r r!rHs) isinstancerrorZ overloadsr"r]r0jitZ _builtinsZ _find_builtin_CZ_jit_get_schemas_for_operator)rmrbrhoverrideZaten_fnr-r rqr!rs      rc CszEt|ttfrCt|trdd}ndd}t|dkr!|tWS|d}|D]}t||r/q't||r7|}q'|tWS||WSW|Sty`}ztd|WYd}~|Sd}~ww)NcSst|Sr$)rxr r r!ret_typesz"create_type_hint..ret_typecSs t|dfS)N.)rrwr r r!rys rz@We were not able to successfully create type hint from the type ) rslistrSrRr issubclass Exceptionwarningswarn)rxryZ base_typer4rkr r r!rs.        rsignature_type argument_typecs&t|d|}|ur dS|tjur#|kr#|j}tfdd|DS|ttur/tur/dSt|ddtthvrj|jdt sNt d|ddStddtthvr`t jdSfd d }|S|turut jurudS|tjurtthvrdSt rt |rt |SdS) N __origin__Tc3s|]}t|VqdSr$)rrFc)rr r! ztype_matches..rz.Does not support nested parametric types, got z. Please file a bug.FcsBt|ddtthvr dS|j}|jdkrdStfdd|DS)NrF)r Tc3s"|] }|tup t|VqdSr$)Ellipsisr{r sig_el_typer r!rs z=type_matches..is_homogeneous_tuple..)rnrSr__args__all)r4 containedrr r!is_homogeneous_tuples  z*type_matches..is_homogeneous_tuple)rntypingUnionranyrintrzr*isclassr}r~r{r0ZdtypenumbersNumberfloat)rrZsig_origin_typeZ sig_containedrr )rrr!rs4       r arg_types kwarg_typesnormalize_to_only_use_kwargsc CsH|duri}d}t|tjsVt|ttfsV|}|tvr?t|tr"Jt|}|d|d} } t| j t| j kr=dS| }t |sEJtt |} t | |||}|St |s\Jt |} g} | r"| D]#}z|j|i|| |Wqgty}zWYd}~qgd}~wwt| dkr |St| dkrt | d|||}|S|dus|dur |r|ntttd}|r|ni}| D]G}d}z!|j|i|}|jD]\}}|j |}|ot|j|}qWnty}zd}WYd}~nd}~ww|rt ||||}|Sq|Sd d d | D}td t|d ||S)a Returns normalized arguments to PyTorch functions. This means that `args/kwargs` will be matched up to the functional's signature and return exclusively kwargs in positional order if `normalize_to_only_use_kwargs` is True. Also populates default values. Does not support positional-only parameters or varargs parameters (*args, **kwargs). Does not support modules. May require `arg_types` and `kwarg_types` in order to disambiguate overloads. Args: target (Callable): Function that we are normalizing args (Tuple[Any]): Tuple of args to the function kwargs (Optional[Dict[str, Any]]): Dict of kwargs to the function arg_types (Optional[Tuple[Any]]): Tuple of arg types for the args kwarg_types (Optional[Dict[str, Any]]): Dict of arg types for the kwargs normalize_to_only_use_kwargs (bool): Whether to normalize to only use kwargs. Returns: Returns normalized_args_and_kwargs, or `None` if not successful. Nif_trueif_falserr r TF css|]}t|VqdSr$)rrrr r r!r^sz%normalize_function..z Tried to normalize arguments to zy but the schema match was ambiguous! Please provide argument types to the normalize_arguments() call. Available schemas: )rstypesBuiltinFunctionTyperrr rr*r+rUcallableunwrap&_args_kwargs_to_normalized_args_kwargsrrfr)rgrRr rrrJitemsrrDjoinr1r0typename)rarrrrrnew_args_and_kwargsZtarget_for_analysisZ dispatchedrrsigZtorch_op_schemasrirjrkZ sig_matchesZ bound_typesZarg_namerWparamZschema_printoutsr r r!rs   0        rrootc Csz||}Wnty}z td|d|d}~wwt|jdrI|jj}ttj|d|jkrIt t |j }|dur@i}t ||||} | SdS)a( Returns normalized arguments to PyTorch modules. This means that `args/kwargs` will be matched up to the functional's signature and return exclusively kwargs in positional order if `normalize_to_only_use_kwargs` is True. Also populates default values. Does not support positional-only parameters or varargs parameters (*args, **kwargs). Args: root (nn.Module): root module upon which we query modules target (Callable): Function that we are normalizing args (Tuple[Any]): Tuple of args to the function kwargs (Optional[Dict[str, Any]]): Dict of kwargs to the function normalize_to_only_use_kwargs (bool): Whether to normalize to only use kwargs. Returns: Returns normalized_args_and_kwargs, or `None` if not successful. z$Tried to normalize node with target z# but root did not have that target!Nr)Z get_submoduleAttributeErrorr1hasattr __class__rrnr0nnr*r+rforwardr) rrarrrZsubmodrk classnamerrr r r!res& rr.c stjjtjjhtfdd|jDr#t|jgdkr#dS|j |i|}| i}g}t |jD]\}}|sM|t |krM| |j|q8|j|||<q8tt||S)a Given a call target, args, and kwargs, return the arguments normalized into an ArgsKwargsPair, or None if the type signature is not supported by this normalization. Args: sig (inspect.Signature): Signature object for the target args (Tuple): Arguments that appear at the callsite for `target` kwargs (Dict): Keyword arguments that appear at the callsite for `target` normalize_to_only_use_kwargs (bool): Whether to normalize to only use kwargs. Returns: Optional[ArgsKwargsPair]: Normalized args and kwargs for `target`, or `None` if this target is not supported. c3s|]}|jvVqdSr$)rB)rFrYZsupported_parameter_typesr r!rrz9_args_kwargs_to_normalized_args_kwargs..)r@rAto generatorN)r*r?rNrMrrUvaluesrzkeysrfapply_defaultsrPrRr)rJrrS) rrrrZ bound_argsZ new_kwargsnew_argsirr rr!rs r)F)NNNF)NF)@r0r*rrrenumr}rrrrrrrr r Ztorch._jit_internalr Z_compatibilityr Z torch._opsrrnoder__all__rr"rTrr.r&r/r5ZdeviceZlayoutrrtr7EnumZqschemerETypeVarr<dirkrnr=ruZFunctionSchemar[r\rr`rr,rrrrrModulerrr r r r!s ,        " $#! /  a &