o <&i1 @sddlZddlZddlZddlZddlZddlZddlZddlZddlZddl m Z m Z ddl m Z mZmZmZmZmZddlmZeeeedeeeeef ZddZdZdd Z Gd d d e Z!Gd d d ej"Z"GdddZ#ddZ$dS)N) FunctionType ModuleType)AnyDictOptionalSetTupleUnion)mockcsxGdddt}fddttt}d__t_|_|_ d_ d_ dS)z Converts a module-level config into a `ConfigModule()`. See _config_typing.pyi for instructions on how to get the converted module to typecheck. c@seZdZeddhZdS)z3install_config_module..ConfigModuleInstance _is_dirty _hash_digestN)__name__ __module__ __qualname__set _bypass_keysrrEC:\wamp64\www\opt\env\Lib\site-packages\torch/utils/_config_module.pyConfigModuleInstancesrc st|jD]l\}}|ds!t|ttfs!t|dr"|jdkr"q||}t|t r?||<||<|ur>t |qt|t rd|jj ksLJt |d}|||dt|||qtd|d|dt |dd S) z?Walk the module structure and move everything to module._config__rtyping.zUnhandled config =z ()N)list__dict__items startswith isinstancerrhasattrr CONFIG_TYPESdelattrtyper SubConfigProxysetattrAssertionError)sourcedestprefixkeyvaluenameproxyconfigdefaultmodulevisitrrr1s.       z$install_config_module..visitTN) ConfigModuledict-get_assignments_with_compile_ignored_comments_config_defaultrkeys _allowed_keys_compile_ignored_keys __class__r r )r0rZcompile_ignored_keysrr-rinstall_config_modules  r<z@compile_ignoredc Cs(t|}t}tt|dj}d}d}d}|D]j}|jtj krR|j }t |vrQ|dks8Jdt ||j df}|j d|dkrQ||dd}q|jtjkr\|j }q|jtjkr|j dkr||j df}t |dvr|d|j ddkr||d}q|dksJdt |S)Nutf-8)r2r2z unconsumed rr)inspect getsourcertokenizeioBytesIOencodereadliner"COMMENTstringstripCOMPILE_IGNORED_MARKERstartaddNAMEOP) r0Z source_codeZ assignmentstokensZcurrent_commentZ prev_nameZ prev_assignedtokenZ maybe_currentrrrr5Is:       r5cseZdZUeeefed<eeefed<eeed<eeed<eeed<eed<e e ed<dd Z fd d Z d d Z ddZde fddZdefddZdeeefdeeeefe ffddZdeeefde fddZde fddZdeeeffddZdeeeffdd Zd!ee eeeffdd"fd#d$Zdeeeffd%d&Z " "d+d'e eeeeeffd(efd)d*ZZS),r3r7r6r9rr:r r cCstdtd)Nzuse z-.install_config_module(sys.modules[__name__]))NotImplementedErrorr selfrrr__init__s zConfigModule.__init__csJ||jvrt||dS||jvrt|jd|d||j|<dSNrz does not exist)rsuper __setattr__r9AttributeErrorr r6rSr+r*r;rrrWs  zConfigModule.__setattr__c Cs>z|j|WSty}z t|jd|d|d}~wwrU)r6KeyErrorrXr )rSr+errr __getattr__s  zConfigModule.__getattr__cCs |j|=dSNr6rSr+rrr __delattr__s zConfigModule.__delattr__returncCs4t|j}|ddD]}||q tj|ddS)z Convert config to a pickled blob_save_config_ignorer)protocol)r4r6getpoppickledumps)rSr.r)rrr save_configs  zConfigModule.save_configcCsfg}|j}|jD]#\}}||jddvrq ||j|kr q ||d|d|q d|S)zConvert config to Python statements that replicate current config. This does NOT include config settings that are at default values. rcrrz =  )r r6rrfr7appendjoin)rSlinesmodkvrrrcodegen_configs zConfigModule.codegen_configupdatescsRtfdd|DrtdfddjD}|||}||fS)zCHashes the configs that are not compile_ignored, along with updatesc3s|]}|jvVqdSr^r:).0rprRrr sz@ConfigModule.get_config_and_hash_with_updates..z&update keys cannot be @compile_ignoredc i|] \}}|jvr||qSrrtrurprqrRrr szAConfigModule.get_config_and_hash_with_updates..)any ValueErrorr6rupdate _get_hash)rSrscfghashedrrRr get_config_and_hash_with_updatess   z-ConfigModule.get_config_and_hash_with_updatesr.cCs$tt|}t|dS)Nr=)reprsortedrhashlibmd5rEdigest)rSr.Zstring_to_hashrrrr}szConfigModule._get_hashcs@jsjdurfddjD}|_d_jS)z/Hashes the configs that are not compile_ignoredNcrwrrtrxrRrrrys  z)ConfigModule.get_hash..F)r r r6rr})rSZ dict_to_hashrrRrget_hashs  zConfigModule.get_hashcCstdt|S)Nzconfig.to_dict() has been deprecated. It may no longer change the underlying config. use config.shallow_copy_dict() or config.get_config_copy() instead)warningswarnDeprecationWarningshallow_copy_dictrRrrrto_dicts zConfigModule.to_dictcCs i|jSr^r_rRrrrrs zConfigModule.shallow_copy_dictmaybe_pickled_configNcCs*t|ts t|}n|}|j|dS)zARestore from a prior call to save_config() or shallow_copy_dict()N)rr4rhloadsr6r|)rSrr.rrr load_configs  zConfigModule.load_configcCs t|jSr^)copydeepcopyr6rRrrrget_config_copys zConfigModule.get_config_copyarg1arg2c s|dur"|durt|tsJ||in t|tsJ||r!Jn||dus*Jtts8Jdti|dGfdddt}|S)a Decorator and/or context manager to make temporary changes to a config. As a decorator: @config.patch("name", val) @config.patch(name1=val1, name2=val2) @config.patch({"name1": val1, "name2", val2}) def foo(...): ... As a context manager: with config.patch("name", val): ... Nzexpected `dict` got Fcs.eZdZfddZfddZdS)z'ConfigModule.patch..ConfigPatchcsDrJD]}j||<|jvqj_dSr^)r8r6r:r|r )rSr)changesr.dirtypriorrr __enter__ s     z1ConfigModule.patch..ConfigPatch.__enter__csj_dSr^)r6r|r clearrSexc_typeexc_valexc_tb)r.rrrr__exit__s  z0ConfigModule.patch..ConfigPatch.__exit__N)r rrrrrrrr ConfigPatch s r)rstrr4r"ContextDecorator)rSrrkwargsrrrrpatchs   zConfigModule.patch)NN)r rrrrr__annotations__rboolrbytesrTrWr]rarjrrrrr}rrrr rrr __classcell__rrrZrr3qs@          "r3cs0eZdZdZddZddZfddZZS)rz[ Same as contextlib.ContextDecorator, but with support for `unittest.TestCase` cCtdNZNYIrQrRrrrr&zContextDecorator.__enter__cCrrrrrrrr)rzContextDecorator.__exit__csRt|tr#t|tjr#Gfddd|}|j|_|j|_|j|_|St |S)Ncs4eZdZefddZefddZZS)z,ContextDecorator.__call__.._TestCasecs8ztWdStydddwr^)rrV setUpClass Exceptionrclsr;rSrrr0s z7ContextDecorator.__call__.._TestCase.setUpClassc s0ztWddddSdddwr^)rV tearDownClassrrrrrr9s "z:ContextDecorator.__call__.._TestCase.tearDownClass)r rr classmethodrrrrrRrZr _TestCase/s r) rr" issubclassunittestZTestCaser rrrV__call__)rSfuncrrZrRrr,s zContextDecorator.__call__)r rr__doc__rrrrrrrZrr s rcs8eZdZdZfddZddZddZdd ZZS) r#zn Shim to redirect to main config. `config.triton.cudagraphs` maps to _config["triton.cudagraphs"] cs td|td|dS)Nr6_prefix)rVrW)rSr.r(rZrrrTOszSubConfigProxy.__init__cCs|j|j||Sr^)r6rWrrYrrrrWTszSubConfigProxy.__setattr__cC|j|j|Sr^)r6r]rr`rrrr]WzSubConfigProxy.__getattr__cCrr^)r6rarr`rrrraZrzSubConfigProxy.__delattr__) r rrrrTrWr]rarrrrZrr#Is  r#cCs&t|tr |||Stj|||S)z@ Workaround `mock.patch.object` issue with ConfigModule )rr3rr object)objr+r*rrr patch_object^s  r)% contextlibrrr@rCrhrBrrtypesrrrrrrrrr r intfloatrr"rrrtupler4r r<rJr5r3rr#rrrrrs*  2(0)