j7UddlZddlmZmZmZmZmZmZddlZddl m cm Z ddl m cm cmZddlm cm cmcmZddlm cm cmcmZddlm cm cmcmcmZddlm cm cmZddlm cm cmcmZddlm cm cmZddlm cm cmcmZ ddl!m cm cmcm"Z#ddl$Zddl%m cm&Z'ddlm Z ddl(m)Z)m*Z*ddl+m,Z,m-Z-ddl.m/Z/ddl0m1Z1gdZ2e-ej3e,ej4e j5e#j5e j6e#j6e j7e#j7e j8e#j8e j9e#j9e j:e#j:e j;e#j;e j<e#j<e j=e#j=e j>e#j>e j?e#j?e j@e#j@e jAe#jAiZBeeefeCd <ie-ej3e,ej4e jDejDe jEejEe jFejFe j6ej6e j7ej7e j8ej8e j9ej9e j:ej:e j;ej;e jGejGe j<ej<e j=ej=e jHejHe jIejIe jJejJie jKejKe jLejLe jMejMe jNejNe jOjPjQej5e j5ej5e jRejRe jFejFe jSejSejTejUejVejVejWejWejXejXejYejYejZejZej[ej[ej\ej\iej]ej]ej^ej^ej_ej_ej`ej6ejaej7ejbej8ejcejXejdejYejeejZejYejYejZejZej]ej]ejfej5ej5ej5ej7ej7ej8ej8ZgeeefeCd <e j7ej7e j8ej8e j5ej5e jOjPjQej5ej`ej`ejaejaejbejbejcejcejdejdejeejeejYejYejZejZej]ej]ejfejfiZheeefeCd <e j>e j>e j5e j5ej5e j5e jOjPjQe j5e jAe jAe jie jie j?e j?e j@e j@ej]ej]e j=ej=e j<ej<i ZjeeefeCd <e jkhZleeeCd <e'jmejnjjme'joejnjjoe'jpejnjjpe'jqejnjjqe'jrejnjjre'jsejnjjsiZteeeeufefeCd<e jve)e jwe)e jxe)e jye*iZzeeefeCd<e j5e j{jj5iZ|eeefeCd<e j5e j{jjj5iZ}eeefeCd<deefdZ~deeeffdZdeeeffdZdeeeffdZdeeeffdZ d+dedeeeefdedefdZ d,dedeeeefdefdZdeeeffdZdeeeffd Zdeeeffd!Zdeeeffd"Zdeefd#Zdeefd$Zdeeeeufeffd%Zd&eeeufdefd'Zd(ej jdeefd)Zd(ej jdefd*ZdS)-N)AnyCallableDictOptionalSetUnion)nn)+default_fixed_qparams_range_0to1_fake_quant.default_fixed_qparams_range_neg1to1_fake_quant) DeQuantStub QuantStub)get_combined_dict)type_before_parametrizations).DEFAULT_REFERENCE_STATIC_QUANT_MODULE_MAPPINGS$DEFAULT_STATIC_QUANT_MODULE_MAPPINGSDEFAULT_QAT_MODULE_MAPPINGS%DEFAULT_DYNAMIC_QUANT_MODULE_MAPPINGS,DEFAULT_FLOAT_TO_QUANTIZED_OPERATOR_MAPPINGS"DEFAULT_MODULE_TO_ACT_POST_PROCESS+DEFAULT_STATIC_SPARSE_QUANT_MODULE_MAPPINGS,DEFAULT_DYNAMIC_SPARSE_QUANT_MODULE_MAPPINGSno_observer_set(get_default_static_quant_module_mappings2get_default_static_quant_reference_module_mappings*get_embedding_static_quant_module_mappings/get_default_static_sparse_quant_module_mappingsget_static_quant_module_classget_dynamic_quant_module_classget_default_qat_module_mappings!get_embedding_qat_module_mappings)get_default_dynamic_quant_module_mappings0get_default_dynamic_sparse_quant_module_mappings$get_default_qconfig_propagation_list&get_default_compare_output_module_list0get_default_float_to_quantized_operator_mappingsget_quantized_operatorrrrr_INCLUDE_QCONFIG_PROPAGATE_LISTrrrrreturncJtjjtjjh}|S)z8These modules cannot have observers inserted by default.)r quantizableLSTMMultiheadAttention) no_observerss \C:\Projects\Historical\venv\Lib\site-packages\torch/ao/quantization/quantization_mappings.pyrrsN')JKL c4tjtS)z8Get module mapping for post training static quantization)copydeepcopyrr/r.rrs == > >>r/c4tjtS)zBGet reference module mapping for post training static quantization)r1r2rr3r/r.rrs =G H HHr/ctjt}tj|t j<tj|t j<|S)z7Get module mapping, including mapping for embedding QAT)r1r2rnnq EmbeddingBagnnqat Embeddingmappings r.rrs5m@AAG"%"2GE "}GEO Nr/c4tjtS)z?Get module mapping for post training static sparse quantization)r1r2rr3r/r.rrs =D E EEr/Ffloat_module_classadditional_static_quant_mapping is_referencec|i}t|rtnt|}||d}|Jdt |dzt j|S)zen Get the statically quantized module class corresponding to the floating point module class NFloating point module class 5 does not have a corresponding quantized module class)rrrgetstrr1r2)r=r>r? all_mappingsstatic_quant_module_classs r.rrs'.*,'$  266 1' L !- 0 01CT J J $ 0 0@s+='>'>@@ A B 1 0 0 =2 3 33r/ additional_dynamic_quant_mappingc|i}tt|}||d}|Jdt|dzt j|S)zfn Get the dynamically quantized module class corresponding to the floating point module class NrArB)rrrCrDr1r2)r=rGrEdynamic_quant_module_classs r.rrs(/+-($-/OL".!1!12Dd!K!K % 1 1@s+='>'>@@ A B 2 1 1 =3 4 44r/c4tjtS)z:Get default module mapping for quantization aware training)r1r2rr3r/r.rrs =4 5 55r/ctjt}tj|t j<tj|t j<|S)zGet module mapping for quantization aware training This is includes default values in addition to enabling qat for embeddings. )r1r2rr8r7r r9r:s r.r r s6 m788G$1GBO!OGBL Nr/ctS)z9Get module mapping for post training dynamic quantization)rr3r/r.r!r!*s 00r/ctS)z@Get module mapping for post training dynamic sparse quantization)rr3r/r.r"r"/s 77r/c"ttttzttzt z}t j|S)z_Get the default list of module types that we'll attach qconfig attribute to in prepare )setrkeysrrr'r1r2)#QCONFIG_PROPAGATE_MODULE_CLASS_LISTs r.r#r#4sx 0 5 5 7 788 )..00 1 1 2 388:: ; ; < * *( =< = ==r/c ttttzttzttzttzttzt z}tj|S)zSGet list of module class types that we will record output in numeric suite ) rOrvaluesrrrPr'r1r2).NUMERIC_SUITE_COMPARE_MODEL_OUTPUT_MODULE_LISTs r.r$r$As 0 7 7 9 9:: )0022 3 3 4 3::<< = = > 27799 : : ; )..00 1 1  2 388:: ; ;  < *  *3 =G H HHr/c4tjtSN)r1r2rr3r/r.r%r%Qs =E F FFr/float_opcvt|d}|Jdt|d|S)z>Get the quantized operator corresponding to the float operatorNz Operator z) does not have corresponding quantized op)rrCrD)rW quantized_ops r.r&r&XsE?CCHdSSL  K3x==KKK !  r/modulecRtt|dS)zGet the special activation post process for `module`, this has higher priority than the activation post process in `qconfig` e.g. input: torch.nn.Sigmoid output: default_affine_fixed_qparam_fake_quant N)rrCrrZs r._get_special_act_post_processr]as) . 1 1$V,,d  r/c<|jot|tvSrV)trainingtyperr\s r._has_special_act_post_processrams ? QtF||/QQQr/)NFrV)r1typingrrrrrrtorch torch.ao.nnaor ao_nntorch.ao.nn.intrinsic intrinsicnnitorch.ao.nn.intrinsic.qatqatnniqattorch.ao.nn.intrinsic.quantized quantizednniq'torch.ao.nn.intrinsic.quantized.dynamicdynamicnniqdtorch.ao.nn.qatr8torch.ao.nn.qat.dynamicnnqatdtorch.ao.nn.quantizedr6torch.ao.nn.quantized.dynamicnnqdtorch.ao.nn.quantized.reference referencennqrtorch.ao.nn.sparsetorch.nn.functional functionalF#torch.ao.quantization.fake_quantizer r torch.ao.quantization.stubsr r torch.ao.quantization.utilsrtorch.nn.utils.parametrizer__all__Quantize DeQuantizeLinearConv1dConv2dConv3dConvTranspose1dConvTranspose2dConvTranspose3dr9r7GRUCellLSTMCellRNNCellr+r__annotations__ BatchNorm2d BatchNorm3dDropoutELU GroupNorm HardswishInstanceNorm1dInstanceNorm2dInstanceNorm3d LayerNorm LeakyReLUmoduleslinearNonDynamicallyQuantizableLinearReLU6PReLUFloatFunctional QFunctionalBNReLU2dBNReLU3d ConvReLU1d ConvReLU2d ConvReLU3d ConvAdd2d ConvAddReLU2d LinearReLULinearLeakyReLU LinearTanhConvBn1dConvBn2dConvBn3d ConvBnReLU1d ConvBnReLU2d ConvBnReLU3d LinearBn1drrGRUr Sequentialr'eluops hardswish instance_norm layer_norm leaky_reludropoutrrD HardsigmoidSigmoidSoftmaxTanhrsparserrrrrrrboolrrrr r!r"r#r$r%r&Moduler]rar3r/r.rsj  <<<<<<<<<<<<<<<< ############***************...............777777777777777777(((((((((((((((############,,,,,,,,,,,,,,,...............?>>>>>>>999999CCCCCC   8s|It{It{It{It{,,,L$.OT&J KJ GTYG.Xs]0C&6= s|6=6=NCO6=NCO 6= J 6= Isz 6=Isz6=Isz6=+6=+6=+6=FCG6=L#-6=OS%6=L#-6= L#-!6="s)#6=6=$s)%6=&s)'6=(L#-)6=*L#-+6=,J5sz-6=.Isz/6=0Hci16=2J 36=4Hci56=896=<L$-=6=>L$-?6=@NDOA6=BNDOC6=DNDOE6=FM4>G6=Ht)I6=6=6=JNDOK6=L-M6=NNDOO6=P OSZQ6=R OSZS6=T OSZU6=V W6=X Y6=Z [6=\ t]6=^ t_6=` ta6=b szc6=f L#*g6=h L#*i6=j L#*k6=6=$d8S=&9666tIu|Iu|Iu|J5u|L&/L&/L&/f)f)f)NF%NF%NF%NF%4T(C-0(J It{ M4;J5t{GTYFDHKJ NE$OS%L#->%tHcM':0M2XE59  "K$.OUY(6L%)%0L%)%0Iuy"* V,d533G3Q.RN?J;J;G ; @"D8);$<Iu|%,D+T(C--@ Iu|%-4E,d8S=.A S ?$x}2E???? ID314# 3F1111 8$x}:M8888 >c(m > > > > IH I I I I Gx} x '(GGGGU8S=%9h %(/ hx>P    R%(/RdRRRRRRr/