关键定义
########



.. toctree::
   :caption: 推荐系统
   :glob:
   :maxdepth: 1

   keys/Recommenders/*

.. toctree::
   :caption: 分布式训练
   :maxdepth: 1

   keys/Parallelism/normal
   keys/Parallelism/PipelineParallelism
   keys/Parallelism/TensorParallesim



.. toctree::
    :caption: 激活函数
    :maxdepth: 1

    keys/func_activations/activation_Sigmoid
    keys/func_activations/activation_RELU
    keys/func_activations/activation_Leaky-ReLU
    keys/func_activations/activation_Tanh
    keys/func_activations/activation_GELU
    keys/func_activations/normalization_L1
    keys/func_activations/normalization_L2
    keys/func_activations/probabilistic_Softmax
    keys/func_activations/probabilistic_logSoftmax
    keys/func_activations/probabilistic_Sparsemax


.. toctree::
    :caption: 损失函数
    :maxdepth: 1

    keys/func_loss/classify_cross_entropy
    keys/func_loss/classify_NLL
    keys/func_loss/classify_log
    keys/func_loss/classify_kl
    keys/func_loss/regression_MSE
    keys/func_loss/regression_MAE
    keys/func_loss/regression_Huber
    keys/func_loss/regression_log_cosh
    keys/func_loss/权重衰减-L2正则化



.. toctree::
    :caption: 调优函数
    :maxdepth: 1

    keys/func_optims/GD
    keys/func_optims/SGD
    keys/func_optims/RMSprop
    keys/func_optims/Adam
    keys/func_optims/AdamW
    keys/func_optims/Momentum


.. toctree::
    :caption: 命名实体识别
    :maxdepth: 1

    keys/ners/HMM-隐马尔可夫模型
    keys/ners/WWM-全词Mask
    keys/ners/CRF-条件随机场


.. toctree::
    :caption: 神经网络
    :maxdepth: 1

    keys/dls/ANN
    keys/dls/DNN-深度神经网络
    keys/dls/CNN-卷积神经网络
    keys/dls/RNN-循环神经网
    keys/dls/LSTM-长短时记忆


.. toctree::
    :caption: 深度神经网络理论
    :maxdepth: 1

    keys/dl_theorys/propagation
    keys/dl_theorys/LinearLayer
    keys/dl_theorys/FFN
    keys/dl_theorys/LayerNorm
    keys/dl_theorys/WeightTying
    keys/dl_theorys/GreedyDecoding
    keys/dl_theorys/ImageGrounding
    keys/dl_theorys/Perplexity


.. toctree::
    :caption: 3D
    :maxdepth: 1

    keys/3Ds/ManhattanWorld曼哈顿世界
    keys/3Ds/HoughTransform霍夫变换
    keys/3Ds/PolarCoordinateSystem极坐标表示法
    keys/3Ds/GaussianSphere高斯球
    keys/3Ds/edge_direction边缘方向
    keys/3Ds/NormalVector法向量


.. toctree::
    :caption: 其他
    :glob:
    :maxdepth: 1

    keys/others/*