关键定义
########

.. toctree::
   :caption: 分布式训练
   :maxdepth: 1

   ais/Parallelism/normal
   ais/Parallelsim/DataParallelism
   ais/Parallelism/PipelineParallelism
   ais/Parallelism/TensorParallesim





.. toctree::
    :caption: 激活函数
    :maxdepth: 1

    ais/func_activations/activation_Sigmoid
    ais/func_activations/activation_RELU
    ais/func_activations/activation_Leaky-ReLU
    ais/func_activations/activation_Tanh
    ais/func_activations/activation_GELU
    ais/func_activations/normalization_L1
    ais/func_activations/normalization_L2
    ais/func_activations/probabilistic_Softmax
    ais/func_activations/probabilistic_logSoftmax
    ais/func_activations/probabilistic_Sparsemax


.. toctree::
    :caption: 损失函数
    :maxdepth: 1

    ais/func_loss/classify_cross_entropy
    ais/func_loss/classify_NLL
    ais/func_loss/classify_log
    ais/func_loss/classify_kl
    ais/func_loss/regression_MSE
    ais/func_loss/regression_MAE
    ais/func_loss/regression_Huber
    ais/func_loss/regression_log_cosh
    ais/func_loss/权重衰减-L2正则化



.. toctree::
    :caption: 调优函数
    :maxdepth: 1

    ais/func_optims/GD
    ais/func_optims/SGD
    ais/func_optims/RMSprop
    ais/func_optims/Adam
    ais/func_optims/AdamW
    ais/func_optims/Momentum


.. toctree::
    :caption: 命名实体识别
    :maxdepth: 1

    ais/ners/HMM-隐马尔可夫模型
    ais/ners/WWM-全词Mask
    ais/ners/CRF-条件随机场


.. toctree::
    :caption: 神经网络
    :maxdepth: 1

    ais/dls/ANN
    ais/dls/DNN-深度神经网络
    ais/dls/CNN-卷积神经网络
    ais/dls/RNN-循环神经网
    ais/dls/LSTM-长短时记忆


.. toctree::
    :caption: 深度神经网络理论
    :maxdepth: 1

    ais/dl_theorys/propagation
    ais/dl_theorys/LinearLayer
    ais/dl_theorys/FFN
    ais/dl_theorys/LayerNorm
    ais/dl_theorys/WeightTying
    ais/dl_theorys/GreedyDecoding
    ais/dl_theorys/ImageGrounding
    ais/dl_theorys/Perplexity




.. toctree::
    :caption: 其他
    :maxdepth: 1

    ais/others/判别式模型vs生成式模型
    ais/others/AllReduce
    ais/others/Embedding模型
    ais/others/BPE
    ais/others/LLM
    ais/others/KL散度
    ais/others/deeplearning
    ais/others/矢量化计算
    ais/others/other