AI 与检测引擎

토큰화 (Tokenization)

定义

The preprocessing step of splitting text into smaller units called tokens for model input.

了解更多

Wikipedia ↗相关新闻 ↗

同类别的其他术语

LLM / sLLM 인공신경망 (ANN)스파이킹 신경망 (SNN)검색증강생성 (RAG)에이전트형 AI (Agentic AI)적대적 예제 (Adversarial Example)