AI & detection engine

토큰화 (Tokenization)

Definition

The preprocessing step of splitting text into smaller units called tokens for model input.

Learn more

Wikipedia ↗Related news ↗

Related terms

LLM / sLLM 인공신경망 (ANN)스파이킹 신경망 (SNN)검색증강생성 (RAG)에이전트형 AI (Agentic AI)적대적 예제 (Adversarial Example)