跳到主要内容
知仓学习社ZHICANG

rag-chunking-strategy

Document chunking with multiple strategies including semantic, recursive, and fixed-size chunking

不碰外部(只输出文字)无严重或高危命中a5c-ai/babysitter

它会碰到什么

扫了多少2 个文本文件,2 KB
它会碰到什么不碰外部(只输出文字)
命中总数0 处
命中统计严重 0 · 高 0 · 中 0 · 低 0

这一栏是扫描器报的事实,不是结论。命中多不等于有毒(安全工具、规则库、示例脚本本来就会包含危险写法),命中少也不等于干净。它和你手上的凭据、文件、网络有什么关系,需要你自己看。

技能内容

RAG Chunking Strategy Skill

Capabilities

  • Implement multiple document chunking strategies
  • Configure semantic chunking based on content boundaries
  • Set up recursive character text splitting
  • Design fixed-size chunking with overlap
  • Implement document-aware chunking (markdown, code, etc.)
  • Optimize chunk sizes for retrieval quality

Target Processes

  • rag-pipeline-implementation
  • chunking-strategy-design

Implementation Details

Chunking Strategies

  1. RecursiveCharacterTextSplitter: Hierarchical splitting with separators
  2. SemanticChunker: Embedding-based semantic boundaries
  3. TokenTextSplitter: Token-aware splitting
  4. MarkdownHeaderTextSplitter: Structure-aware markdown splitting
  5. CodeSplitter: Language-aware code chunking

Configuration Options

  • Chunk size (characters or tokens)
  • Chunk overlap percentage
  • Separator hierarchy
  • Embedding model for semantic chunking
  • Document type detection

Best Practices

  • Match chunk size to embedding model limits
  • Use appropriate overlap for context preservation
  • Test retrieval quality with different strategies
  • Consider document structure in strategy selection

Dependencies

  • langchain-text-splitters
  • sentence-transformers (for semantic chunking)

想直接用这个技能?

本站把开放许可(MIT / Apache 等)的技能按仓库打包整理到网盘,点一下转存到你自己的网盘,不用一个个从 GitHub 拉。许可未声明的技能只给原始仓库链接,不打包。

它属于哪个仓库

星标★ 1,796
本站分层T1
该仓技能数2115
原文件路径library/specializations/ai-agents-conversational/skills/rag-chunking-strategy/SKILL.md

同一个仓库里的其他技能

看这个仓库的全部 2115 个技能