Is there an existing issue for the same feature request?

• I have checked the existing issues.

Is your feature request related to a problem?

No response

Describe the feature you'd like

Implement rag_tokenizer of RAGFlow in C++:
https://github.com/infiniflow/ragflow/blob/main/rag/nlp/rag_tokenizer.py

Describe implementation you've considered

No response

Documentation, adoption, use case

No response

Additional information

No response