Search results

Can't pass test with system absl

bug

Status: Open.

#1137 In google/sentencepiece;

· Henry-ZHR opened on Aug 12, 2025

Perftools use seems to cause Attempt to free invalid pointer 0x1ef160aa2f80

Details requestedRequesting more detailed information to investigate the cause.Requesting more detailed information to investigate the cause.

Status: Open.

#1105 In google/sentencepiece;

· yurivict opened on Apr 10, 2025

BPE Dropout tokenizer generates unk at the beginning of sequence

Details requestedRequesting more detailed information to investigate the cause.Requesting more detailed information to investigate the cause.

Status: Open.

#1071 In google/sentencepiece;

· AnnaLebedeva opened on Dec 1, 2024

Initialized number of seed sentencepieces too low

Status: Open.

#1068 In google/sentencepiece;

· dpedchenko opened on Nov 14, 2024

With unigram algorithm, constant piece at end of each sentences does not become a token

bug

Status: Open.

#1047 In google/sentencepiece;

· jogardi opened on Aug 29, 2024

Zero Width Joiner issue for Sinhala Language

Details requestedRequesting more detailed information to investigate the cause.Requesting more detailed information to investigate the cause.

Status: Open.

#1031 In google/sentencepiece;

· Nadil-K opened on Jun 30, 2024

No typings in Python package

enhancement

Status: Open.

#1030 In google/sentencepiece;

· marcospgp opened on Jun 29, 2024

When I set SPM_PROTOBUF_PROVIDER to "package" in CMakeLists.txt, the compilation fails.

execution environmentAny issues related to execution environment, installationAny issues related to execution environment, installation

protobuf

Status: Open.

#1029 In google/sentencepiece;

· hhxdestiny opened on Jun 25, 2024

Wrong calculation of max_score in unigram_model.cc

bug

Status: Open.

#1024 In google/sentencepiece;

· fairydreaming opened on Jun 12, 2024

Allow whitespace-only pieces

Status: Open.

#984 In google/sentencepiece;

· bauwenst opened on Feb 26, 2024

High frequency token segmented into letter sequence when input is a tsv file

bug

Status: Open.

#967 In google/sentencepiece;

· TingxunShi opened on Jan 30, 2024

A library that conflicts with the use of protobuf in vcpkg

protobuf

Status: Open.

#927 In google/sentencepiece;

· hhxdestiny opened on Oct 31, 2023