Skip to content

Wrong detection of a json character encoding? #463

@ghost

Description

I'm trying to deduplicate files remotely. I have run rmlint on machine A, and obtained a json file.

I uploaded it to machine B, and tried to run:
#LC_ALL=en_US.utf8 /root/rmlint-2.10.1/rmlint --replay /mnt/SEAGATE/ // 2021-01-04_pi-rmlint-utf8.json

I am getting an error:

INFO: Loading json-results `/root/2020-12-18_sorting_hdd-running-rmlint-seagate-vs-wd/pi/2021-01-04_pi-rmlint-utf8.json'
WARNING: Error: JSON data must be UTF-8 encoded
WARNING: Loading /root/2020-12-18_sorting_hdd-running-rmlint-seagate-vs-wd/pi/2021-01-04_pi-rmlint-utf8.json failed.
ERROR: No valid .json files given, aborting.

The json file is produced by rmlint itself, and under a utf8 locale. chardetect from python-chardet agrees that the file is utf8.

The difference between the machines is that machine A is a raspberry pi 4B, and machine B is an x86_64. rmlint versions are both 2.10.4

Metadata

Metadata

Assignees

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions