Hmm, I generated a 700mb (10,000 columns, 10,000 rows) sas file with the following

data libfoo.bar ;
    call streaminit(123);
    array x{10000} x1-x10000 ;
    do i=1 to 10000 ;
        do j=1 to dim(x) ;
            x(j) = rand('Uniform') ;
        end ;
        output ;
    end ;
run ;

and I get the following with haven 0.2.0 + R 3.2.2 on AIX:

> library(haven)
> d1 = read_sas('bar.sas7bdat')
Error: cannot allocate vector of size 78 Kb
> d1 = read_sas('bar.sas7bdat')
Error: Failed to parse /sas/data04/vinh/bar.sas7bdat: Invalid file, or file has unsupported features.
> d1 = read_sas('bar.sas7bdat')
Error: Failed to parse /sas/data04/vinh/bar.sas7bdat: Invalid file, or file has unsupported features.

On a Windows machine running Revolution R Open 3.2.2, I get:

> library(haven)
> d1 = read_sas('bar.sas7bdat')
> dim(d1)
[1] 10000 10002

Could it be an issue with my compiled R on AIX? Probably not because I played around with the number of rows of data and was able to get a similar error on my Windows R at 30,000 rows:

Error: Failed to parse G:\path\to\bar.sas7bdat: Invalid file, or file has unsupported features.

I uploaded my test data set here. Curious if it's a haven or ReadState issue, and hopefully a fix will be forthcoming. Thanks so much!

Fail to parse >2GB SAS files on AIX (big endian) #33

Description

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions