I'm currently analizing this issue.

cdlpResults

The explain returns exactly the same plan for both versions of Scala.

However, there are some differences inside GraphX:

SCALA 2.12

Edge(1,2,()) , Edge(1,3,()) , Edge(1,7,()) , Edge(2,3,()) , Edge(4,5,()) , Edge(4,6,()) , Edge(4,8,()) , Edge(5,6,()) , Edge(5,7,()) , Edge(5,8,()) , Edge(6,7,()) , Edge(6,8,()) , Edge(7,8,()) , Edge(2,1,()) , Edge(3,1,()) , Edge(3,2,()) , Edge(5,4,()) , Edge(6,4,()) , Edge(6,5,()) , Edge(7,1,()) , Edge(7,5,()) , Edge(7,6,()) , Edge(8,4,()) , Edge(8,5,()) , Edge(8,6,()) , Edge(8,7,())

Iterations
0 - (4,Map(8 -> 4, 5 -> 2)) , (1,Map(2 -> 2, 8 -> 2, 1 -> 2)) , (6,Map(8 -> 6, 5 -> 2)) , (3,Map(2 -> 2, 1 -> 2)) , (7,Map(2 -> 2, 8 -> 4, 5 -> 2)) , (8,Map(8 -> 8)) , (5,Map(8 -> 6, 5 -> 2)) , (2,Map(2 -> 4))
1 - (4,Map(8 -> 6)) , (1,Map(8 -> 2, 2 -> 4)) , (6,Map(8 -> 8)) , (3,Map(8 -> 2, 2 -> 2)) , (7,Map(8 -> 8)) , (8,Map(8 -> 8)) , (5,Map(8 -> 8)) , (2,Map(8 -> 2, 2 -> 2))

SCALA 2.13
Edge(1,2,()) , Edge(1,3,()) , Edge(1,7,()) , Edge(2,3,()) , Edge(4,5,()) , Edge(4,6,()) , Edge(4,8,()) , Edge(5,6,()) , Edge(5,7,()) , Edge(5,8,()) , Edge(6,7,()) , Edge(6,8,()) , Edge(7,8,()) , Edge(2,1,()) , Edge(3,1,()) , Edge(3,2,()) , Edge(5,4,()) , Edge(6,4,()) , Edge(6,5,()) , Edge(7,1,()) , Edge(7,5,()) , Edge(7,6,()) , Edge(8,4,()) , Edge(8,5,()) , Edge(8,6,()) , Edge(8,7,())

Iterations
0 - (4,HashMap(4 -> 6)) , (1,HashMap(1 -> 6)) , (6,HashMap(1 -> 2, 4 -> 4, 5 -> 2)) , (3,HashMap(1 -> 2, 2 -> 2)) , (7,HashMap(2 -> 2, 4 -> 6)) , (8,HashMap(1 -> 2, 4 -> 4, 5 -> 2)) , (5,HashMap(1 -> 2, 4 -> 4, 5 -> 2)) , (2,HashMap(1 -> 2, 2 -> 2))
1 - (4,HashMap(4 -> 6)) , (1,HashMap(1 -> 4, 4 -> 2)) , (6,HashMap(4 -> 8)) , (3,HashMap(1 -> 4)) , (7,HashMap(1 -> 2, 4 -> 6)) , (8,HashMap(4 -> 8)) , (5,HashMap(4 -> 8)) , (2,HashMap(1 -> 4))
2 - (4,HashMap(4 -> 6)) , (1,HashMap(1 -> 4, 4 -> 2)) , (6,HashMap(4 -> 8)) , (3,HashMap(1 -> 4)) , (7,HashMap(1 -> 2, 4 -> 6)) , (8,HashMap(4 -> 8)) , (5,HashMap(4 -> 8)) , (2,HashMap(1 -> 4))
3 - (4,HashMap(4 -> 6)) , (1,HashMap(1 -> 4, 4 -> 2)) , (6,HashMap(4 -> 8)) , (3,HashMap(1 -> 4)) , (7,HashMap(1 -> 2, 4 -> 6)) , (8,HashMap(4 -> 8)) , (5,HashMap(4 -> 8)) , (2,HashMap(1 -> 4))
4 - (4,HashMap(4 -> 6)) , (1,HashMap(1 -> 4, 4 -> 2)) , (6,HashMap(4 -> 8)) , (3,HashMap(1 -> 4)) , (7,HashMap(1 -> 2, 4 -> 6)) , (8,HashMap(4 -> 8)) , (5,HashMap(4 -> 8)) , (2,HashMap(1 -> 4))

bug: CDLP with algo GraphX may return incorrect results for scala 2.12 (works for 2.13) #571

Description

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions