Skip to content

Conversation

pdet
Copy link
Contributor

@pdet pdet commented Jun 4, 2025

This PR introduces a new option, the arrow_output_version, which allows us to specify a format version to which we should output our data to. We default to V1.0.

This new variable kind of makes the produce_arrow_string_view arrow_output_list_view useless, but I guess that removing them might be slightly controversial, since it might break ppl's scripts. Hence I went with inter-op.

https://arrow.apache.org/docs/format/Versioning.html#post-1-0-0-format-versions

Fix: https://github.com/duckdblabs/duckdb-internal/issues/5058

@pdet pdet requested a review from Tishj June 4, 2025 14:12
@pdet pdet added the Needs Documentation Use for issues or PRs that require changes in the documentation label Jun 4, 2025
@duckdb-draftbot duckdb-draftbot marked this pull request as draft June 5, 2025 10:25
@pdet pdet marked this pull request as ready for review June 5, 2025 10:25
@Mytherin Mytherin merged commit 6d6324a into duckdb:v1.3-ossivalis Jun 5, 2025
50 checks passed
@Mytherin
Copy link
Collaborator

Mytherin commented Jun 5, 2025

Thanks!

github-actions bot pushed a commit to duckdb/duckdb-r that referenced this pull request Jun 5, 2025
arrow_output_version option to produce arrow depending on a format version. (duckdb/duckdb#17791)
Support glibc 2.28 environments in 1.3.x (duckdb/duckdb#17814)
Avoid saving ccache on pull_requests (duckdb/duckdb#17810)
github-actions bot added a commit to duckdb/duckdb-r that referenced this pull request Jun 5, 2025
arrow_output_version option to produce arrow depending on a format version. (duckdb/duckdb#17791)
Support glibc 2.28 environments in 1.3.x (duckdb/duckdb#17814)
Avoid saving ccache on pull_requests (duckdb/duckdb#17810)

Co-authored-by: krlmlr <krlmlr@users.noreply.github.com>
@pdet pdet deleted the arrow_output branch July 18, 2025 12:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Needs Documentation Use for issues or PRs that require changes in the documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants