Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: klauspost/compress
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: v1.17.4
Choose a base ref
...
head repository: klauspost/compress
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: v1.17.5
Choose a head ref
  • 16 commits
  • 30 files changed
  • 7 contributors

Commits on Dec 1, 2023

  1. Update README.md

    klauspost authored Dec 1, 2023
    Configuration menu
    Copy the full SHA
    1dba04a View commit details
    Browse the repository at this point in the history

Commits on Dec 9, 2023

  1. zstd: Shorter and faster asm for decSymbol.newState (#896)

    * zstd: Shorter asm for decSymbol.newState
    
    The asm needs to compute decSymbol.newState, which is
    
    	uint16(state >> 16),
    
    or, equivalently (except for types),
    
    	uint32(state) >> 16.
    
    This can be accomplished by a MOVL+SHRL, the former of which is elided
    by avo, so we get a single instruction for both the BMI2 and non-BMI2
    cases.
    
    Benchmarks show no difference on a new BMI2-supporting machine, but on
    an older i7, decompression throughput is a tiny bit faster:
    
    	goos: linux
    	goarch: amd64
    	pkg: github.com/klauspost/compress/zstd
    	cpu: Intel(R) Core(TM) i7-3770K CPU @ 3.50GHz
    	                                       │     old      │                shift                │
    	                                       │     B/s      │     B/s       vs base               │
    	Decoder_DecodeAll/kppkn.gtb.zst-8        441.4Mi ± 2%   450.4Mi ± 0%  +2.03% (p=0.000 n=10)
    	Decoder_DecodeAll/geo.protodata.zst-8    1.148Gi ± 1%   1.152Gi ± 0%  +0.34% (p=0.009 n=10)
    	Decoder_DecodeAll/plrabn12.txt.zst-8     347.9Mi ± 0%   356.6Mi ± 1%  +2.48% (p=0.000 n=10)
    	Decoder_DecodeAll/lcet10.txt.zst-8       417.4Mi ± 0%   427.3Mi ± 0%  +2.37% (p=0.000 n=10)
    	Decoder_DecodeAll/asyoulik.txt.zst-8     347.1Mi ± 0%   352.7Mi ± 1%  +1.62% (p=0.003 n=10)
    	Decoder_DecodeAll/alice29.txt.zst-8      346.3Mi ± 1%   352.6Mi ± 0%  +1.83% (p=0.000 n=10)
    	Decoder_DecodeAll/html_x_4.zst-8         1.440Gi ± 0%   1.445Gi ± 0%  +0.29% (p=0.019 n=10)
    	Decoder_DecodeAll/paper-100k.pdf.zst-8   4.191Gi ± 0%   4.210Gi ± 0%  +0.45% (p=0.007 n=10)
    	Decoder_DecodeAll/fireworks.jpeg.zst-8   8.891Gi ± 0%   8.849Gi ± 0%  -0.47% (p=0.000 n=10)
    	Decoder_DecodeAll/urls.10K.zst-8         589.6Mi ± 0%   600.2Mi ± 0%  +1.80% (p=0.001 n=10)
    	Decoder_DecodeAll/html.zst-8             926.1Mi ± 1%   937.9Mi ± 0%  +1.27% (p=0.000 n=10)
    	Decoder_DecodeAll/comp-data.bin.zst-8    389.6Mi ± 0%   395.1Mi ± 0%  +1.40% (p=0.000 n=10)
    	geomean                                  832.6Mi        843.3Mi       +1.28%
    
    * zstd: Remove unused parameter in asm generator
    greatroar authored Dec 9, 2023
    Configuration menu
    Copy the full SHA
    6bf960e View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2023

  1. CI: Hash pin sensitive actions and configure Dependabot to automatica…

    …lly update them (#899)
    
    * ci: hashpin sensitive workflow dependencies
    
    Signed-off-by: Diogo Teles Sant'Anna <diogoteles@google.com>
    
    * ci: configure dependabot to update workflow dependencies
    
    Signed-off-by: Diogo Teles Sant'Anna <diogoteles@google.com>
    
    ---------
    
    Signed-off-by: Diogo Teles Sant'Anna <diogoteles@google.com>
    diogoteles08 authored Dec 15, 2023
    Configuration menu
    Copy the full SHA
    5f128b2 View commit details
    Browse the repository at this point in the history
  2. build(deps): bump the github-actions group with 4 updates (#900)

    Bumps the github-actions group with 4 updates: [actions/checkout](https://github.com/actions/checkout), [github/codeql-action](https://github.com/github/codeql-action), [actions/setup-go](https://github.com/actions/setup-go) and [goreleaser/goreleaser-action](https://github.com/goreleaser/goreleaser-action).
    
    
    Updates `actions/checkout` from 2 to 4
    - [Release notes](https://github.com/actions/checkout/releases)
    - [Commits](actions/checkout@v2...v4)
    
    Updates `github/codeql-action` from 2.22.11 to 3.22.11
    - [Release notes](https://github.com/github/codeql-action/releases)
    - [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
    - [Commits](github/codeql-action@03e7845...b374143)
    
    Updates `actions/setup-go` from 2 to 5
    - [Release notes](https://github.com/actions/setup-go/releases)
    - [Commits](actions/setup-go@v2...v5)
    
    Updates `goreleaser/goreleaser-action` from 2.9.1 to 5.0.0
    - [Release notes](https://github.com/goreleaser/goreleaser-action/releases)
    - [Commits](goreleaser/goreleaser-action@b953231...7ec5c2b)
    
    ---
    updated-dependencies:
    - dependency-name: actions/checkout
      dependency-type: direct:production
      update-type: version-update:semver-major
      dependency-group: github-actions
    - dependency-name: github/codeql-action
      dependency-type: direct:production
      update-type: version-update:semver-major
      dependency-group: github-actions
    - dependency-name: actions/setup-go
      dependency-type: direct:production
      update-type: version-update:semver-major
      dependency-group: github-actions
    - dependency-name: goreleaser/goreleaser-action
      dependency-type: direct:production
      update-type: version-update:semver-major
      dependency-group: github-actions
    ...
    
    Signed-off-by: dependabot[bot] <support@github.com>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Dec 15, 2023
    Configuration menu
    Copy the full SHA
    0619f9a View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2023

  1. Configuration menu
    Copy the full SHA
    93a6c80 View commit details
    Browse the repository at this point in the history
  2. Update generator and executable go.mod (#904)

    * Update generator and executable go.mod
    * Update sum files
    klauspost authored Dec 19, 2023
    Configuration menu
    Copy the full SHA
    d0453f8 View commit details
    Browse the repository at this point in the history

Commits on Dec 28, 2023

  1. Update README.md (#905)

    pelenium authored Dec 28, 2023
    Configuration menu
    Copy the full SHA
    f6216d3 View commit details
    Browse the repository at this point in the history

Commits on Jan 2, 2024

  1. build(deps): bump the github-actions group with 1 update (#906)

    Bumps the github-actions group with 1 update: [github/codeql-action](https://github.com/github/codeql-action).
    
    
    Updates `github/codeql-action` from 3.22.11 to 3.22.12
    - [Release notes](https://github.com/github/codeql-action/releases)
    - [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
    - [Commits](github/codeql-action@b374143...012739e)
    
    ---
    updated-dependencies:
    - dependency-name: github/codeql-action
      dependency-type: direct:production
      update-type: version-update:semver-patch
      dependency-group: github-actions
    ...
    
    Signed-off-by: dependabot[bot] <support@github.com>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jan 2, 2024
    Configuration menu
    Copy the full SHA
    eabf71d View commit details
    Browse the repository at this point in the history

Commits on Jan 3, 2024

  1. zstd: Add Frame header encoding and stripping (#908)

    Allows to remove the frame header from input and adds a function that encodes current frame header values.
    klauspost authored Jan 3, 2024
    Configuration menu
    Copy the full SHA
    85452d2 View commit details
    Browse the repository at this point in the history

Commits on Jan 15, 2024

  1. zstd: Tweak noasm FSE decoder (#910)

    Benchmark results below. On a different machine, I saw somewhat bigger
    speedups when benchmarking a version that has the noasm version of FSE,
    but asm seqdec. The paper-100k benchmarks have some extreme variance in
    the first 12 runs, so I did 12 more to get a more reliable average. The
    apparent regression on that benchmark may be a fluke.
    
    The asm FSE decoder still wins.
    
    goos: linux
    goarch: amd64
    pkg: github.com/klauspost/compress/zstd
    cpu: Intel(R) Core(TM) i7-3770K CPU @ 3.50GHz
                                                         │     old      │                 new                 │
                                                         │     B/s      │     B/s       vs base               │
    Decoder_DecoderSmall/kppkn.gtb.zst/buffered-8          252.3Mi ± 0%   251.9Mi ± 0%  -0.12% (p=0.027 n=12)
    Decoder_DecoderSmall/kppkn.gtb.zst/unbuffered-8        300.2Mi ± 1%   299.5Mi ± 1%       ~ (p=0.977 n=12)
    Decoder_DecoderSmall/geo.protodata.zst/buffered-8      702.1Mi ± 0%   701.4Mi ± 0%       ~ (p=0.551 n=12)
    Decoder_DecoderSmall/geo.protodata.zst/unbuffered-8    703.1Mi ± 1%   695.9Mi ± 1%       ~ (p=0.178 n=12)
    Decoder_DecoderSmall/plrabn12.txt.zst/buffered-8       200.3Mi ± 0%   200.2Mi ± 0%       ~ (p=0.417 n=12)
    Decoder_DecoderSmall/plrabn12.txt.zst/unbuffered-8     294.3Mi ± 2%   294.2Mi ± 2%       ~ (p=0.755 n=12)
    Decoder_DecoderSmall/lcet10.txt.zst/buffered-8         237.7Mi ± 0%   237.7Mi ± 0%       ~ (p=0.561 n=12)
    Decoder_DecoderSmall/lcet10.txt.zst/unbuffered-8       315.7Mi ± 1%   313.0Mi ± 2%       ~ (p=0.713 n=12)
    Decoder_DecoderSmall/asyoulik.txt.zst/buffered-8       205.7Mi ± 3%   212.8Mi ± 0%  +3.43% (p=0.002 n=12)
    Decoder_DecoderSmall/asyoulik.txt.zst/unbuffered-8     267.1Mi ± 2%   273.4Mi ± 4%       ~ (p=0.078 n=12)
    Decoder_DecoderSmall/alice29.txt.zst/buffered-8        194.8Mi ± 0%   194.8Mi ± 0%       ~ (p=0.876 n=12)
    Decoder_DecoderSmall/alice29.txt.zst/unbuffered-8      219.8Mi ± 2%   221.5Mi ± 1%       ~ (p=0.410 n=12)
    Decoder_DecoderSmall/html_x_4.zst/buffered-8           1.512Gi ± 1%   1.550Gi ± 0%  +2.49% (p=0.000 n=12)
    Decoder_DecoderSmall/html_x_4.zst/unbuffered-8         1.149Gi ± 2%   1.196Gi ± 2%  +4.09% (p=0.000 n=12)
    Decoder_DecoderSmall/paper-100k.pdf.zst/buffered-8     2.504Gi ± 1%   2.513Gi ± 0%       ~ (p=0.136 n=24)
    Decoder_DecoderSmall/paper-100k.pdf.zst/unbuffered-8   1.041Gi ± 3%   1.023Gi ± 0%  -1.72% (p=0.002 n=24)
    Decoder_DecoderSmall/fireworks.jpeg.zst/buffered-8     6.315Gi ± 0%   6.349Gi ± 0%  +0.53% (p=0.000 n=12)
    Decoder_DecoderSmall/fireworks.jpeg.zst/unbuffered-8   3.178Gi ± 3%   3.234Gi ± 2%       ~ (p=0.713 n=12)
    Decoder_DecoderSmall/urls.10K.zst/buffered-8           350.9Mi ± 0%   351.0Mi ± 0%       ~ (p=1.000 n=12)
    Decoder_DecoderSmall/urls.10K.zst/unbuffered-8         525.8Mi ± 1%   524.9Mi ± 3%       ~ (p=0.671 n=12)
    Decoder_DecoderSmall/html.zst/buffered-8               562.0Mi ± 0%   561.2Mi ± 0%       ~ (p=0.054 n=12)
    Decoder_DecoderSmall/html.zst/unbuffered-8             537.4Mi ± 2%   543.5Mi ± 2%       ~ (p=0.178 n=12)
    Decoder_DecoderSmall/comp-data.bin.zst/buffered-8      283.4Mi ± 0%   283.8Mi ± 0%       ~ (p=0.164 n=12)
    Decoder_DecoderSmall/comp-data.bin.zst/unbuffered-8    118.0Mi ± 1%   120.3Mi ± 3%       ~ (p=0.128 n=12)
    geomean                                                505.1Mi        508.1Mi       +0.60%
    greatroar authored Jan 15, 2024
    Configuration menu
    Copy the full SHA
    d9b6e1e View commit details
    Browse the repository at this point in the history

Commits on Jan 19, 2024

  1. flate: Fix reset with dictionary on custom window encodes (#912)

    Dictionary was being ignored when compressing with a custom window size.
    
    Fixes #911
    klauspost authored Jan 19, 2024
    Configuration menu
    Copy the full SHA
    32312d5 View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2024

  1. zstd: Limit default window to 8MB (#913)

    Limit the default window size to 8MB.
    klauspost authored Jan 24, 2024
    Configuration menu
    Copy the full SHA
    01b2a79 View commit details
    Browse the repository at this point in the history

Commits on Jan 25, 2024

  1. s2: Fix callbacks for skippable blocks and disallow 0xfe (Padding) fo…

    …r custom use (#916)
    
    The spec writes that 0xfe must not be interpreted by decompressors, so
    setting up a callback should be denied.
    
    I left 0xfe open for use by the Writer, as it could maybe be valid for a
    user to handle padding manually.
    Jille authored Jan 25, 2024
    Configuration menu
    Copy the full SHA
    515f153 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6ac58c9 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    3deb878 View commit details
    Browse the repository at this point in the history
  4. s2: Document and test how to peek the stream for skippable blocks (#918)

    Co-authored-by: Klaus Post <klauspost@gmail.com>
    Jille and klauspost authored Jan 25, 2024
    Configuration menu
    Copy the full SHA
    6662a21 View commit details
    Browse the repository at this point in the history
Loading