Skip to content

elek/ogh

Repository files navigation

Ozone Github Helper

Ozone GH is a simple script to make it easier the development of Apache Hadoop Ozone

Install

OSX:

brew install elek/brew/ogh

Linux

go get github.com/elek/ogh

Configuration

If you have ever used hub or gh, you don't need to set the GITHUB_TOKEN:

Github token can be set by

  • setting GITHUB_TOKEN environment variable
  • Setting it in .config/hub used by hub
  • Setting it in .config/gh/config.yaml

Interactive

You can use it as an interactive command with fzf

ogh review | fzf --reverse | awk '{print $2}' | xargs -n1 ogh

Caching

Github calls are cached for 3-5 minutes, by default. (Cache stored in stander ~/.cache/ogh locations).

Results of finished builds are cached forever.

Usage

Print out READY pull requests

> ogh review

+-----+--------------+----------------------------------------------------+------------------------+----------------+
| ID  |    AUTHOR    |                      SUMMARY                       |      PARTICIPANTS      |     CHECK      |
+-----+--------------+----------------------------------------------------+------------------------+----------------+
| 648 | >avijayanhwx | HDDS-3117. Recon throws InterruptedException while | ✓swagl                 | _______ ______ |
| 578 | >elek        | HDDS-3053. Decrease the number of the chunk writer | ✓adoro                 | _______ ______ |
| 622 | >adoroszlai  | HDDS-3113. Add new Freon test for putBlock         | ✓elek                  | _______ ______ |
| 551 | >adoroszlai  | HDDS-2717. Handle chunk increments in datanode     | bshas,adoro,arp7,lokes | _______ ______ |
| 618 | >captainzmc  | HDDS-2911. Fix lastUsed and stateEnterTime value i |                        | _______ ______ |
| 555 | >elek        | HDDS-3023. Create Freon test to test isolated Rati |                        | _______ ______ |
| 582 | >smengcl     | HDDS-3047. ObjectStore#listVolumesByUser and Creat | xiaoy                  | _______ ______ |
| 399 | >cxorm       | HDDS-2424. Add the recover-trash command server si | cxorm,bhara,maoba      | _______ ...... |
+-----+--------------+----------------------------------------------------+------------------------+----------------+

Legend (IMPORTANT):

  • [C] means a conflict
  • Participants can be prefixed with a review flag (✓ approved, ✕ change requested)
  • Upper case login name means a real review, lower case is a comment
  • The last column (CHECK) shows the results of the checks
    • _ means a passed
    • . means a missing build
    • % means an in-progress builds
    • any letter (eg. b,c) means a failing test (b -> build, u -> unit test ,etc).
    • The second part (after the space) of the checks display all the integrations tests.

Print out all the available pull requests (including failiing / conflicted ones)

ogh pr

+-----+---------------+----------------------------------------------------+---------------------------------+----------------+
| ID  |    AUTHOR     |                      SUMMARY                       |          PARTICIPANTS           |     CHECK      |
+-----+---------------+----------------------------------------------------+---------------------------------+----------------+
| 430 | >cxorm        | HDDS-2817. Fix listing buckets for setting --prefi | ✕githu,cxorm,smeng              | _______ ______ |
| 649 | >bharatviswa5 | [WIP]HDDS-3120. Freon work with OM HA.             |                                 | ______a _____o |
| 623 | >supratimdeka | HDDS-2941. file create : create key table entries  | mukul                           | _____u_ f_____ |
| 524 | >iamabug      | HDDS-2797. beyond/RunningWithHDFS.md translation   | ✕cxorm                          | _______ ______ |
| 520 | >iamabug      | HDDS-2793. concept/Datanodes.md translation        | iamab,xiaoy                     | ______a ______ |
| 525 | >iamabug      | HDDS-2798. beyond/Containers.md translation        | ✕cxorm,iamab                    | ______a f__h__ |
| 648 | >avijayanhwx  | HDDS-3117. Recon throws InterruptedException while | ✓swagl                          | _______ ______ |
| 608 | >sodonnel     | HDDS-3084 - Extended Network Topology Robot tests  | ✕adoro,✕githu,elek,sodon       | _______ ______ |
| 645 | >runzhiwang   | HDDS-3130. Add jaeger trace span in s3gateway      |                                 | _____u_ ______ |
| 578 | >elek         | HDDS-3053. Decrease the number of the chunk writer | ✓adoro                          | _______ ______ |
| 622 | >adoroszlai   | HDDS-3113. Add new Freon test for putBlock         | ✓elek                           | _______ ______ |
| 551 | >adoroszlai   | HDDS-2717. Handle chunk increments in datanode     | lokes,bshas,adoro,arp7          | _______ ______ |
| 643 | >hanishakoner | HDDS-2339. Add OzoneManager to MiniOzoneChaosClust |                                 | _____u_ ______ |

Print out latest builds on master

ogh builds master

+-----+----------------------+--------------+---------------------+--------+----------------------------------------------------+----------------+
| ID  |       CREATED        |   WORKFLOW   |        REPO         | BRANCH |                       COMMIT                       |     CHECKS     |
+-----+----------------------+--------------+---------------------+--------+----------------------------------------------------+----------------+
| 579 | 2020-03-08T04:04:13Z | build-branch | apache/hadoop-ozone | master | HDDS-3089. TestSCMNodeManager intermittent crash ( | _______ ______ |
| 578 | 2020-03-07T07:35:10Z | build-branch | apache/hadoop-ozone | master | HDDS-3075. Fix ScmCli exception message when conta | _______ ______ |
| 576 | 2020-03-06T22:17:09Z | build-branch | apache/hadoop-ozone | master | HDDS-3071. Datanodes unable to connect to recon in | _______ ______ |
| 574 | 2020-03-06T17:37:19Z | build-branch | apache/hadoop-ozone | master | HDDS-3132. NPE when create RPC client. (#646)      | _____u_ f__h__ |
| 571 | 2020-03-06T15:53:19Z | build-branch | apache/hadoop-ozone | master | HDDS-3072. SCM scrub pipeline should be started af | _______ ______ |
| 570 | 2020-03-06T14:45:47Z | build-branch | apache/hadoop-ozone | master | HDDS-3131. Disable TestMiniChaosOzoneCluster (#644 | _______ ______ |

Download an artifacts

Use ogh artifacts pr/717 (to download the last build of a PR) or ogh artifacts 579 to download results of a specific line (see previous) table.

Without the --all flag, only the failing tests are downloaded.

Rerun build

Usually it's better to do with an empty commit, but you can trigger rerun from the API (use PR number):

ogh rerun 123

For some reason Github usually returns with 500 and starts the rerun.

About

Helper script for Apache Hadoop Ozone development

Resources

Stars

Watchers

Forks

Packages

No packages published

Contributors 2

  •  
  •