Skip to content

[devs] some workflow changes... #6032

@soumith

Description

@soumith

If you follow PyTorch development closely (maintainers, core-devs, folks sending PRs), you may have noticed a few things in the past few months:

  • PyTorch and Caffe2 now share a CI which was significant engineering work
  • PyTorch and PyTorch-ONNX have a very complicated CI -- onnxbot triggers builds on each PyTorch PR and updates the PyTorch PR status in a roundabout way
  • There's been backend work in a "pending" state, such as integrating with the latest and greatest libraries (MKLDNN, cuFFT, more NNPACK coverage, etc. etc.)

As maintainers of PyTorch and Caffe2 frameworks, it kinda made sense to share engineering that is common across both, such as operator libraries.

However, sharing code across two separate github repos is a challenge (submodules or subtrees dont cut it, Continuous Integration becomes hard, etc.).

As a step in this line of collaboration and thinking, we are merging the Caffe2 repo into the PyTorch github, i.e. if you git clone https://github.com/pytorch/pytorch, you will see some caffe2 bits there.

As a PyTorch user, here's what you need to know:

  • Nothing changes for you. PyTorch is installed, shipped and used exactly how it is done today.

Does this mean that my code will break?

No, your code will not break. This is development and backend work. If you are not a core-developer, this issue is not even that relevant for you.

Will this mean I have to deal with protobuf?

No, if you are a user nothing changes.

Does this mean ATen is being replaced?

No, ATen will be here for a while. When we share code for operators, it will be under the ATen level.

reference: facebookarchive/caffe2#2439

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions