Skip to content
This repository was archived by the owner on Jul 10, 2025. It is now read-only.

RFC: TFX Tuner Component #236

Merged
merged 9 commits into from
May 12, 2020
Merged

RFC: TFX Tuner Component #236

merged 9 commits into from
May 12, 2020

Conversation

1025KB
Copy link
Contributor

@1025KB 1025KB commented Apr 24, 2020 •
edited by theadactyl
Loading

This RFC will be open for comment until Friday, May 8, 2020.

TFX Tuner Component

Status Proposed
RFC # 236
Author(s) Jiayi Zhao (jyzhao@google.com), Amy Wu (wuamy@google.com)
Sponsor Zhitao Li (zhitaoli@google.com), Tom O'Malley (omalleyt@google.com), Matthieu Monsch (mtth@google.com), Makoto Uchida (muchida@google.com), Goutham Bhat (goutham@google.com)
Updated 2020-04-20

Objective

Goal

  • A new Tuner component in TFX for automated hyper-parameter tuning, which is based on abstractions from KerasTuner library, in order to reuse abstractions and algorithms from latter.

Non Goal

  • Natively support multi-worker tuning by the system. As TFX doesn't have ability to manage multi-worker clusters, running multiple trials in parallel (parallel tuning) and running each trial in distributed env (distributed training) are not supported natively. Parallel tuning may instead be realized by a particular implementation of TFX Tuner (custom Executor), e.g., in Google Cloud environment.
  • Implementation of custom tuner for KerasTuner library is out of scope of this design discussion, e.g., a built-in EstimatorTuner support. However, user project can still implement a tuner that inherits from kerastuner.BaseTuner and provide it to the proposed TFX Tuner component.

@1025KB 1025KB closed this Apr 24, 2020
@1025KB 1025KB reopened this Apr 24, 2020
@theadactyl theadactyl changed the title RFC for TFX Tuner Component RFC: TFX Tuner Component Apr 24, 2020
@theadactyl theadactyl added the RFC: Proposed RFC Design Document label Apr 24, 2020
@ematejska
Copy link

The review happened today. There was no extra feedback and the Design is accepted as is.

@ematejska ematejska merged commit d1c022d into tensorflow:master May 12, 2020
@ematejska ematejska added RFC: Accepted RFC Design Document: Accepted by Review and removed RFC: Proposed RFC Design Document labels May 12, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@ewilderj ewilderj Awaiting requested review from ewilderj

@martinwicke martinwicke Awaiting requested review from martinwicke

@theadactyl theadactyl Awaiting requested review from theadactyl theadactyl is a code owner

1 more reviewer

@ematejska ematejska ematejska approved these changes

Reviewers whose approvals may not affect merge requirements
Assignees
No one assigned
Labels
cla: yes RFC: Accepted RFC Design Document: Accepted by Review
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@1025KB @ematejska @googlebot @theadactyl