Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Object Detection Model Overview Flask template #2004

Merged
merged 9 commits into from
Mar 21, 2023

Conversation

Advitya17
Copy link
Collaborator

@Advitya17 Advitya17 commented Mar 13, 2023

Description

This PR sets up the components to invoke a new Flask endpoint calculating the model overview metrics for the object detection scenario.

This PR is currently in draft state as it requires the metrics implementation to be defined in the backend.

Checklist

  • I have added screenshots above for all UI changes.
  • I have added e2e tests for all UI changes.
  • Documentation was updated if it was needed.

@codecov-commenter
Copy link

codecov-commenter commented Mar 13, 2023

Codecov Report

Merging #2004 (5766b7c) into main (a40e046) will increase coverage by 0.00%.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##             main    #2004   +/-   ##
=======================================
  Coverage   92.38%   92.38%           
=======================================
  Files          95       95           
  Lines        4882     4885    +3     
=======================================
+ Hits         4510     4513    +3     
  Misses        372      372           
Flag Coverage Δ
unittests 92.38% <100.00%> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
erroranalysis/erroranalysis/_internal/constants.py 100.00% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

@Advitya17 Advitya17 requested a review from vigupta March 14, 2023 13:36
@tongyu-microsoft tongyu-microsoft merged commit 1202fb6 into main Mar 21, 2023
@tongyu-microsoft tongyu-microsoft deleted the agemawat/mo_flask branch March 21, 2023 20:58
gaugup pushed a commit that referenced this pull request Mar 23, 2023
* flask endpoint infra template

* docstring and lint fixes

* lint fixes

* lint fixes

* lint autofixes

* error statement fix
gaugup added a commit that referenced this pull request Mar 23, 2023
* Add validations for model predictions

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add test

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Undo change

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Update notebooks for categorical features to pass through FeatureMetadata (#2011)

* Update responsibleaidashboard-diabetes-decision-making.ipynb

* Update responsibleaidashboard-census-classification-model-debugging.ipynb

* Update responsibleaidashboard-census-classification-model-debugging.ipynb

* Update responsibleaidashboard-diabetes-decision-making.ipynb

* Update responsibleaidashboard-diabetes-decision-making.ipynb

* Update responsibleaidashboard-diabetes-regression-model-debugging.ipynb

* Update responsibleaidashboard-census-classification-model-debugging.ipynb

* Update responsibleaidashboard-diabetes-decision-making.ipynb

* Update responsibleaidashboard-housing-classification-model-debugging.ipynb

* Update responsibleaidashboard-housing-classification-model-debugging.ipynb

* Update responsibleaidashboard-census-classification-model-debugging.ipynb

* Update responsibleaidashboard-diabetes-decision-making.ipynb

* Update responsibleaidashboard-diabetes-regression-model-debugging.ipynb

* Update responsibleaidashboard-housing-decision-making.ipynb

* Update responsibleaidashboard-multiclass-dnn-model-debugging.ipynb

* Update responsibleaidashboard-diabetes-decision-making.ipynb

* Update responsibleaidashboard-diabetes-regression-model-debugging.ipynb

* Update responsibleaidashboard-housing-classification-model-debugging.ipynb

* Update responsibleaidashboard-housing-decision-making.ipynb

* [Model Overview] Metrics Template support with OD-specific optional args (#2002)

* OD label support ckpt

* Surfaced OD metrics

* numLabels update

* lint fixes

* main fetch

* line end changes

* var fix

* ts lint fix

* lint autofixes

* Object Detection Model Overview Flask template (#2004)

* flask endpoint infra template

* docstring and lint fixes

* lint fixes

* lint fixes

* lint autofixes

* error statement fix

* Model Overview: Object Detection Widgets for Aggregate Methods, Class selection, & IoU Threshold (#1997)

* agg method & iou thresh widgets ckpt

* class selection widget

* widget option format fix

* comment fixes

* widget size & lint fixes

* semiclon lint fix

* od widget options refactor

* lint complexity fixes

* lint complexity fixes

* comment fixes

* refactor to reduce complexity

* complexity refactor

* lint fixes

* autolint fixes

* Address code review comments

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
Co-authored-by: tongy-msft <91754176+tongyu-microsoft@users.noreply.github.com>
Co-authored-by: Advitya Gemawat <agemawat@ucsd.edu>
Co-authored-by: Advitya Gemawat <agemawat@microsoft.com>
@imatiach-msft imatiach-msft mentioned this pull request Apr 25, 2023
3 tasks
This pull request was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants