Airflow operator for model serving and blocking job launch operator

Description

As part of our ML pipeline we need an Airflow operator to administer model serving instances in Hopsworks. With this operator we can create, update, start and stop a model serving instance localhost or on Kubernetes depending on the deployment.

Also, we should modify HopsworksLaunchOperator to allow block until a job finishes without calling HopsworksSensors.

Assignee

Antonios Kouzoupis

Reporter

Antonios Kouzoupis

Labels

None

Fix versions

Affects versions

Priority

Medium
Configure