This page provides information about testing of ODAHU. ODAHU uses Robot Framework for an integration, system and end-to-end testings.
All tests are located in the following directories of the ODAHU project:
packages/robot/- a python package with additional Robot libraries. For example: kubernetes, auth_client, feedback, and so on.
packages/tests/stuff/- artifacts for integration testing. For example: pre-trained ML artifacts, test toolchain integrations, and so on.
packages/tests/e2e/- directory with the RobotFramework tests.
Preparing for testing¶
It’s expected that you are using Unix-like operating system and have installed Python 3.6.9+ and pip.
Clone ODAHU project from git repository and proceed to main dir –
Create Python virtual environment e.g. in the folder
./odahu-flow/virtual_environment/and activate one.
Install Robot Framework
Update and/or install pip and setuptools:
$ pip install -U pip setuptools
Proceed to the
odahu-flowmain directory where the
Makefileis located and run make command:
/odahu-flow$ make install-all
Check that odahuflowctl works:
We set up robot tests for
gke-odahu-flow-test cluster in the example below.
NB. Do not forget change your cluster url and odahu-flow version.
By default put
odahu-flow/.secrets/folder (by default) or you can specify another default name of file or directory in ‘Makefile’ in parameters:
You can optionally override the following parameters in
.envfile (which by default are taken from
For that, you should create
.envfile in the main dir of the project (
In our example, we will override the parameters of
# Cluster name CLUSTER_NAME=gke-odahu-flow-test # Optionally, you can provide RobotFramework settings below. # Additional robot parameters. For example, you can specify tags or variables. ROBOT_OPTIONS=-e disable # Robot files ROBOT_FILES=**/*.robot # Cloud which will be used CLOUD_PROVIDER=gcp # Docker registry DOCKER_REGISTRY=gcr.io/or2-msq-<myprojectid>-t1iylu/odahu # Version of odahu-flow ODAHUFLOW_VERSION=1.1.0-rc8
Afterwards, you should prepare an Odahu cluster for Robot Framework tests by using the command:
/odahu-flow$ make setup-e2e-robot
NB. You should execute the previous command only once for a new cluster.
Finally, start the robot tests:
/odahu-flow$ make e2e-robot