Configuring model evaluations with manual setup

Adding a database connection

Connect to a database to store model transactions and model evaluation results. You can use a Free lite plan database to get started. Alternatively, if you have an existing EDB Postgres or Db2 database, you can use it to evaluate models. You can also purchase a new database.

Follow these steps to add a database connection for model evaluations:

1. Ensure that the Database tab is open in the System setup page. Click the Edit icon.

2. Choose the database type:

   • To use the database at no cost, select the Free lite plan database from the list.

   • To use an existing database, choose one of the following options:
     a. Databases for EDB
     b. Db2
     c. Db2 Warehouse

   • To purchase a new database, click Purchase a database.

3. Complete the details for your database connection and click Save.

Limitations

• The database and IBM watsonx.ai Runtime instance must be deployed in the same account.
• You can use a EDB Postgres or Db2 database to store model-related data (feedback data, scoring payload) and calculated metrics. Lite Db2 plans are not currently supported.
• The free Lite plan database is not GDPR-compliant. If your model processes personally identifiable information (PII), you must purchase a new database or use an existing database that does conform to GDPR rules.

Setting up a machine learning provider

You can connect to deployed models stored in a machine learning environment, including pre-production and production environments. The following machine learning service providers are available for model evaluations:

• watsonx.ai Runtime
• Amazon SageMaker
• Microsoft Azure ML Studio
• Microsoft Azure ML Service

You can also use a custom service environment.

Follow these steps to connect to a machine learning provider for model evaluations:

1. In the Machine learning providers section, click Add machine learning provider.
2. Optional: To change the default name, click the Edit icon beside Machine learning providers.
3. Optional: To enter a description, click the Edit icon beside Description.
4. To enter connection information, click the Edit icon beside Connection.
5. Choose a Service provider and specify the connection details.
6. Click Save.

Managing users and roles

You must add the users that you want to have access to your model evaluations and assign roles to determine which tasks they can complete.