Skip to content

Full patch test 1.2.x

This is a full patch test for the 1.2.x branch. It includes all changes made since the last full patch test. Note that this is very shallow testing and does not cover all edge cases. Please go through all the issues being added in this patch and test the relevant functionality as well.

Setup a new environment

  1. Create a new folder called drupal-11-test with latest version of Drupal 11.
  2. cd drupal-11-test
  3. ddev config --project-type=drupal11 --docroot=web
  4. ddev start
  5. ddev composer create-project "drupal/recommended-project:^11"
  6. ddev composer require drush/drush
  7. ddev drush site:install --account-name=admin --account-pass=admin -y
  8. ddev composer require 'drupal/ai:^1.2' 'drupal/ai_agents:^1.2' 'drupal/ai_provider_openai:^1.2' 'drupal/ai_vdb_provider_milvus:^1.1@beta'
  9. ddev composer require 'drupal/field_validation:^3.0@beta' 'drupal/search_api:^1.40' 'drupal/token:^1.17' 'drupal/admin_toolbar:^3.6'
  10. Copy the file docker-compose.milvus.yaml to the .ddev folder.
  11. ddev restart

Install the current versions of everything

  1. ddev drush pm:en ai ai_agents ai_provider_openai ai_logging ai_automators field_widget_actions ai_api_explorer ai_assistant_api ai_chatbot ai_ckeditor ai_content_suggestions ai_search ai_observability ai_translate ai_validations ai_vdb_provider_milvus admin_toolbar admin_toolbar_tools ai_agents_explorer -y

Login to the website

  1. Open browser to http://drupal-11-test.ddev.site/user/login
  2. Login with username admin and password admin

Setup the VDB Provider:

  1. In the menu go Configuration -> AI -> Vector DB Settings -> Milvus Provider
  2. In host enter http://milvus and in port enter 19530, no key needed.
  3. Click Save configuration

Setup OpenAI Provider:

  1. In the menu go to Configuration -> AI -> Provider Settings -> OpenAI Authentication
  2. Click "Create a new key".
  3. Name key name OpenAI Key and for the key value use your OpenAI API key.
  4. Click Save configuration
  5. Go back twice
  6. Reload and select the key OpenAI Key from the dropdown for the OpenAI Provider.
  7. Click Save configuration

Test the base functionality

  1. You can see this under Testing a AI Provider. Just test the OpenAI provider as normal.
  1. Visit https://drupal11-test.ddev.site/admin/config/search/search-api
  2. Click Add server
  3. For Server name enter Milvus Server
  4. For Embeddings Engine select OpenAI | text-embedding-3-small
  5. For Vector Database select Milvus DB
  6. For Database Name write default
  7. For Collection write articles
  8. Click Save
  9. Visit https://drupal11-test.ddev.site/admin/config/search/search-api again
  10. Click Add index
  11. For Index name enter Articles Index
  12. For Datasources select Content
  13. For Bundles choose Only those selected and select Article
  14. For Server select Milvus Server
  15. Click Save and add fields
  16. Add the fields Title and Body and click Done
  17. For Title select Contextual content as Indexing options
  18. For Body select Main content as Indexing options
  19. Click Save changes
  1. Create a new article with title "Living Standards" and body "Living standards refer to the level of wealth, comfort, material goods, and necessities available to a certain socioeconomic class or geographic area."
  2. Click Save
  3. Visit https://drupal11-test.ddev.site/admin/config/ai/explorers/vector_db_generator
  4. Enter the prompt Affluance Level and select the Articles Index as the index.
  5. Click Run DB Query
  6. The article should show up with over 0.3 in score.
  7. Change the prompt to Cars and Motorbikes and click Run DB Query again.
  8. The article should show up with under 0.3 in score.

Setup AI Automators

  1. Visit https://drupal11-test.ddev.site/admin/structure/types/manage/article/fields
  2. Click Edit under Tags
  3. Check Enable AI Automators
  4. Choose LLM: Taxonomy as the Automator Type
  5. Select Body as the Automator Base Field
  6. In Automator Prompt write Based on the context text create up to 2 tags that fits the context. Context: {{ context }}
  7. Click Save settings

Test AI Automators

  1. Visit the article you created earlier.
  2. Click Edit
  3. Click Save without changing anything.
  4. After the page reloads, the Tags field should be populated with 2 tags that fit the article.

Test Agents

  1. Visit https://drupal11-test.ddev.site/admin/config/ai/agents
  2. On the Content Type Agent, click the dropdown and select Explore
  3. In the prompt enter What article types are available on this website?
  4. Click Run Agent
  5. The explorer should run once and tell you that Article and Basic page are available content types.

Setup AI Logging

  1. Visit https://drupal11-test.ddev.site/admin/config/ai/logging/settings
  2. Check Automatically log requests
  3. Check Automatically log responses
  4. Click Save configuration

Test AI Logging

  1. Visit https://drupal11-test.ddev.site/admin/config/ai/explorers/chat_generator
  2. Enter the prompt What is Drupal?
  3. Click Ask The AI
  4. Visit https://drupal11-test.ddev.site/admin/config/ai/logging/collection
  5. You should see the request logged with the prompt and response.

Test AI Observability

  1. Visit https://drupal11-test.ddev.site/admin/reports/dblog
  2. You should see log entries for AI requests and responses with details about the provider used, tokens consumed, and time taken.

Setup AI Translate

  1. Visit https://drupal11-test.ddev.site/admin/structure/types/manage/article
  2. Click the tab Language settings
  3. Check Enable translation
  4. Visit https://drupal11-test.ddev.site/admin/config/regional/language/add
  5. Add German as a new language.
  6. Visit https://drupal11-test.ddev.site/admin/config/ai/settings
  7. Under Translate Text choose Chat proxy to LLM and provider and gpt-4.1 as the model.
  8. Click Save configuration

Test AI Translate

  1. Go to the article you created earlier.
  2. Click Edit
  3. Click the Translate tab
  4. On the German row, click Translate using gpt-4.1
  5. You should now see the translated title being Lebensstandard.

Setup AI Content Suggestions

  1. Visit https://drupal11-test.ddev.site/admin/config/ai/suggestions
  2. Click Enable Evaluate Readability
  3. Click Save configuration

Test AI Content Suggestions

  1. Go to the article you created earlier.
  2. Click Edit
  3. Open the tab called Evaluate Readability
  4. Click Score readability
  5. You should see a readability score and suggestions to improve the content.

Setup AI CKEditor

  1. Visit https://drupal11-test.ddev.site/admin/config/content/formats
  2. Click Configure on the Basic HTML text format.
  3. Drag the AI CKEditor button from Available buttons to Active toolbar
  4. Open the Generate with AI section.
  5. Check Enabled
  6. Click Save configuration

Test AI CKEditor

  1. Go to the article you created earlier.
  2. Click Edit
  3. In the Body field, place the cursor at the end of the content.
  4. Click the AI Assistant button in the toolbar and Generate with AI.
  5. In the modal, enter the prompt Add a conclusion about living standards.
  6. Click Generate
  7. The AI should generate a conclusion. Click Save changes to editor
  8. The conclusion should now be added to the article body.

Setup AI Validations

  1. Visit https://drupal11-test.ddev.site/admin/structure/field_validation
  2. Click Add field validation rule set
  3. Pick Content as Entity Type and Article as Bundle
  4. Click Create new field validation rule set
  5. Select Image as the field and AI Image Constraint as the constraint.
  6. Click Add
  7. In the Field Validation Rule Title enter Car Image Validation
  8. In the Column of field select target_id
  9. Change the prompt to Check if the image is of a car. Respond with XTRUE if it is a car and XFALSE if it is not.
  10. In Message add The image must be of a car.
  11. Click Add Rule

Test AI Validations

  1. Go to the article you created earlier.
  2. Click Edit
  3. In the Image field, upload an image of a tree.
  4. You should see the validation message The image must be of a car.
  5. Replace the image with an image of a car.
  6. You should be able to save the article without validation errors.

Setup AI Chatbot and AI Assistants API

  1. Visit https://drupal11-test.ddev.site/admin/config/ai/ai-assistant
  2. Click Add AI Assistant
  3. In Label enter Content Type Assistant
  4. In Instructions enter Just forward everything to the content type agent.
  5. Enable the Content Type Agent under Agents Enabled
  6. Click Save
  7. Visit https://drupal11-test.ddev.site/admin/structure/block
  8. Under Content Below click Place block 9 . Click Place block next to AI DeepChat Chatbot
  9. Under AI Assistant select Content Type Assistant
  10. Under Styling settings select Style as Bard, width as 500px, height as 600px and Placement as Bottom right
  11. Click Save block
  12. Click the tab Claro
  13. Under Content click Place block
  14. Click Place block next to AI DeepChat Chatbot
  15. Select the Content Type Assistant under AI Assistant
  16. Under Styling settings select Style as Toolbar, width as auto, height as 100% and Placement as Toolbar
  17. Click Save block

Test AI Chatbot and AI Assistants API

  1. Visit https://drupal11-test.ddev.site/
  2. In the bottom right, the chatbot should be visible. Click it open.
  3. In the input, enter What content types are available on this website?
  4. The chatbot should respond with The available content types on this website are Article and Basic page.
  5. Visit https://drupal11-test.ddev.site/admin/config
  6. In the Toolbar on the top click Assistant
  7. An assistant should slide out from the left side.
  8. In the input, enter What content types are available on this website?
  9. The assistant should respond with The available content types on this website are Article and Basic page.

Upgrade test (on first run only)

  1. Now run ddev composer require 'drupal/ai:1.2.x-dev@dev' to get the latest changes in the 1.2.x branch.
  2. Run database updates with ddev drush updb -y. Usually this is not needed for patch releases, but run it to be sure.
  3. Clear caches with ddev drush cr

Re-test the base functionality

  1. No rerun all test categories above to ensure everything still works after the upgrade.

Re-test with the updated code on install

  1. Run ddev delete -O && ddev start to delete the environment.
  2. Rerun all test categories above to ensure everything works on a fresh install with the updated code.
  3. The upgrade test is not needed here.

When finished

  1. Run ddev delete -O to delete the test environment.
  2. Remove the drupal-11-test folder if you no longer need it.