Enhanced AI Form Fill Element Plugin

Introduction

The Enhanced AI Form Fill Element Plugin extends Joget’s existing AI Form Fill capability by allowing users to automatically populate form fields using AI-powered prompts, voice input, and uploaded files.

It is designed to take the manual work out of data entry. Instead of typing everything by hand, your team can now fill out forms just by talking, typing a quick note, or uploading a file (PDFs, Word documents, or images of handwritten content).

The plugin is provided as a form element, making it easy to use through drag-and-drop configuration without custom coding.

Plugin information

• Supported Database: MySQL, Postgres
• License: Apache License, Version 2.0

Key Features

• Fill up Joget forms using natural language text prompts
• Support voice input (audio-based prompts)
• Upload and extract data from files (PNG/JPG, handwritten images, TXT, PDF, DOCX)
• No-code setup via a simple drag-and-drop form element configuration
• Configurable AI model (e.g., GPT-4o), extendable to other leading models.
• Secure API access via configurable proxy and API key
• Improves data accuracy and reduces manual form-filling time.

Prerequisite

• Joget DX 8 or DX 9 Enterprise Edition.
• Developer access with permission to manage plugins and apps.
• Valid API Key of OpenAI Service.

Where to get the plugin

You can download the plugin from the Joget Marketplace or Joget AI Form Fill plugin Github repository

Steps to install and use the plugin/app:

1. In the Joget App Center, upload the AI Form Fill Plugin JAR via Settings > Manage Plugins.
   
2. Open Form Builder and drag the AI Form Fill Element into the form.
   
3. Configure the element Label and ID.
4. Select the AI Model (e.g., gpt-4o), set up Proxy Domain, and enter the API Key.
   
5. Save and publish the app.
6. Run the form and provide input via text prompt or audio.
   
7. Alternatively, drag and drop a PDF file, Word document, or an image of your handwritten notes onto the element to automatically extract and populate form data.
   
8. Verify that form fields are accurately populated based on the provided input.
   

Configure AI context form fill element properties

Below are the configurations for the AI Form Fill Configuration section.

• Model *: Choose the non-OpenAI model of your choice, for example, Google Gemini (gemini-2.5-flash).
• Proxy Domain: Define the Proxy Domain (e.g., https://generativelanguage.googleapis.com/v1beta/openai/chat/completions).
• API Key *: Enter the API key from the model of your choice (you can add the API key to App variables and use a hash variable to reference the values; for more information, see App Variable).

Video Tutorial

The video below provides a visual representation of the steps mentioned.

Download sample app