Skip to main content

Batch processing

ToothFairyAI's Batch processing allows users to upload a large number of records to be processed by the AI agent selected.

tip

The agent selection is not required for the "Sentiment reviewer" which can be adapted onl;y by fine-tuning the underlying model.

TheBatch section can located from the main menu: Batch

Batch structure​

ToothFairyAI offers three types of batch processing:

  • Business analyst
  • Content creator
  • Sentiment reviewer

The batch name matches the same naming convention as the agent name.

Depending on the tab selected, the user will be presented with a different interface showing the batch processing initiation window.

The user will be asked to select the agent to be used for the batch processing in case of the Business analyst and Content creator tabs.

The selection of the agent is not needed for the Sentiment reviewer.

The user will also be able to include name and description for the batch processing for future reference.

Once the batch processing is initiated, the user will be asked to upload a CSV file containing the data to be processed.

The CSV file must contain a column named "text" which will be used as the input for the agent.

Below the format for each batch type:

Business Analyst

  • text: Prompt to be used by the agent for the analysis
  • answerLanguage: Language code to override the language detection result forcing the agent to use a specific language for the answer (optional)
  • questionLanguage: Language code to override the language detection result forcing the agent to use a specific language for the question (optional)
  • id: Unique identifier for the record (optional)

Content Creator

  • text: Prompt to be used by the agent for the content creation
  • sourceLanguage: Language code to override the language detection result forcing the agent to use a specific language for the prompt (optional)
  • targetLanguage: Language code to override the language detection result forcing the agent to use a specific language for the answer (optional)
  • scope: Custom prompt id to be used by the agent for the content creation (optional)
  • id: Unique identifier for the record (optional)

Sentiment Reviewer

  • text: The text to be processed by the agent
  • forcedLanguage: Language code to override the language detection result (optional)
  • id: Unique identifier for the record (optional)
  • split: Split the text into logical sentences (optional)
  • self: When true, the text assumes the subject is "I" when there is no clear sentence subject (optional)
  • med: When true, it forces the sentiment reviewer to extract drugs and medical conditions as entities (optional)

Once the file is uploaded the batch processing will start and the user will be able to see the progress in the "Batch processing" tab.

Batch processing can have one of the following statuses:

  • dispatched: The batch processing has been dispatched to the queue
  • inProgress: The batch processing is currently being processed
  • completed: The batch processing has been completed
  • inError: The batch processing has failed - the error can be seen in the metadata of the batch processing
  • cancelled: The batch processing has been cancelled
  • cancellationRequested: The batch processing cancellation has been requested

Upon completion, the user will be able to download the results of the batch processing in JSON format.