Job Runner

Generate Text From Text and Image Using OpenAI

Summary

Send the messages and images to OpenAI, then retrieve texts from OpenAI.

Usage

To perform this Do, you need to issue an API key with your OpenAI account.

You can send messages and images to the language model provided on OpenAI, then retrieve the texts generated by that model.

The generated texts will be set as the result value of the action. The result value of the action can be referenced using expressions like “= $1”.

Specify the images to be sent to OpenAI using the record and attachment fields. All images in the specified records with attachment fields will be sent to OpenAI.

To send a message to OpenAI without attaching an image, use “Generate Text From Text Using OpenAI”.

Parameters

Set OpenAI API Key, Model, Message, Record Containing Image, Image, and Target Field (Optional).

OpenAI API Key

Specify the API key that OpenAI has issued in advance.

Please note that this is not about the API token on the Kintone app.

Model

Specify the language model to which the messages and images will be sent.

Message

Specify the messages to be sent to OpenAI.

Record Containing Image

Specify the records obtained in advance.

If there are multiple records, images will be collected from all records to send to OpenAI.

If there are no records, no error will occur. In this case, it will be sent to OpenAI without an image.

Image

Select the attachment field for the records specified in the Record Containing Image.

If multiple images are attached in an attachment field, all images will be sent to OpenAI.

If no images are in the attachment field, no error will occur.

Target Field (Optional)

Specify when setting the generated text in the field. If you plan to reuse the text in another Action without exporting it, you can leave this parameter empty.

This parameter accepts the following field types:

  • Text area

This parameter does not accept fields that are inside tables.

Precautions

Please judge the accuracy of the content generated by OpenAI and use it at your own risk.

Restrictions

  • If the total size of “Message” and the images on “Record Containing Image” exceeds approximately 50MB, an error will occur.
  • Text generation by OpenAI will result in an error if it exceeds about 1 minute.
  • The supported image formats depend on OpenAI’s specifications.