GITBOOK-22: joshua's Nov 28 changes

pull/28/head
joshua 2023-11-28 06:26:53 +00:00 committed by gitbook-bot
parent 1ea4cf04b4
commit b4f30e283e
No known key found for this signature in database
GPG Key ID: 07D2180C7B12D0FF
6 changed files with 128 additions and 70 deletions

Binary file not shown.

After

Width:  |  Height:  |  Size: 130 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 130 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 113 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 56 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 129 KiB

View File

@ -5,52 +5,57 @@ Developers can extend module capabilities through the API extension module. Curr
* `moderation` 
* `external_data_tool` 
Before extending module capabilities, you need to prepare an API and an API Key for authentication (which can also be automatically generated by Dify, optional). In addition to developing the corresponding module capabilities, you also need to follow the specifications below so that Dify can invoke the API correctly.\
Before extending module capabilities, prepare an API and an API Key for authentication, which can also be automatically generated by Dify. In addition to developing the corresponding module capabilities, follow the specifications below so that Dify can invoke the API correctly.
<figure><img src="../../../.gitbook/assets/screenshot-20231128-104353.png" alt=""><figcaption><p>Add API Extension</p></figcaption></figure>
### API Specifications
## API Specifications
Dify will invoke your API according to the following specifications:
#### Header
```
POST {Your-API-Endpoint}
```
### Header
| Header | Value | Desc |
| --------------- | ----------------- | -------------------------------------------------------------------------------------------------------------------------------------------- |
| `Content-Type` | application/json | The request content is in JSON format. |
| `Authorization` | Bearer {api\_key} | The API Key is transmitted as a token. You need to parse the `api_key` and verify if it matches the provided API Key to ensure API security. |
#### Request Body
### Request Body
```JSON
{
"point": string,
"point": string, // Extension point, different modules may contain multiple extension points
"params": {
...
... // Parameters passed to each module's extension point
}
}
```
#### API Response
### API Response
```JSON
{
...
... // For the content returned by the API, see the specific module's design specifications for different extension points.
}
```
### Check
## Check
When configuring API-based Extension in Dify, Dify will send a request to the API Endpoint to verify the availability of the API. When the API Endpoint receives `point=ping`, the API should return `result=pong`, as follows:
#### Header
### Header
```JSON
Content-Type: application/json
Authorization: Bearer {api_key}
```
#### Request Body
### Request Body
```JSON
{
@ -58,7 +63,7 @@ Authorization: Bearer {api_key}
}
```
#### Expected API response
### Expected API response
```JSON
{
@ -69,22 +74,22 @@ Authorization: Bearer {api_key}
\
### For Example
## For Example
Here we take the external data tool as an example, where the scenario is to retrieve external weather information based on the region as context.
#### API Specifications
### API Specifications
`POST https://fake-domain.com/api/dify/receive`
**Header**
### **Header**
```JSON
Content-Type: application/json
Authorization: Bearer 123456
```
**Request Body**
### **Request Body**
```JSON
{
@ -100,7 +105,7 @@ Authorization: Bearer 123456
}
```
**API Response**
### **API Response**
```JSON
{
@ -108,73 +113,93 @@ Authorization: Bearer 123456
}
```
#### Code demo
### Code demo
1. ```Bash
pip install 'fastapi[all]' uvicorn
```
2. ```Python
from fastapi import FastAPI, Body, HTTPException, Header
from pydantic import BaseModel
The code is based on the Python FastAPI framework.
app = FastAPI()
#### **Install dependencies.** &#x20;
<pre><code><strong>pip install 'fastapi[all]' uvicorn
</strong></code></pre>
#### Write code according to the interface specifications.
<pre><code>from fastapi import FastAPI, Body, HTTPException, Header
<strong>from pydantic import BaseModel
</strong>
app = FastAPI()
class InputData(BaseModel):
point: str
params: dict
class InputData(BaseModel):
point: str
params: dict
@app.post("/api/dify/receive")
async def dify_receive(data: InputData = Body(...), authorization: str = Header(None)):
"""
Receive API query data from Dify.
"""
expected_api_key = "123456" # TODO Your API key of this API
auth_scheme, _, api_key = authorization.partition(' ')
@app.post("/api/dify/receive")
async def dify_receive(data: InputData = Body(...), authorization: str = Header(None)):
"""
Receive API query data from Dify.
"""
expected_api_key = "123456" # TODO Your API key of this API
auth_scheme, _, api_key = authorization.partition(' ')
if auth_scheme.lower() != "bearer" or api_key != expected_api_key:
raise HTTPException(status_code=401, detail="Unauthorized")
if auth_scheme.lower() != "bearer" or api_key != expected_api_key:
raise HTTPException(status_code=401, detail="Unauthorized")
point = data.point
point = data.point
# for debug
print(f"point: {point}")
# for debug
print(f"point: {point}")
if point == "ping":
return {
"result": "pong"
}
if point == "app.external_data_tool.query":
return handle_app_external_data_tool_query(params=data.params)
# elif point == "{point name}":
# TODO other point implementation here
if point == "ping":
return {
"result": "pong"
}
if point == "app.external_data_tool.query":
return handle_app_external_data_tool_query(params=data.params)
# elif point == "{point name}":
# TODO other point implementation here
raise HTTPException(status_code=400, detail="Not implemented")
raise HTTPException(status_code=400, detail="Not implemented")
def handle_app_external_data_tool_query(params: dict):
app_id = params.get("app_id")
tool_variable = params.get("tool_variable")
inputs = params.get("inputs")
query = params.get("query")
def handle_app_external_data_tool_query(params: dict):
app_id = params.get("app_id")
tool_variable = params.get("tool_variable")
inputs = params.get("inputs")
query = params.get("query")
# for debug
print(f"app_id: {app_id}")
print(f"tool_variable: {tool_variable}")
print(f"inputs: {inputs}")
print(f"query: {query}")
# for debug
print(f"app_id: {app_id}")
print(f"tool_variable: {tool_variable}")
print(f"inputs: {inputs}")
print(f"query: {query}")
# TODO your external data tool query implementation here,
# return must be a dict with key "result", and the value is the query result
if inputs.get("location") == "London":
return {
"result": "City: London\nTemperature: 10°C\nRealFeel®: 8°C\nAir Quality: Poor\nWind Direction: ENE\nWind "
"Speed: 8 km/h\nWind Gusts: 14 km/h\nPrecipitation: Light rain"
}
else:
return {"result": "Unknown city"}
```
# TODO your external data tool query implementation here,
# return must be a dict with key "result", and the value is the query result
if inputs.get("location") == "London":
return {
"result": "City: London\nTemperature: 10°C\nRealFeel®: 8°C\nAir Quality: Poor\nWind Direction: ENE\nWind "
"Speed: 8 km/h\nWind Gusts: 14 km/h\nPrecipitation: Light rain"
}
else:
return {"result": "Unknown city"}
</code></pre>
#### Launch the API service.
The default port is 8000. The complete address of the API is: `http://127.0.0.1:8000/api/dify/receive`with the configured API Key '123456'.
<pre><code><strong>uvicorn main:app --reload --host 0.0.0.0
</strong></code></pre>
#### Configure this API in Dify.
<figure><img src="../../../.gitbook/assets/screenshot-20231128-104353.png" alt=""><figcaption></figcaption></figure>
#### Select this API extension in the App.
<figure><img src="../../../.gitbook/assets/screenshot-20231128-104353 (1).png" alt=""><figcaption></figcaption></figure>
When debugging the App, Dify will request the configured API and send the following content (example):
@ -200,4 +225,37 @@ API Response
}
```
\
### Local debugging
Since Dify's cloud version can't access internal network API services, you can use Ngrok to expose your local API service endpoint to the public internet for cloud-based debugging of local code. The steps are:
1. Visit the Ngrok official website at [https://ngrok.com](https://ngrok.com/), register, and download the Ngrok file.
<figure><img src="../../../.gitbook/assets/spaces_CdDIVDY6AtAz028MFT4d_uploads_kLpE7vN8jg1KrzeCWZtn_download.webp" alt=""><figcaption></figcaption></figure>
2. After downloading, go to the download directory. Unzip the package and run the initialization script as instructed:
```
$ unzip /path/to/ngrok.zip
$ ./ngrok config add-authtoken 你的Token
```
3. Check the port of your local API service.
<figure><img src="../../../.gitbook/assets/spaces_CdDIVDY6AtAz028MFT4d_uploads_Z1SpULkGZ0xDBnSXOhC1_8000.webp" alt=""><figcaption></figcaption></figure>
Run the following command to start:
```
$ ./ngrok http [port number]
```
Upon successful startup, you'll see something like the following:
<figure><img src="../../../.gitbook/assets/spaces_CdDIVDY6AtAz028MFT4d_uploads_8EgAgdMcArHAaJJFEEWA_ngrock copy.jpg" alt=""><figcaption></figcaption></figure>
4. Find the 'Forwarding' address, like the sample domain `https://177e-159-223-41-52.ngrok-free.app`, and use it as your public domain.
* For example, to expose your locally running service, replace the example URL `http://127.0.0.1:8000/api/dify/receive` with `https://177e-159-223-41-52.ngrok-free.app/api/dify/receive`.
Now, this API endpoint is accessible publicly. You can configure this endpoint in Dify for local debugging. For the configuration steps, consult the appropriate documentation or guide.