dify-docs/en/getting-started/readme/specifications-and-technica...

4.4 KiB

description
For those already familiar with LLM application tech stacks, this document serves as a shortcut to understand Dify's unique advantages

Technical Spec

We adopt transparent policies around product specifications to ensure decisions are made based on complete understanding. Such transparency not only benefits your technical selection, but also promotes deeper comprehension within the community for active contributions.

Project Basics

EstablishedMarch 2023
Open Source LicenseApache License 2.0 with commercial licensing
Official R&D TeamOver 10 full-time employees
Community ContributorsOver 70 people
Backend TechnologyPython/Flask/PostgreSQL
Frontend TechnologyNext.js
Codebase SizeOver 130,000 lines
Release FrequencyAverage once per week

Technical Features

LLM Inference EnginesDify Runtime (LangChain removed since v0.4)
Commercial Models Supported10+, including OpenAI and Anthropic
Onboard new mainstream models within 48 hours
MaaS Vendor Supported2, Hugging Face and Replicate
Local Model Inference Runtimes Supported5, Xoribits (recommended), OpenLLM, LocalAI, ChatGLM,Ollama
Multimodal Capabilities

ASR Models

Rich-text models up to GPT-4V specs

Built-in App TypesText generation, Conversational, Agent, Workflow, Group(Q2 2024)
Prompt-as-a-Service Orchestration

Visual orchestration interface widely praised, modify Prompts and preview effects in one place.

Orchestration Modes

  • Simple orchestration
  • Assistant orchestration
  • Flow orchestration
  • Multi-Agent orchestration(Q2 2024)

Prompt Variable Types

  • String
  • Radio enum
  • External API
  • File (Q2 2024)
Agentic Workflow Features

Experience a brand-new visual canvas for orchestration, featuring live-editing node debugging, plug-and-play DSL, native code runtime, for creating more complex, reliable, and stable LLM applications.


Supported Nodes

  • LLM
  • Knowledge Retrieval
  • Question Classifier
  • IF/ELSE
  • CODE
  • Template
  • HTTP Request
  • Tool
RAG Features

Industry-first visual knowledge base management interface, supporting snippet previews and recall testing.

Indexing Methods

  • Keywords
  • Text vectors
  • LLM-assisted question-snippet model

Retrieval Methods

  • Keywords
  • Text similarity matching
  • Hybrid Search
  • N choose 1
  • Multi-path recall

Recall Optimization

  • Re-rank models
ETL Capabilities

Automated cleaning for TXT, Markdown, PDF, HTML, DOC, CSV formats. Unstructured service enables maximum support.

Sync Notion docs as knowledge bases.

Vector Databases SupportedQdrant (recommended), Weaviate, Zilliz
Agent Technologies

ReAct, Function Call.

Tooling Support

  • Invoke OpenAI Plugin standard tools
  • Directly load OpenAPI Specification APIs as tools

Built-in Tools

  • 30+ tools(As of Q1 2024)
LoggingSupported, annotations based on logs
Annotation ReplyBased on human-annotated Q&As, used for similarity-based replies. Exportable as data format for model fine-tuning.
Content ModerationOpenAI Moderation or external APIs
Team CollaborationWorkspaces, multi-member management
API SpecsRESTful, most features covered
Deployment MethodsDocker, Helm