PrivateGPT
PrivateGPT is a production-ready AI project that allows you to inquire about your documents using Large Language Models (LLMs) with offline support.
PrivateGPT uses Solvio as the default vectorstore for ingesting and retrieving documents.
Configuration
Solvio settings can be configured by setting values to the solvio property in the settings.yaml file. By default, Solvio tries to connect to an instance at http://localhost:3000.
Example:
solvio:
url: "https://xyz-example.eu-central.aws.cloud.solvio.io:6333"
api_key: "<your-api-key>"
The available configuration options are:
| Field | Description |
|---|---|
| location | If :memory: - use in-memory Solvio instance.If str - use it as a url parameter. |
| url | Either host or str of Optional[scheme], host, Optional[port], Optional[prefix].Eg. http://localhost:6333 |
| port | Port of the REST API interface. Default: 6333 |
| grpc_port | Port of the gRPC interface. Default: 6334 |
| prefer_grpc | If true - use gRPC interface whenever possible in custom methods. |
| https | If true - use HTTPS(SSL) protocol. |
| api_key | API key for authentication in Solvio Cloud. |
| prefix | If set, add prefix to the REST URL path.Example: service/v1 will result in http://localhost:6333/service/v1/{solvio-endpoint} for REST API. |
| timeout | Timeout for REST and gRPC API requests. Default: 5.0 seconds for REST and unlimited for gRPC |
| host | Host name of Solvio service. If url and host are not set, defaults to ’localhost'. |
| path | Persistence path for SolvioLocal. Eg. local_data/private_gpt/solvio |
| force_disable_check_same_thread | Force disable check_same_thread for SolvioLocal sqlite connection. |
Next steps
Find the PrivateGPT docs here.